The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “#cloud”

Mass Data Fragmentation: Reducing ‘Data Puddles’

Shortly before leaving Snowflake last year, I was interviewed for this post about one of the worst case examples of data siloes I had seen – we called them data puddles!

A few years ago, Kent Graziano joined a big organization to work on its data. The first problem was that nobody really knew what and where all the data was. Graziano took his first three months on the job investigating data sources and targets, ultimately creating an enterprise data map to illustrate all the flows. It wasn’t pretty.

“In the end, I discovered that the same data was being sent to three or four places,” he said. In one case raw data was transformed and stored in a data warehouse, then moved from there into another warehouse—which was also pulling in the original raw data.

Graziano, who recently retired from his post as Chief Technical Evangelist at Snowflake, said this scenario is entirely common. Data scattered and copied in lakes, warehouses, data marts, SaaS platforms, spreadsheets, test systems, and more. That’s mass data fragmentation, or, more colloquially, data sprawl or data puddles. 

Indeed, 75% of organizations do not have a complete architecture in place to manage an end-to-end set of data activities including integration, access, governance, and protection, according to IDC’s State of the CDO research, December 2021. This lack of governance combines with legacy systems, shadow IT, and good intentions to pave the road to a lot of fragmentation.

Check out the rest of the post to learn how data sprawl hurts businesses and what to do about it. Read it all here!

Try not to step into any of those puddles!

Kent

The Data Warrior

Data Mesh Learning – Interview with The Data Warrior

Last week I had the privilege of being interviewed by Nick Heudecker (former Gartner analyst and current Senior Director at Cribl) for the Data Mesh Learning Community. In our interview, we covered the idea of empowering business domains to really own and manage their data via things like templates and a center of excellence, not to just give them the responsibility of owning their data and leaving them to figure the rest out on their own. We also discussed the need for organizations to focus on investing in growing a data culture, not just investing in the newest cloud based tooling. Really, how do we lower the barriers to accessing, sharing, and leveraging data and get people to really think about data-as-a-product.

Like Agile before it, Data Mesh is as much about changing the way an organization thinks and works as it is about technology. I argue that the people and organization aspects of adopting a data mesh approach are more important than the technology aspects. Without the right approach, the best technology (like Snowflake), is not going to solve your organization’s data problems.

See the full interview here:

So what do you think about all this data mesh stuff?

Cheers!

Kent

The Data Warrior

P.S. For much more on the thoughts about #datamesh, check the other podcasts and videos listed on my Snowflake Resources page.

Snowday! Sunny, with a 100% Chance of Innovation

What a great event! So many announcements and great demos, plus and awesome live Q&A with our Snowflake leaders.

At Snowday 2021, Snowflake announced exciting new product capabilities that expand what is possible in the Data Cloud. In addition to announcing Python support in Snowpark (currently in private preview), these latest innovations make it easier for organizations to maintain business continuity across clouds and regions; help data engineers and data scientists build pipelines, ML workflows, and data applications faster; and remove the complexity of getting the right data into the hands of customers.

The Snowflake Data Cloud is a global network connecting organizations through data, creating new opportunities for collaboration to improve business outcomes, and fundamentally changing what is possible across industries. For Kraft Heinz, its data science teams are able to build and test models dramatically faster in Snowflake compared with its prior data lake. For NBCUniversal, it’s building brand-new advertising targeting and measurement products, in a secure and privacy-compliant way using Snowflake’s governance and data sharing capabilities. And for 84.51°, it’s built a Collaborative Cloud that takes complexity off the table and unlocks new possibilities for grocers and CPGs sharing and collaborating on data.

Snowflake continues to expand the scope and possibilities of the Data Cloud, delivering unique innovations that enable customers to:

  • Operate globally
  • Eliminate silos
  • Build faster
  • Create new businesses

Catch up on all the details on the  Snowflake blog.

Check it out!

Kent

The Data Warrior

P.S. Registration for Snowflake Summit 2022 is now open!

 

Snowflake Resources from The Data Warrior

Since you are on this blog, I assume that means you are “following” me in that techie, non-stalker sort of way. 😉

That being the case you are aware of my tenure for the last 5+ years at the hottest data-focused software company in the world – Snowflake. And you know I have produced a lot of content (really – A LOT!). Everything from blogs to ebooks to videos to podcasts – in addition to my usual array of industry and Snowflake sponsored webinars and talks.

But if, like me, you have consumed so much content in the last year or so, you have probably lost track of some of it, right?

Well if you are trying to find something you saw me do (or tweet about doing) but just can’t remember what it was (or when or where) and you want to find it but don’t want to sift through the hundreds of Google search results or the thousands of social media posts I have done, look no further!

I decided to make it easier for you (and me frankly) by putting a pretty comprehensive list together on a permanent page here on my site.

I broke it up into videos/Podcasts, Thought Leader articles, ebooks, and blogs and have included links to all of these so you can quickly get to the content you need when you need it.

So check it out and bookmark the page now, before you forget or lose track of this post too. 🙂

You’re welcome.

Kent

The Data Warrior

Snowflake Summit 2021

It’s almost time! The annual Snowflake Summit is just a few weeks away.

Data is everywhere and it holds the keys to unlocking your organization’s success today and in the future. Attend Snowflake Summit and you’ll learn how to use the #DataCloud to unify, analyze, and share data previously out of your reach for more impact than you have ever imagined.

Data Together Now will inspire business and technical leaders, data scientists and engineers, data and analytics professionals, and application developers, to lead their organizations to a data-driven future, today. There is something for everyone in the organization.

You can be a DATA LEADER!

SAVE THE DATE:

AMERICAS: June 8-9  | 9  am PT  |  12 pm ET |  View Agenda

ASIA PACIFIC: June 9-10  | 10 am AEST  |  9 am JST |   View Agenda

EMEA AND INDIA: June 9-10  | 9 am BST  |  10 am CEST  |  1.30 pm IST |  View Agenda

So what are you waiting for? Register today.

Let it snow!

Kent

The Data Warrior

Post Navigation