The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the tag “data mesh”

10 Jan 2023

Panel Discussion: Data Modeling in a Data Mesh World

Happy New Year y’all!

Last month I had the pleasure of chatting with two of my data modeling pals about how to think about data modeling in a #DataMesh architecture. The recording was hosted by the Data Mesh Learning Community in partnership with Data Mesh Radio.

Juha Korpela (Chief Product Officer at Ellie Technologies) facilitated this panel with Veronika Durgin (Head of Data at Saks) and myself (The Data Warrior). Watch (or listen) to learn why Veronika and I consider Data Vault to be the best choice available right now, why only focusing on the technical aspects of data modeling instead of the business will lead you astray, how to build in iterations, change management for data modeling, and much more!

Watch the video replay here: Panel: Data Modeling in Data Mesh

If you want to just listen, check out the podcast audio, which has some nice notes from Scott Hirleman from the Data Mesh Learning Community.

Enjoy!

Kent

The Data Warrior

Posted in Data Modeling, thought leadership and tagged , , , , | Leave a comment
08 Dec 2022

The Role of DataOps in a Data Mesh Architecture

Hot off the press – a new post discussing two of today’s hottest topics – #DataMesh and #DataOps.

Data Mesh is a decentralized architecture that organizes data by specific business domains and teams, leveraging a self-service approach. It’s designed to provide greater ownership and responsibility to Data Product teams and, it is hoped, more effective outputs in a timely manner. 

Data mesh is founded on four pillars: 

  • Empowered domain ownership – letting the experts who know the data best do their jobs. 
  • Cross organizational transport – enabling consumption through data products. 
  • Self-service analytical platform – reducing costs, improving agility. 
  • Federated governance – the ‘glue’ that holds the process together, enabling interoperability and compliance. 

Is DataOps simply an enabler for more sophisticated design patterns like Data Mesh?  If we carry on with DevOps thinking – considering how the involvement of end users in a product lifecycle went from passive to truly active, one starts to see that it’s more than that. 

Read the rest of the post here – The Role of DataOps in a Data Mesh Architecture

Happy reading.

Kent

The Data Warrior

Posted in Big Data, thought leadership and tagged , , , , | Leave a comment
09 May 2022
1 Comment

Data Vault and Data Mesh – A Match Made in the Cloud?

Check out my latest thoughts about Data Vault and Data Mesh:

Over the last six years (after I joined Snowflake basically), I have witnessed a massive increase in the interest and implementation of Data Vault 2.0. I have talked to literally hundreds of companies across the globe and across all industries about changing their approach to building an enterprise data platform. It was sort of mind boggling how many folks wanted to speak to me about this. So why, after almost two decades of successful data vault implementations, have so many people “suddenly” got interested in Data Vault?

Well, a few reasons:

1. They are moving to the cloud (in this case, Snowflake) and figured it was time to look at their approach to data warehousing and data lakes.

2. What they had been doing for decades, on critical review, really was not working (i.e., lots of expensive re-engineering all the time) and definitely could not scale.

3. Things are changing so rapidly, they needed to find a way to be more agile.

Read the rest of the post here on the Data Rebels site to find out how Data Vault relates to Data Mesh – Data Vault and Data Mesh

What do you think?

Have a great week!

Kent

The Data Warrior

Posted in Data Vault, Data Warehouse, thought leadership and tagged , , , , , , ,
06 Dec 2021
1 Comment

Data Mesh Learning – Interview with The Data Warrior

Last week I had the privilege of being interviewed by Nick Heudecker (former Gartner analyst and current Senior Director at Cribl) for the Data Mesh Learning Community. In our interview, we covered the idea of empowering business domains to really own and manage their data via things like templates and a center of excellence, not to just give them the responsibility of owning their data and leaving them to figure the rest out on their own. We also discussed the need for organizations to focus on investing in growing a data culture, not just investing in the newest cloud based tooling. Really, how do we lower the barriers to accessing, sharing, and leveraging data and get people to really think about data-as-a-product.

Like Agile before it, Data Mesh is as much about changing the way an organization thinks and works as it is about technology. I argue that the people and organization aspects of adopting a data mesh approach are more important than the technology aspects. Without the right approach, the best technology (like Snowflake), is not going to solve your organization’s data problems.

See the full interview here:

So what do you think about all this data mesh stuff?

Cheers!

Kent

The Data Warrior

P.S. For much more on the thoughts about #datamesh, check the other podcasts and videos listed on my Snowflake Resources page.

Posted in #cloud, SnowflakeDB, thought leadership and tagged , , , , , , , , ,

Post Navigation

%d bloggers like this: