The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “thought leadership”

Why Column-Aware Metadata Is Key to Automating Data Transformation

So it is 2023, and like everyone, I have a few predictions. Check out my thoughts in this post about automating data transformations using column-aware metadata and why it is critical to the success of more collaboration and data sharing..

Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. 

In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption. This process is known as data transformation, and while automation in many areas of the data ecosystem has changed the data industry over the last decade, data transformations have lagged behind. 

That started to change in 2022, and in 2023 I predict we will see an accelerated adoption of platforms that enable data transformation automation. 

Read the rest of the post here – Why Column-Aware Metadata Is Key to Automating Data Transformation

May 2023 be your most agile year yet!

Kent

The Data Warrior

#TrueDataOps Podcast: Ultimate Guide

In case you have been under a rock these last few months (or just busy with holiday plans), I started doing a weekly, livestream podcast call #TrueDataOps. Details below for a recap of 2022 and a look at what’s ahead on the show for 2023.

The Seven Pillars of #TrueDataOps

Hosted by Kent Graziano, aka The Data Warrior, the #TrueDataOps Podcast launched in November 2022, bringing together leading lights in the industry to discuss all matters DataOps, and in particular its journey towards maturity.  

Kent has met thought leaders, innovators, and pioneering user organizations at the forefront of the #TrueDataOps revolution – with the story continuing into 2023 and beyond. 

We are working on a great lineup of guests for 2023 to help us understand not only the technical aspects of implementing a #TrueDataOps approach, but also the organizational aspects. So, we will address not only the “what” but the who, when, and most importantly “why” organizations need this. 

Check out the rest of the post for all the details and how to get notifications of upcoming episodes: #TrueDataOps Podcast: Ultimate Guide

I hope you will kick off the new year by joining us. Happy viewing!

Kent

The Data Warrior

Panel Discussion: Data Modeling in a Data Mesh World

Happy New Year y’all!

Last month I had the pleasure of chatting with two of my data modeling pals about how to think about data modeling in a #DataMesh architecture. The recording was hosted by the Data Mesh Learning Community in partnership with Data Mesh Radio.

Juha Korpela (Chief Product Officer at Ellie Technologies) facilitated this panel with Veronika Durgin (Head of Data at Saks) and myself (The Data Warrior). Watch (or listen) to learn why Veronika and I consider Data Vault to be the best choice available right now, why only focusing on the technical aspects of data modeling instead of the business will lead you astray, how to build in iterations, change management for data modeling, and much more!

Watch the video replay here: Panel: Data Modeling in Data Mesh

If you want to just listen, check out the podcast audio, which has some nice notes from Scott Hirleman from the Data Mesh Learning Community.

Enjoy!

Kent

The Data Warrior

The New Modern Data Stack

Hey gang – sorry for the last minute update but I will be going LIVE early next Monday December 19th for an exciting event hosted by Datacated.

Join me, along with Vinay Samuel, Founder & CEO of Zetaris as we talk about the NEW modern data stack. We will be discussing:

  • The new way for data consumption & connection
  • Methods for quicker data project execution
  • The engine of engines & architectural optionality for data integration
  • The future of data in 2023

We will also take questions from the live audience!

This is an event you won’t want to miss!

Register today at: https://hubs.ly/Q01vHw4c0 

See you there!

Kent

The Data Warrior

The Role of DataOps in a Data Mesh Architecture

Hot off the press – a new post discussing two of today’s hottest topics – #DataMesh and #DataOps.

Data Mesh is a decentralized architecture that organizes data by specific business domains and teams, leveraging a self-service approach. It’s designed to provide greater ownership and responsibility to Data Product teams and, it is hoped, more effective outputs in a timely manner. 

Data mesh is founded on four pillars: 

  • Empowered domain ownership – letting the experts who know the data best do their jobs. 
  • Cross organizational transport – enabling consumption through data products. 
  • Self-service analytical platform – reducing costs, improving agility. 
  • Federated governance – the ‘glue’ that holds the process together, enabling interoperability and compliance. 

Is DataOps simply an enabler for more sophisticated design patterns like Data Mesh?  If we carry on with DevOps thinking – considering how the involvement of end users in a product lifecycle went from passive to truly active, one starts to see that it’s more than that. 

Read the rest of the post here – The Role of DataOps in a Data Mesh Architecture

Happy reading.

Kent

The Data Warrior

Post Navigation

%d bloggers like this: