The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “thought leadership”

Federated Governance: Why it Matters and Why it’s Essential for Data Mesh

How do you balance agility and governance, particularly when you now have the capability to ingest, deploy and transform massive amounts of data at a scale that no-one had previously dreamed of? And often this is sensitive data. Perhaps you’re working a highly regulated area like healthcare or financial services.  

How can you ensure domain teams adhere to the rules and standards while also giving them freedom and autonomy – the responsibility – to manage and develop data products appropriate to their domains, without it turning into a free-for-all? 

The concept of federated governance isn’t new but the popularity of data mesh means it’s become a much hotter topic, and a challenge for teams to solve. One of the four pillars of data mesh, a federated data governance framework provides for some centralized management, for enterprise level rules and standards,  but the ultimate responsibility to apply and execute the rules is decentralized to the domains.  

In short, it’s a way to ensure good governance with the right rules being applied in the right ways to the right data but through a more flexible approach, one that empowers domain team developers and supports collaborative working.   

Read the rest of the post here: Federated Governance: Why it Matters and Why it’s Essential for Data Mesh

Ciao for now!

Kent

The Data Warrior

Why Column-Aware Metadata Is Key to Automating Data Transformation

So it is 2023, and like everyone, I have a few predictions. Check out my thoughts in this post about automating data transformations using column-aware metadata and why it is critical to the success of more collaboration and data sharing..

Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. 

In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption. This process is known as data transformation, and while automation in many areas of the data ecosystem has changed the data industry over the last decade, data transformations have lagged behind. 

That started to change in 2022, and in 2023 I predict we will see an accelerated adoption of platforms that enable data transformation automation. 

Read the rest of the post here – Why Column-Aware Metadata Is Key to Automating Data Transformation

May 2023 be your most agile year yet!

Kent

The Data Warrior

#TrueDataOps Podcast: Ultimate Guide

In case you have been under a rock these last few months (or just busy with holiday plans), I started doing a weekly, livestream podcast call #TrueDataOps. Details below for a recap of 2022 and a look at what’s ahead on the show for 2023.

The Seven Pillars of #TrueDataOps

Hosted by Kent Graziano, aka The Data Warrior, the #TrueDataOps Podcast launched in November 2022, bringing together leading lights in the industry to discuss all matters DataOps, and in particular its journey towards maturity.  

Kent has met thought leaders, innovators, and pioneering user organizations at the forefront of the #TrueDataOps revolution – with the story continuing into 2023 and beyond. 

We are working on a great lineup of guests for 2023 to help us understand not only the technical aspects of implementing a #TrueDataOps approach, but also the organizational aspects. So, we will address not only the “what” but the who, when, and most importantly “why” organizations need this. 

Check out the rest of the post for all the details and how to get notifications of upcoming episodes: #TrueDataOps Podcast: Ultimate Guide

I hope you will kick off the new year by joining us. Happy viewing!

Kent

The Data Warrior

Panel Discussion: Data Modeling in a Data Mesh World

Happy New Year y’all!

Last month I had the pleasure of chatting with two of my data modeling pals about how to think about data modeling in a #DataMesh architecture. The recording was hosted by the Data Mesh Learning Community in partnership with Data Mesh Radio.

Juha Korpela (Chief Product Officer at Ellie Technologies) facilitated this panel with Veronika Durgin (Head of Data at Saks) and myself (The Data Warrior). Watch (or listen) to learn why Veronika and I consider Data Vault to be the best choice available right now, why only focusing on the technical aspects of data modeling instead of the business will lead you astray, how to build in iterations, change management for data modeling, and much more!

Watch the video replay here: Panel: Data Modeling in Data Mesh

If you want to just listen, check out the podcast audio, which has some nice notes from Scott Hirleman from the Data Mesh Learning Community.

Enjoy!

Kent

The Data Warrior

The New Modern Data Stack

Hey gang – sorry for the last minute update but I will be going LIVE early next Monday December 19th for an exciting event hosted by Datacated.

Join me, along with Vinay Samuel, Founder & CEO of Zetaris as we talk about the NEW modern data stack. We will be discussing:

  • The new way for data consumption & connection
  • Methods for quicker data project execution
  • The engine of engines & architectural optionality for data integration
  • The future of data in 2023

We will also take questions from the live audience!

This is an event you won’t want to miss!

Register today at: https://hubs.ly/Q01vHw4c0 

See you there!

Kent

The Data Warrior

Post Navigation

%d bloggers like this: