The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “thought leadership”

Better Data Models (redux)

Lately there have been quite a few posts and articles about what is needed for AI to be successful. In the data world, that means high quality data is table stakes. But it’s not just the data in your database. It’s having nailed down the semantic meaning of that data (in business terms) and all the context surrounding that data (including relationships to other data and systems).

It sounds like we need to get back to the basics of good #datamanagment (like #DAMA has taught for decades via their DMBOK and certifications).

And that gets back to having a well curated #datamodel (you must have seen that coming from me!). And that then reminded me that I once wrote a book with a Checklist for Data Model Design Reviews. And it is still available on Amazon! Check it out: https://lnkd.in/gVE4u5FR

By no means is it everything you need to be successful in building a data driven #AI agent or process, but if you have not looked at your data models in years, or (more likely) don’t have one, this will get you started in the right direction to at least ask the questions of your data team to see where you are.

The output from AI is only as good as the information we make available to it. So get going and make sure your data is indeed #AIReady.

NB – the book mentions specific data modeling tools I have used in the past, but the concepts and questions can be applied to any modeling tool you are using today.

Model on!

Kent G

#TrueDataOps Podcast Returns with Season 2 on Sept 6th

LONDON, Aug. 30, 2023 /PRNewswire/ — Prepare for an enriching deep dive into the rapidly evolving world of DataOps as the highly acclaimed #TrueDataOps podcast series returns for its second season on September 6th, at 8AM Pacific Time, 3pm GMT. Hosted by the distinguished Kent Graziano, The Data Warrior, the podcast delivers a wealth of technical knowledge and expert education to data professionals navigating the complexities of modern data management.

Following a remarkable inaugural season that featured 18 noteworthy guests and amassed over 10,000 views, Season 2 is poised to deliver an even more profound impact. With a steadfast commitment to providing listeners with unparalleled insights, this season aims to equip data practitioners with the tools and knowledge necessary to excel in the evolving DataOps landscape.

Check out the full press release with links to sign up for notification.

Hope you will join me for season 2!

Kent

The Data Warrior

Federated Governance: Why it Matters and Why it’s Essential for Data Mesh

How do you balance agility and governance, particularly when you now have the capability to ingest, deploy and transform massive amounts of data at a scale that no-one had previously dreamed of? And often this is sensitive data. Perhaps you’re working a highly regulated area like healthcare or financial services.  

How can you ensure domain teams adhere to the rules and standards while also giving them freedom and autonomy – the responsibility – to manage and develop data products appropriate to their domains, without it turning into a free-for-all? 

The concept of federated governance isn’t new but the popularity of data mesh means it’s become a much hotter topic, and a challenge for teams to solve. One of the four pillars of data mesh, a federated data governance framework provides for some centralized management, for enterprise level rules and standards,  but the ultimate responsibility to apply and execute the rules is decentralized to the domains.  

In short, it’s a way to ensure good governance with the right rules being applied in the right ways to the right data but through a more flexible approach, one that empowers domain team developers and supports collaborative working.   

Read the rest of the post here: Federated Governance: Why it Matters and Why it’s Essential for Data Mesh

Ciao for now!

Kent

The Data Warrior

Why Column-Aware Metadata Is Key to Automating Data Transformation

So it is 2023, and like everyone, I have a few predictions. Check out my thoughts in this post about automating data transformations using column-aware metadata and why it is critical to the success of more collaboration and data sharing..

Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. 

In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption. This process is known as data transformation, and while automation in many areas of the data ecosystem has changed the data industry over the last decade, data transformations have lagged behind. 

That started to change in 2022, and in 2023 I predict we will see an accelerated adoption of platforms that enable data transformation automation. 

Read the rest of the post here – Why Column-Aware Metadata Is Key to Automating Data Transformation

May 2023 be your most agile year yet!

Kent

The Data Warrior

#TrueDataOps Podcast: Ultimate Guide

In case you have been under a rock these last few months (or just busy with holiday plans), I started doing a weekly, livestream podcast call #TrueDataOps. Details below for a recap of 2022 and a look at what’s ahead on the show for 2023.

The Seven Pillars of #TrueDataOps

Hosted by Kent Graziano, aka The Data Warrior, the #TrueDataOps Podcast launched in November 2022, bringing together leading lights in the industry to discuss all matters DataOps, and in particular its journey towards maturity.  

Kent has met thought leaders, innovators, and pioneering user organizations at the forefront of the #TrueDataOps revolution – with the story continuing into 2023 and beyond. 

We are working on a great lineup of guests for 2023 to help us understand not only the technical aspects of implementing a #TrueDataOps approach, but also the organizational aspects. So, we will address not only the “what” but the who, when, and most importantly “why” organizations need this. 

Check out the rest of the post for all the details and how to get notifications of upcoming episodes: #TrueDataOps Podcast: Ultimate Guide

I hope you will kick off the new year by joining us. Happy viewing!

Kent

The Data Warrior

Post Navigation