The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “Data Warehouse”

26 Sep 2025
1 Comment

Attention #DataVault fans – Check out the all new DVAUnited site

You may have missed it, but Dan Linstedt has evolved the Data Vault System from 2.0 to 2.1 (lots of new stuff in there!). Along with that, he has decommissioned the original Data Vault Alliance site and forums and replaced it with an all new, modern, home for DV 2.1 that he calls DVA United.

Why “united?” Because we finally have access to all things data vault under one roof – just one site for learning, discussing, and connecting. This gives us a central location for community driven learning and support. That includes active engagement, online discussions, and live Q&A sessions with Dan Linstedt himself.

If you are embarking on a new Data Vault 2.x project or already in the middle of one, this is the most economical way to get the coaching and mentoring you need from not only Dan, but other industry experts (like myself occasionally).

As a member (yes, there is a fee for all this goodness), you gain access to in-depth resources, expert-led discussions, and live events designed to help you master the architecture, methodology, and modeling practices that make Data Vault effective. More importantly, you’ll build confidence in your projects by applying techniques supported by a global network of professionals who have been where you are now.

If you are a recruiter or consultancy looking for highly qualified Data Vault practitioners, there is a new Talent Connect feature just for you (seperate fee applies). So why search the internet and LinkedIn, when you can go one place to find folks who are actively looking for new gigs?

For instant access to all this goodness, all you have to do is sign up for Starter Membership (which includes a 10 day trial). With that you get:

  • 1 Quarterly Q&A Webinar
  • Starter Resources
  • Podcasts
  • Tips and Tricks
  • SQL Downloads
  • Articles
  • Data Vault Discussions
  • Hot Topics
  • Fun Data Memes
  • Direct Private Messaging
  • Access to Talent Connect (to add yourself if you are on the hunt)

With the Pro Membership, you get these additional benefits:

  • Monthly Q&A Webinars
  • Quarterly Topic Webinars
  • Access to Past Q&A Webinars
  • Access to WWDVC Videos
  • BI (AI) Prompt Exchange
  • Access to Pro Resources
  • Pro-Specific Courses

If you like what you see and learn (I am sure you will), then you can sign up for either the Starter membership or the Pro membership. As a bonus, because you read my blog, you can use the code KG30YCD to get 30% your quarterly membership fee. Cancel anytime.

So, check the new site out today and take your Data Vault game to new heights.

Happy Data Vaulting!

Kent

The Data Warrior

Posted in Data Vault, Data Warehouse and tagged , , , , , ,
26 Jan 2023

Why Column-Aware Metadata Is Key to Automating Data Transformation

So it is 2023, and like everyone, I have a few predictions. Check out my thoughts in this post about automating data transformations using column-aware metadata and why it is critical to the success of more collaboration and data sharing..

Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. 

In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption. This process is known as data transformation, and while automation in many areas of the data ecosystem has changed the data industry over the last decade, data transformations have lagged behind. 

That started to change in 2022, and in 2023 I predict we will see an accelerated adoption of platforms that enable data transformation automation. 

Read the rest of the post here – Why Column-Aware Metadata Is Key to Automating Data Transformation

May 2023 be your most agile year yet!

Kent

The Data Warrior

Posted in Big Data, Data Warehouse, thought leadership and tagged , , , , , , , , , | Leave a comment
16 Dec 2022

The New Modern Data Stack

Hey gang – sorry for the last minute update but I will be going LIVE early next Monday December 19th for an exciting event hosted by Datacated.

Join me, along with Vinay Samuel, Founder & CEO of Zetaris as we talk about the NEW modern data stack. We will be discussing:

  • The new way for data consumption & connection
  • Methods for quicker data project execution
  • The engine of engines & architectural optionality for data integration
  • The future of data in 2023

We will also take questions from the live audience!

This is an event you won’t want to miss!

Register today at: https://hubs.ly/Q01vHw4c0 

See you there!

Kent

The Data Warrior

Posted in #cloud, Big Data, Data Warehouse, thought leadership and tagged , , , , , , | Leave a comment
16 Nov 2022

The Data Warrior Way – DataOps: Past, Present, and Future

Heads up gang – I will be doing a webinar on #TrueDataOps on Wednesday, Nov 30th!

4 pm UTC – 10 am CDT, 11 am ET, 4 pm London, 5 pm CET

During this 60-minute live webinar, I will delve deeper into this topic to share my thoughts on DataOps. What is it? How is it different from DevOps? Where is it headed?

Join me to learn about the seven key pillars of #TrueDataOps:

  • ELT and the spirit of ELT
  • Continuous Integration / Continuous Deployment (CI/CD)
  • Code design and maintainability
  • Environment management
  • Governance and change control
  • Automated testing and monitoring
  • Collaboration and self-service

Come learn what DataOps REALLY IS, and how it’s guiding philosophy can help you deliver data projects faster and better.​

Sign up today to reserve you space! (Yes – it will be recorded!)

The Data Warrior Way – DataOps: Past, Present, and Future | WhereScape

See you there!

Kent

The Data Warrior

Posted in Big Data, Data Warehouse, thought leadership and tagged , , , | Leave a comment
06 Oct 2022

The Hype:  Data Mesh Will Become Obsolete – Really?

Data Mesh is indeed a hot topic these days. Is it the answer to all our big data problems? Probably not, but it will help some organizations. Is it obsolete? See what I think in this recent blog post…

In the summer of 2022, Gartner® published its Hype Cycle on Data Management, and this was not without some controversy.

In particular, it asserted that Data Mesh will be obsolete before it reaches what Gartner calls the Plateau of Productivity. It is hard to fathom how they came to that conclusion when there is such a vibrant Data Mesh Community complete with a very active Slack channel, and when DataOps.live customers like Roche and OneWeb have successfully built a Data Mesh using DataOps.live and Snowflake. But we’ll come back to that in a moment.

Data Mesh is in essence a conceptual approach and architectural framework, not a specific off-the-shelf tool or technology. One of the main precepts for its creation is angled towards improving productivity and time to value by eliminating the perceived bottlenecks that have been experienced by organizations building out large-scale enterprise data warehouses and data lakes.  Zhamak Deghani, the creator of the Data Mesh concept, has referred to it as a decentralized sociotechnical approach – meaning it involves people, processes and technology. So, it seems likely that no two implementations will be the same by their nature. How one organization defines productivity based on its specific needs and outputs on its own application of Data Mesh will differ from another. Yes, Data Mesh is (kind of) new and yes, it is maturing, but that does not mean we should ignore or discount it this early in the game.

It is hard these days to separate the hype from the reality so check out the entire post over at the DataOps.live blog.

Cheers.

Kent

The Data Warrior

Posted in Big Data, Data Warehouse, thought leadership and tagged , , , , , | Leave a comment

Post Navigation

← Older Entries