The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the tag “Data Warehouse”

Why Column-Aware Metadata Is Key to Automating Data Transformation

So it is 2023, and like everyone, I have a few predictions. Check out my thoughts in this post about automating data transformations using column-aware metadata and why it is critical to the success of more collaboration and data sharing..

Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. 

In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption. This process is known as data transformation, and while automation in many areas of the data ecosystem has changed the data industry over the last decade, data transformations have lagged behind. 

That started to change in 2022, and in 2023 I predict we will see an accelerated adoption of platforms that enable data transformation automation. 

Read the rest of the post here – Why Column-Aware Metadata Is Key to Automating Data Transformation

May 2023 be your most agile year yet!

Kent

The Data Warrior

All new Data Vault Alliance Forums are open!

Great news for all fans and followers of #DataVault – Ask DVA forums are up and running!

You can sign up at https://forums.datavaultalliance.com

These all new forums are the sanctioned voice of DVA (Data Vault Alliance). That means you can expect the answers will be reviewed and in compliance with data vault standards and best practices as taught by Dan Linstedt and all the authorized DV 2.0 CDVP trainers. Hopefully this will help reduce confusion in the market and assist organizations in successfully applying the approach.

Other (important) details:

  • 100% free – to anyone and everyone
  • Anyone that has an account can: reply, or post a new topic.
  • 100% readable by guests – without ever creating an account
  • 100% moderated (by DVA for starters, by a few others that have already agreed to moderate)
  • Members can POST POLLS!!!

And better still, the forums are OPEN to both Business and Technical questions!!

You can expect answers to your toughest data vault questions through examples, best practices, and standards.

So why wait? Hop on now and take a minute to view the forums, sign up / register, and possibly ask or reply to questions.

Enjoy!

Kent

The Data Warrior

How Data Vault 2.0 Supports Your Data Governance Strategy – Part 1

Data Vault 2.0 is way more than just a data modeling approach. In fact it is an entire methodology and architecture for building business intelligence and analytic solutions. This is a post just released that I wrote for Data Rebels on how DV2 actually supports various aspects of data governance. Check it out.

With the growth of volume and diversity of data in recent years, it has become even more critical for organizations to develop an effective and scalable strategy for data governance and its closely aligned sibling discipline – Master Data Management. The importance of ensuring the security and the quality of data has never been more important than now. Add to that the increased pressures for regulatory compliance and privacy concerns, having a solid approach to data governance is no longer an option, it’s a necessity. In this 2-part blog series, I will discuss how the Data Vault 2.0 System of Business Intelligence addresses these concerns and incorporates both Data Governance and Master Data Management. 

Read the entire post here: Data Vault 2.0 and Data Governance – Part 1.

Stay tuned for Part 2!

Kent

The Data Warrior

SqlDBM – Advisor and Speaker

Just a quick note – I just found out SqlDBM has featured me on their new advisors page. Check it out.

Also wanted to remind everyone that I will be giving a webinar next week, August 17th on Data Modeling for Snowflake, Sign up here for that. It will be fun for sure.

Ciao for now!

Kent

The Data Warrior

To Train or Not to Train – Is That Still a Question?

For years I have been an advocate for training, of all kinds. In my recent post for DataRebels, I dicuss the pros and cons of getting trained along with reasons peopleoften give for not investing in professional training.

Sadly, for decades now, I have seen way too many people and organizations give professional training, and certification, short shrift

.Much to their detriment in the end.

This has always baffled me because I have always found value in attending training classes, workshops, seminar, technical conferences, and the like. Even if the class was not great, the contacts I made were always invaluable.I find I learn best working directly with an experienced professional who has “been there and done that”. Or, putting it another way, I like to learn from other people’s mistakes! For me nothing replaces the ability to be interactive and ask questions of a qualified instructor.

The reasons people have given me for NOT taking a training class are basic (i.e., typical):

1. It costs too much (i.e., no budget)

2. I can’t take time away from the daily job (or I can’t afford to have my team out of the office that long)

3. “It’s really not that hard – we can figure it out ourselves reading books and blogs”

Check out how I combat these attitudes by reading the rest of the post at To Train or Not to Train.

Enjoy (and get thee trained!)

Kent

The Data Warrior

Post Navigation