The Data Warrior

Changing the world, one data model at a time. How can I help you?

Better Data Modeling: 7 Differentiating Characteristics of Data Vault 2.0

Hard to believe that the 2nd Annual World Wide Data Vault Consortium (WWDVC15) is NEXT WEEK in beautiful Stowe Vermont. It promises to be an excellent event. The speakers include myself, Claudia Imhoff, Dan Linstedt (the inventor of Data Vault), Scott Ambler, Roelant Vos, Dirk Lerner and many more. The focus will be DV 2.0, agile data warehousing, big data, NoSQL, virtualization and automation. Check out the agenda here: http://wwdvc.com/schedule/

So in preparation (and to encourage you to attend), I thought it might be good to review some of the important basics about Data Vault 2.0 and why it is an important evolution for the data warehousing community.

The approach started out as the Common Foundational Warehouse Modeling Architecture as it’s official name. Then it was more commonly known as the “Data Vault” and became a modelling method for Data Warehouses. It also had a methodology with implementation guidelines and worked very, very well on relational platforms for many, many years (over 10 years for those who did not know).

But technology evolved. NoSQL architectures came into the picture primarily as sources. The Apache Hadoop platform started offering a cheaper storage and processing MPP architecture.

Data Vault evolved into Data Vault 2.0 and already has many successful implementations. The original Data Vault is now referred to as Data Vault 1.0 (or DV 1.0) and it primarily has a modelling focus. DV 2.0 on the other hand changes some things, and adds a LOT.

Data Vault 2.0 has the following 7 differing characteristics:

1. DV 2.0 is a complete system of Business Intelligence. It talks about everything from concept to delivery. While DV 1.0 had a major focus on modelling and many of the modelling concepts are similar, DV 2.0 goes a step further and talks about data from source to business user facing constructs with guidelines for implementation, agile, virtualization and more.

2. DV 2.0 can adapt to changes better than pretty much ANY other data warehouse architecture or framework. It can do it even better than DV 1.0 because of the change in design to adapt to NoSQL and MPP platforms, if needed. DV 2.0 has successfully been implemented on MPP RDBMS platforms like Teradata as well (ask Dan for details).

3. DV 2.0 is both “big data” and “NoSQL” ready. In fact, there are implementations where data is sourced in real-time from NoSQL databases with phenomenal success stories. One of these was presented at the WWDVC 2014 where an organization saved lots of money by using this architecture.

A near real-time case study for absorbing data from MongoDB is being presented at WWDVC2015. It’s not to be missed.

4. DV 2.0 takes advantage of MPP style platforms and is designed with MPP in mind. While DV 1.0 also did this to an extent, DV 2.0 takes it to a completely other level with a zero-dependency type architecture. Of course, there are a few caveats you will need to learn.

5. DV 2.0 lets you easily tie structured and multi-structured data together (logically) where you can join data across environments easily. This particular aspect lets you build your Data Warehouse on multiple platforms while using the most appropriate storage platform to the particular data set. It lets you build a truly distributed Data Warehouse.

6. DV 2.0 has a greater focus on agility with principles of Disciplined Agile Delivery (DAD) embedded in the architecture and approach. Again, being agile was certainly possible with DV 1.0, but it wasn’t a part of the methodology. DV 2.0 is not just “agile ready”, it’s completely agile.

7. DV 2.0 has a very strong focus on both automation and virtualization as much as possible. There are already a couple of automation tools in the market that have the Dan’s approval (just ask). Some of them will be at WWDVC15.

It’s real-time ready, cloud ready, NoSQL ready and big data friendly. And practitioners have already had success in all these areas (on real projects not just in the lab).

And, as you’ll notice on the agenda, the focus at WWDVC15 will be Data Vault 2.0 with examples of sourcing it from MongoDB, with examples of virtualization (from me!), with examples of design mods (also one from me), with examples of Hadoop implementations and more. It’s not something you want to miss, and there’s hardly any time or seats left.

If you are coming, I look forward to seeing you and chatting about the world of DW/BI and agile. If you want to attend, grab one of the last seats over at http://wwdvc.com/#tile_registration  (if there are still seats left by the time you get this message).

See you soon!

Kent

The Data Warrior

P.S. After the conference, the next place you’ll hear about DV 2.0 is in Berlin. There is a bootcamp and certification starting on 16th June at Berlin, Germany. The details are here: http://www.doerffler.com/en/data-vault-training/data-vault-2-0-boot-camp-and-certification-berlin/

Quote of the Day: We cannot direct the wind…

We cannot direct the wind…

But we can adjust the sails!

Are you heading where you want to, or letting the wind blow you about?

Talk the helm of your life and set a course.

Happy Monday!

Kent
The Data Warrior

P.S. It is almost time for the 2nd Annual World Wide Data Vault Consortium (WWDVC) in lovely Stowe, Vermont! If you do DV or want to learn more about DV, this is THE place to do it. Cost is CRAZY LOW for the content and contacts you will make. There are only a few seats left so sail on over and register at http://wwdvc.com/ before they sell out.

Better Data Modeling: An Easter Present

In celebration of Easter this year, I have a present for everyone.

A book sale!

I am putting my first Kindle ebook, A Check List for Doing Data Model Design Reviews, on Sale starting on Easter Sunday, April 5, 2015,  for five days!

The sooner you act, the better deal you will get:

Easter Sunday April 5, 2015 at 8:00 AM (PST) the price will be just 99 cents!

The next day April 6, 2015 at 11:00 AM (PST) the price will go up to $1.99

On  April 7, 2015 at 2:00 PM (PST) the price will go up to $2.99

On  April 8, 2015 at 5:00 PM (PST) the price will go up to $3.99

On  April 9, 2015 at 8:00 PM (PST) the price will go up to $4.99

On  April 10, 2015 at 11:00 PM (PST) the price will go up back to the regular price of $5.99

So if you don’t have a copy yet, buy yourself one for Easter.

If you have a copy, buy a copy for a friend as an Easter present.

Either way go here to buy one!

Happy Easter!

Kent

The Data Warrior (and Easter Bunny)

P.S. This promotion is also available on Amazon.co.uk (where it start at 8:00 AM GMT).

2015 ODTUG Kscope Editor’s Choice Award – Calling All Minds, Calling All Media

Kent Graziano:

This is a great opportunity to show your creative chops and maybe get a nice award to boot (in front of 1,000+ of your best geek buddies). See you in June at KScope15!

Originally posted on TH TECHNOLOGY:

It’s that time of year again – for the ODTUG Editor’s Choice Awards. This year we welcome submissions in all media – even online annotated demos. Shows us your stuff – wow us with your brilliance and clever use of Oracle development tools!

Hello, ODTUG!

Spring is here – finally – and that means ODTUG KScope Editor’s Choice Award submissions are open,

The annual ODTUG Editor’s Choice Award honors excellence in creative, effective use of all modern media options to convey a complete technical topic to our members. Every Kscope presenter is eligible.

2015 is again an all-media year. The popularity of blogs, videos, and podcasts provest hat today’s developers gather and share information in a wide variety of media. ODTUG members consume information online and in various media formats, in addition to formal white papers and printed textbooks. Some say the white paper is dead; others simply save trees…

View original 553 more words

An Irish Blessing (for my friends at #OUG_IRE)

Maybe a day or so late (for St Patrick’s Day) but a bunch of my Oracle pals (#ACEs and #ACEDs) are all over in Dublin at an Oracle User Group event (#oug_ire on Twitter) so this seemed appropriate. Looks like they are having a good event (based on the tweets), with a fun evening to boot.

This is an old, traditional blessing. I found it in a box of papers while doing some spring cleaning yesterday.

For all my friends in or visiting Ireland this week:

May your blessings outnumber the shamrocks that grow,
And may trouble avoid you wherever you go.
May the road rise up to meet you,
May the wind be at your back,
May the sun shine down upon your face,
And the rain fall soft upon your fields,
Until we meet again,
May God hold you in the hollow of his hand.

See y’all in Florida at #KScope15

Kent

The Data Warrior

Post Navigation

Follow

Get every new post delivered to your Inbox.

Join 1,126 other followers

%d bloggers like this: