The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the category “Data Vault”

List of Top Data Vault Resources (UPDATED 2016)

As I finished out my latest contract, my team mates wanted to know where they could go to get their data vault questions answered (besides emailing me!).

So I put together this list for them and figured the readers of my blog would probably like to see the same list.

Here it is!

My Stuff

Introduction to Data Vault 1.0 (pdf):

https://kentgraziano.com/white-papers/

Book:

Intro to Agile Data Engineering Using Data Vault 2.0

Slides

Introduction to  Data Vault and Why Data Vault?  (ppt):

http://www.slideshare.net/kgraziano/why-data-vault?

http://www.slideshare.net/kgraziano/agile-data-warehouse-modeling-introduction-to-data-vault-data-modeling

Dan’s Data Vault Books

The NEW Data Vault 2.0 Book:

http://www.amazon.com/Building-Scalable-Data-Warehouse-Vault-ebook/dp/B015KKYFGO/

The Data Vault Modeling book (DV 1.0):

http://www.amazon.com/Super-Charge-Your-Data-Warehouse/dp/1463778686/

The Data Vault Modeling book – Kindle version:

http://www.amazon.com/Super-Charge-Your-Warehouse-ebook/dp/B00853265G/

The Data Vault Modeling book – downloadable PDF version:

http://learndatavault.com/books/super-charge-your-data-warehouse/

Data Vault Implementation using Pentaho (DV 1.0):

http://www.lulu.com/shop/peter-van-til/implementing-a-datavault-architecture-with-pentaho-data-integration/paperback/product-17580260.html

Around the Web

Dan has two online classes for Implementing Data Vault (1.0):

  1. Using Informatica. You can see that here.
  2. Using SQL. You can see that here.

Dan’s main site and blog – Subscribe to this to get email updates/announcements regarding data vault:

http://danlinstedt.com/

Best overall source of Q&A – Data Vault Discussion group on LinkedIn:

http://www.linkedin.com/groups?gid=44926&trk=hb_side_g

Martin Evers,  data vault expert from Europe,  (just one of his articles) :

http://dm-unseen.blogspot.nl/2012/10/data-vault-business-key-mutations-matter.html

On YouTube

Data Vault videos from Dan (and Sanjay):

http://www.youtube.com/user/learndatavault

Older videos (includes RapidACE demo):

http://www.youtube.com/user/dlinstedt/videos?sort=dd&flow=list&page=1&view=0

Data Vault Architecture:

http://www.youtube.com/watch?v=WmFENnqgoS0&feature=youtu.be&a  (BTW – turn the volume down first. The “theme” music is loud)

Well that’s the main ones for now.

What’s your favorite?

Enjoy!

Kent

The Data Warrior

Data Vault Master and CDVP2

Authorized DV Bootcamp Instructor

Standards? We Don’t Need No Stinking Standards!

Well, actually we do need standards.

Especially if we want to have any consistency in the systems we develop, or the models we build.

For years people in the data warehouse arena have literally begged Dan Linstedt, inventor of the Data Vault Model and Methodology, to create books and training materials on Data Vault.

They wanted to know how he got the results he was getting for his clients.

They wanted to understand how to properly build a Data Vault.

They wanted STANDARDS.

Well, ask and ye shall receive.

Recently Dan put this on his blog:

For many many years I have written and maintained Data Vault Standards v1.x.  Well, I’ve released them on Amazon for you.  These are the DV1.0 Standards, and are the same standards document I used to hand out in my certification classes.

Apparently there are folks out there who either don’t know about the standards, or who have had some confusion over the fact that there ever were standards.

I wanted to make it free – but unfortunately I was not able to do that.  So, I’ve made the price to be $0.99 USD on Amazon.  Again, these are Data Vault 1.0 Modeling Standards and Data Vault 1.0 Loading Standards.

via Data Vault Modeling & Methodology – Data Vault 1.0 Modeling and Loading Standards.

So there you have it – the official standards for Data Vault 1.0.

Go get ’em here.

Read ’em.

Use ’em.

Your data warehouse will thank you.

Kent

Oracle Data Warrior

Big Blunder means extended discount opportunity for Data Vault fans

Sometimes the best laid plans…they just don’t quite work out. Here’s what I mean:

If you were at my Data Vault session at the recent ODTUG KScope conference in San Antonio, you got a special code to enter at http://www.LearnDataVault.com/kscope12  to get $200 off the new online Data Vault Implementation training class. (For more on the training check out this post).

That deal was supposed to end this week on July 31st.

Well…

I was just informed that there was an error in the code on the BUY button.

Error in the code? Say it isn’t so! (Hey – I did not do the programming)

If you went to the link and put in the code you got some sort of an error message. If you forgot the code and just pushed the button you went to Dan’s offer to try the first module for only $7.00 (USD) – which is a really great deal on its own.

As you may imagine, I was not happy to hear that the Kscope participants were unable to get the discount I promised them and that there are only a few days left for this deal. 😦

So as compensation for this mistake, I was able to negotiate an extension of this offer until August 30th.

So that means you now have until August 30th to take advantage of the $200 discount.

Just go to http://www.LearnDataVault.com/kscope12 and put in the secret code. All the details about the course are there on the page for you to review.

And don’t forget, Dan offers a 7 day, 100% money back guarantee.

So if you have been putting off investing in this course, you just got a 30 day reprieve to get the $200 discount.

Don’t waste it. There are not that many 2nd chances.

Kent

P.S., Since speakers at KScope do not get attendee lists and emails, I have no way to directly contact the folks who attended my session. So do me a favor, help me get the word out. Please re-post and tweet this to your networks so we can be sure no one misses out. Thanks a bunch.

ODTUG KScope12: Day 2

So another extraordinary, information filled day in San Antonio, with a bit of pathos thrown in for depth.

Started the day again with Morning Chi Gung. Another nice group of folks dropped by to try it out and a few hardy souls returned to try again. I think they are all getting the hang of it and enjoying it. We will do it again in the morning.

First session of the day from me was OBIEE Answers vs BI Publisher from Borkur Steingrimsson of Rittman-Mead.

image

Borkur did a great job of highlighting the pros and cons of each toolset and outlining some of the use cases for the two tools. While there is some overlap, there are definitely some best practices to follow to help decide which to use for what.

One tool does not fit all.

Next session was mine: Introduction to Data Vault Modeling for an Oracle BI Environment.

I had a good crowd (below) to pitch data vault modeling to. Talked about where it fits and how this modeling approach can be leveraged in OBIEE and with Oracle’s Exalytics platform. The audience was small but I think they got a lot out of the talk.

Lots of note taking going on!

Next another information packed session from Tom Kyte about the various options in the Oracle database for securing your data.

He talked about many things including Oracle Total Recall, Audit Vault, and Database Vault (not to be confused with Data Vault Modeling), and Oracle Advanced Security option. Yes most of these cost more money for licenses but you really do need to think about how you protect your data and from whom.

Tom gave us a lot to think about.

Next, my favorite, lunch! Sort of a cook out style lunch with hamburgers, slaw and the fix’ns just in the exhibit hall.

In the picture you have some of the BI crowd (Stewart and Kevin) chatting with the Optimizer Queen (Maria). Lunch at Kscope is where many questions get answered and problems solved.

After lunch we had the official KScope12 (or was it 2022?) General Session complete with “special” effects and time travel.

Edward did a “this is your life” style interview with ODTUG President Mike Riley. Along with some good-natured ribbing, we also got some serious announcements:

  1. Mike Riley stepped down as President
  2. Monty Latiolais was appointed the new President
  3. Edward got “fired” as conference chair
  4. Mike got named conference chair for 2013
  5. Our long time executive director Kathleen McCasland handed the reins over to Crystal Walton so she could focus more on managing the great meeting company she has built, YCC.

There were many awards given including a Lifetime Achievement award to Kathleen (bravo!) and one to Mike for all he has done as President. Oracle Contributor of the year went to Kris Rice; volunteer of the year to Karen Cannel; editors choice award to Peter Koletzke and Duncan Mills.

And the BIG announcement was that KScope13 will be in New Orleans. Registration is open at http://kscope13.com

But wait there is more… I attended more great sessions in the afternoon and evening including another session from Tom Kyte on SQL secrets.

And Steward Bryson’s riveting session on how to use OBIEE against a transactional schema. (I did have a hard time getting a good picture because he NEVER STOPPED MOVING!)

Yes, that is Stewart in a suit…

He has nailed the approach to making OBIEE treat just about any schema design like a dimensional model. Very cool, a bit tricky. Next year we may do a joint session about making a data vault model work in OBIEE without having to instantiate a star schema data mart first. Stay tuned…

To end the day (sort of), we had an excellent and inspiring keynote from Cary Millsap (@carymillsap).

He had lots of inspiring and  insightful things to tell us based on his own life experiences as a father, husband, and business man. I can’t really do it justice so I will give you a few quotes from his slides:

Thinking clearly is more important than the right answer

To teach, test the code path, not just the memory

The goal of a parent: Kids who are interested in figuring out how to use what they are learning

Life is not linear (one of my favorites)

And the biggy:

Happiness is not a state. Happiness is a state change.

So do something BIG.

It really was a great talk.

And to finish out the day (for me anyway) I went to the BI Mad-Dashboard networking event. With Kevin McKinley as the host and Rittman-Mead providing the adult beverages, we had a good time networking and playing some interesting games.

There are actually even more networking events going on into the wee hours but that is it for me today (or I would not have gotten this blog post done).

But that is one of things that makes ODTUG and KScope so great is the opportunity to network and bond with colleagues old and new from around the globe in a relaxed setting.

More tomorrow…

Kent

ODTUG KScope12: Day 1 Symposium Sunday

Wow. What a day!

Started off with leading a Chi Gung class at 7 AM to about 18 attendees. Great start to the day.

Then it was off to the races with the kick off of the BI Symposium, chaired by Kevin McGinley. I got to be “interviewed” about my  Data Vault Modeling session on Monday ( I will report on that tomorrow) , along with several other presenters. That was followed by a lively talk show-style discussion led by Kevin and Stewart
Bryson. Below see the room and audience in attendance at 9:00 AM on a Sunday. (pretty good turn out – way better than last year!)

image

The panel discussion was followed by a series of talks from Oracle BI product management. There was lots of talk about mobile BI, Oracle’s acquisition of Endeca and of course BI in the Cloud.

(At this point I switched tracks to the Db development symposium chaired by Chet Justice aka @Oraclenerd)

The next talk I attended was by Kris Rice (@krisrice) who gave an intro to Oracle SQL Developer Data Modeler. (Nicely he plugged my Data Modeler talk on Thursday)

Some review (for me) and some new stuff too. I learned his trick for showing the joins between views – use the view to table utility to convert the views to tables, add PKs, then use the Discover Foreign Keys feature. This creates FKs based on column names and know PKs.

Cool trick. Just gotta remember to set “generate DDL” to “No”.

Quick switch back to the BI Symposium to see some screen shots of a new look and feel for OBIEE with modern mobile themes.

More coolness…especially if you are an iPad sort of geek.

Back to DB dev land (is it lunch yet?) to hear Oracle product manager Jeff Smith (@thatjeffsmith) take about full lifecycle development using SQL Developer.

Lots of great tips from Jeff about generating table api’s, using version control, doing schema diffs, and unit testing.

SQL Developer definitely has lots of features I did not know about. Being able to define unit tests inside the tool seems like a valuable option. I will be getting folks at my client site to try it out next week!

Oh yeah – he also mentioned DB Doc for creating HTML documentation  on your code because code is never really self-documenting. Gotta check into that more too…

<Lunch break – yummy Italian selection of salads and food>

Post-lunch back to BI and Mike Donohue from Oracle talking about reporting on data from “beyond the data warehouse.”

Heaven forbid! (well I guess we gotta deal with it now)

So, Mike talked a bit about how Endeca Information Discovery can be used to gain understanding and build analytics on big and unstructured data. Mentioned “faceted data model” and generating a key value store. Sounds cool. Have to look into that too.

Mike also discussed using BI Publisher to allow users access to local data (in Excel, XML, OLAP, etc)  so they can build their own reports. Scary thought but, in some businesses it will make sense because in reality not all data is in an ERP system or a well built RDBMS.

Whata gonna do?

<Back to DB Dev>

No to hear the world-famous Tom Kyte (of Ask Tom fame) talk about his approach to tuning. It was, as expected, a full house.

Tom’s main point was not to necessarily tune the specific problem query but more holistically to look at the overall algorithm (or approach) that was taken to solve the problem in the first place.

In his experience many queries can’t be tuned all that much when what was written was not even the best way to solve the problem. He gave quite a few eye-opening examples where there was simply a much better way to accomplish a task than the SQL that was originally written. Seems many situations really require re-engineering the solution.

A nice take away (that makes you go “duh”):

More code = More bugs

Less code = Less bugs

Moral of the story – find the simplest solution. If the code is really complex, you are probably wrong (or at least over complicating it). Try again.

Last symposium session for the day (for me) was Maria Colgan (Oracle) talking about tips to get the most out of the Oracle Cost Based Optimizer.

Maria is the queen of the optimizer. She explained what the optimizer will do in several situations and why and if it is wrong, what you need to change to get it right.

Okay – already on brain overload (and it is just day 1!).

Need sleep.

Have my own presentation tomorrow.

And Chi Gung at 7AM.

C ‘ya

Kent

P.S. There were lots of tweets all day with more pictures of the event. To see them look for #kscope and @ODTUG on Twitter (or follow me @kentgraziano).

Post Navigation