The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the tag “@dlinstedt”

Best #DataVault Event Ever!

Hard to believe it is less than 25 days to WWDVC 20016. I’m going. Are you?

If not, why not?

The 3rd Annual World Wide Data Vault Consortium is going to be epic!

What is the WWDVC?

It’s the only conference that focuses on everything happening in the Data Vault world, and this time, the keynote speaker is the father of Data Warehousing himself Bill Inmon. He created the industry in which we earn our daily bread.

The sessions start prior to the conference with a closed room meeting of Data Vault certified brainstorming. I will be there for sure to talk about Data Vault in the Cloud and of course experiences in virtualizing layers of the data vault architecture. I can hardly wait to discuss what I have learned this year with the other data vault brainiacs.

This is followed by a day of hands on workshops:

  • How to build a DV, a Data Mart, and End User Analytics from Scratch in 3 hours

  • Extend the power of the Data Vault to a real-time use case using a Spark based Lambda architecture

  • Generate code using the award winning Mapping Manager tool

And, these are all before the conference even starts.

There’s a lot more during the conference including the famous networking sessions which this event is known for. If you’ve already booked your seat, see you there. If not, what are you waiting for?

For something so valuable, you would expect a hefty price tag like the vendors do it.

Nope, it’s dirt cheap.

Check it out for yourself here:

WWDVC Registration

It’s a conference for Data Warehouse people with a Data Vault focus. Folks like you. It does have many things for the business person as well such as selling the Data Vault concept to the business owner (Peter Aiken), case studies including implementation of an Near Real Time DV 2.0 in the cloud, and a customer centric analytics case study, and more.

Give Your Brain a Treat

Some of the smartest people in Data Warehousing I know, have been in attendance in the past. This is a once a year chance to meet them in person, increase your network, and have a great time

This time it appears to have been kicked up a notch with the likes of John Giles (Universal Data Vault), Peter Aiken (In one instance their DV 2.0 helped save a client a whopping $25M/year), Bill Inmon (The father of the DW), Dale Anderson (Used the DV to build one of the world’s first DaaS).

There are also the repeat attendees like Mary Mink and Sam Bendayan (Used DV 2.0 to implement an NRT DW sourced from a NoSQL platform serving 3000+ customers), Michael Olschimke (Co-author of the new DV 2.0 book), Roelant Vos (Not only did he build his own automation, he likes to experiment … with architecture).

And … vendors of automation tools. Several of the world’s leading Data Warehouse Automation tools will not only be there, they are sponsoring (and buying dinner and drinks!).

And as if that is not enough, you will get to rub elbows with Dan Linstedt, the inventor of Data Vault, Sanjay (co-founder of LearnDataVault.com), and of course me, Kent, The Data Warrior.

So what are you waiting for? Go buy your ticket to the conference, book your room, and figure out how you will get there (hitch hike if you have to).

See you in Vermont!

Kent

The Data Warrior

P.S. Don’t forget Saturday at WWDVC is crazy shirt day.

P.P.S. The company I work for, Snowflake Computing, is a sponsor and is giving me a GoPro! to raffle off, so, don’t miss my talk on Thursday if you want in on the raffle.

 

 

4 Keys to Succeeding with Agile Data Warehousing in 2016

I have been out giving talks again on using agile methods for data warehouse and business intelligence projects, so I thought it was time for me to share my thoughts about the 4 key elements you need to be successful with an Agile DW project in 2016.

Adopt an Agile Methodology

By this I am talking about SCRUM, Kanban, ScrumBan, or DAD (Disciplined Agile Development), among others.

Go read the blogs, read the books, study these methods. Attend a conference (like Agile Tech in April). Figure out what will work for your organization’s culture and leverage the skills of your staff. One size does not fit all.

In past engagements I have used approaches primarily based on SCRUM and Kanban. Both have been very effective once we got our processes down.

If you need/want help, find a good agile coach.

Use an Agile Data Engineering Approach

If you want to develop your data warehouse in an agile, iterative manner, then you need a way to design your EDW repository that lends itself to this approach without causing huge re-engineering pains (known as refactoring) in future iterations.

The best way I have found is using the Data Vault modeling approach. It was designed specifically for building data warehouses in this manner. I have written much about this approach and give many talks showing examples of successful agile projects using Data Vault. And there is plenty of material available to help you learn how to do it (see the books on the sidebar of this blog).

Also keep an eye on Dan Linstedt’s twitter feed and blog for his training classes.

Use Data Warehouse Automation Software

No better way to get agile and deliver results fast, than to automate as much of your development work as possible. If you use repeatable patterns (like Data Vault) in your design methodology, then it is even easier to automate and greatly reduce your time to market.

There are two vendors in the market that I like a lot and have had some experience with. They are WhereScape and AnalytixDS. And both support not only “traditional” approaches to data warehousing (like automating the ETL for a Type 2 Slowly Changing Dimension) but they both also support Data Vault (and both will be at WWDVC 2016).

Which of these tools you might use depends on your approach, your current tools, and your skills.

If you are coming from a more traditional DW paradigm and use ETL tools like Informatica, Talend, or DataStage, then I would recommend you look at AnalytixDS Mapping Manager which allows you to generate your ETL code from source to target mappings.

If you are just getting started or are committed to more of a database-centric approach and want your ETL or ELT code to run in the database, then look at WhereScape’s products.

Both are great companies with knowledgable people and happy customers.

Your third option is to write your own automation routines. There are many shops doing that as well. Just be sure you have the appropriate skills in house and can allocate the upfront time to get going (a month or so at least).

Deploy on an Agile Data Warehouse Platform

So now that I have learned about Elastic Data Warehousing in the cloud, I can’t imagine trying to do an agile DW project any other way.

Of course I am referring to Snowflake Computing’s DWaaS (data warehouse as a service) offering. Yes, I might be a bit biased since I do work for them now, but…this tech is really good!

From a features perspective, what I am talking about is having a high powered, easily scalable database that supports BI and analytic workloads and does not require a ton of time to configure and tweak.

Why do I think that is a success criteria? Because I have spent way too many months on way too many “agile” projects waiting to get access to the hardware! Or I get access and we either run out of space (e.g., “we had no idea you need THAT much storage”) or we can’t properly test production level loads and queries because the development box does not have enough horsepower.

Taking advantage of the elasticity of the cloud solves both of these problems and the folks at Snowflake have successfully built an RDBMS in the cloud that specifically harnesses these features and leverages them for data warehouse and analytic workloads by providing the ability to scale up and scale down both storage and compute resources on demand.

That and its many other features, give me the infrastructure I need to get an agile data warehouse project off the ground almost instantly. And I can do a Data Vault on Snowflake too.

Very cool.

So what do you think? Are you ready to accelerate your team’s performance and adopt an agile approach to data warehousing?

I hope this post gives you a few ideas on how to make that happen.

Model on!

Kent

The Data Warrior

 

Fire Sale #2: Loading Your Data Vault with Informatica

As I mentioned the other day, Dan and Sanjay have been hard at work re-vamping the Learn Data Vault site and have relaunched it. In celebration they are offering amazing deals on their world class Data Vault Implementation classes.

The 2nd course that is ready to go is Implementing Data Vault with Informatica. This online course walks you through the details of implementing a Data Vault-based data warehouse using Informatica. It includes a ton of examples and templates that you can use in your own ETL work to make it very easy to crank out your load processes.

You can see the full outline for all the topics and modules here.

The Deal

So the deal is that originally the Retail Price was  $1,497. But right now with the re-launched site, this class is marked down to $997  for a short time (a savings of $500). The price will eventually go back to the higher price.

The Better Deal: A Fire Sale

Starting today until February 15th, Learn Data Vault is having a Fire Sale! You can take another $500 off with this special Data Warrior Coupon Code:  DWFS500OFF.

So with the mark down price plus my coupon you can get the Data Vault Informatica Implementation class for only $497 (a savings of $1,000).

But remember is is only good until February 15 (1 week from today!).

So please sign up ASAP before the coupon code expires.

Data Vault Rules!

Happy Coding!

Kent, The Data Warrior

Data Vault Master (CDVDM, CDVP2)

Are You Certifiable? 1st #DataVault 2.0 Bootcamp of the Year

A quick note for all the folks out there that have been contemplating diving deep into Dan Linstedt’s Data Vault 2.0 System of Business Intelligence.

Dan will be teaching a Data Vault 2.o Bootcamp in February! You can sign up here.

You’ve read the articles, read the blog posts (mine included), attended the talks at the conferences, maybe even read the Super Charge book…

Are you done trying to figure it out on your own?

Ready to not only learn how to do it right, but get certified as a Data Vault 2.0 Practitioner?

Well let’s get 2016 off to a great start and attend the 1st Data Vault 2.0 Bootcamp of 2016 in beautiful St. Albans, Vermont, taught by none other than the inventor of Data Vault, my good friend Dan Linstedt.

You could of course just buy the new book, and try it out on your own…

But if you are like me, you do much better when you can interact, face-to-face with a qualified instructor, ask the hard questions, and get the insights that will make you truly successful.

So why not invest in yourself and your future success? Go sign up now.

As an added incentive, Dan has added some brand new material.

NEW TOPICS

Dan will be discussing DV2 on Hive / Hadoop, the benefits, pros and cons, some suggestions on how to build it and leverage it properly.  He will be talking about Satellites on HDFS, Hubs & Links on Hive.  He will discuss data modeling implications, and using SERDe definitions at query time.  This is the first time ever that this information will be presented in the DV2 class!

Make the commitment to a great 2016 now and go sign up before the class fills up. If you sign up before February 1st, you can save over $400!

To your success!

Kent

The Data Warrior

Data Vault Master and CDVP2

P.S. For you skiers, St. Albans is a short drive to both Stowe and Smuggler’s Notch – both great east coast ski areas and with the snow they just got the skiing will be epic. Go take the class, then reward yourself with a little weekend ski trip.

Data Warrior Agenda for 2016

Hard to believe 2015 is almost over.

It was a very busy year for me:

All of that has entailed a lot of air miles! This year I have visited:

  1. Denver (several times!)
  2. Salida, Colorado
  3. Hollywood, Florida,
  4. Raleigh, NC
  5. Charlotte, NC (thanks to Lynn Winterboer for that one!)
  6. San Francisco
  7. Redwood City, California (Oracle HQ)
  8. Austin (drove this one)
  9. Minneapolis/ St Paul (thanks to Redpill Analytics mostly)
  10. Kansas City, Missouri
  11. Portland, Maine
  12. St Albans, Vermont
  13. Stowe, Vermont
  14. San Mateo, California (HQ for Snowflake Computing)

And that was just work related! Family trips took me to:

  1. Galveston (beach!)
  2. South Padre Island, TX (more beach!)
  3. Road trip to Central NY:
    1. Joplin, Missouri
    2. Hannibal, Missouri (Mark Twain museum)
    3. Chicago (to see robots at the Museum of Science and Industry)
    4. Sandusky, Ohio (just to sleep)
    5. Fulton, NY (to see my dad)
    6. Old Forge, NY (summer vacation in the mountains!)
    7. Huntsville, Alabama (NASA Rocket Center!)
  4. Who knows – the year is not over yet!

Speaking in 2016

2016 will be very busy with the new job for sure. I am already booked for a bunch of events. Here they are so far:

Data Day Texas – January 16 in Austin, TX

TDWI Webinar – Dymstyfying Elastic Data Warehousing (with Philip Russom) – January 26th

BIWA Summit – January 26-28 at Oracle HQ

RMOUG Training Days 2016 – Febuary 9-11 in Denver, CO (I have 2 hour deep dive on Feb 9th). Register early for discounts.

Enterprise Data World – April 17-22 in San Diego. Register early for discounts (by the end of the year for the best rate).

ODTUG KScope16 – June 26-30 in Chicago, IL. Register early and be sure to book the hotel!

Also likely speaking at World Wide Data Vault Consortium (WWDVC) – May 25-28 in Stowe, Vermont (TBD)

And many more to come! (watch my twitter feed for updates)

Hopefully I will see you at one or more of these events!

Wishing a safe a joyous holiday season!

Merry Christmas & Happy New Year!

Kent

The Data Warrior


 

Post Navigation

%d bloggers like this: