The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the tag “cloud data warehouse”

19 Apr 2021

Building a Real-time Data Vault in Snowflake?

Yes you can! The #DataCloud loves #DataVault!

In this day and age, with the ever-increasing availability and volume of data from many types of sources such as IoT, mobile devices, and weblogs, there is a growing need, and yes, demand, to go from batch load processes to streaming or “real-time” (RT) loading of data. Businesses are changing at an alarming rate and are becoming more competitive all the time. Those that can harness the value of their data faster to drive better business outcomes will be the ones to prevail.

One of the benefits of using the Data Vault 2.0 architecture is that it was designed from inception not only to accept data loaded using traditional batch mode (which was the prevailing mode in the early 2000s when Dan introduced Data Vault) but also to easily accept data loading in real or near-realtime (NRT). In the early 2000s, that was a nice-to-have aspect of the approach and meant the methodology was effectively future-proofed from that perspective. Still, few database systems had the capacity to support that kind of requirement. Today, RT or at least NRT loading is almost becoming a mandatory requirement for modern data platforms. Granted, not all loads or use cases need to be NRT, but most forward-thinking organizations need to onboard data for analytics in an NRT manner.

See all the details (and some code) in the full post over on Data Vault Alliance.

Happy Vaulting!

Kent

The Data Warrior

Posted in Data Vault, SnowflakeDB and tagged , , , , , , , , , , | Leave a comment
29 May 2020

Say Hello to The Data Cloud!

Instead of having our annual in-person user event, Snowflake Summit, this year we are having a very exciting virtual event on June 2nd – #SayHellotoTheDataCloud. Join us live at 9 AM PDT, 11 AM CDT, 12PN EDT, 5 PM BST, 6 PM CEST for another Snowflake first!

You can be the first to hear from Snowflake CEO Frank Slootman, Snowflake co-founder Benoit Dageville, and Christian Kleinerman, Snowflake’s Senior VP of Product. They’ll detail how you can leverage the #DataCloud for all your data to acquire the deepest insights possible. You’ll also learn how Snowflake customers, data providers, and data service providers use Snowflake #CloudDataPlatform to seamlessly connect and collaborate with data.

What is #TheDataCloud?

#TheDataCloud is the next evolution for democratizing and governing access to data! It provides a central location for any organization to store all of its data inexpensively and as a single source of truth. It not only unites an organization’s data but it connects any two or more organizations that store their data in the Data Cloud. Enabling the Data Cloud is the Snowflake #CloudDataPlatform. This is the engine that drives the Data Cloud. With it, organizations can easily load their data onto the Data Cloud, and then securely integrate, analyze, share, and monetize their data.

Join Frank, Benoit, Christian, and other Snowflake leaders to:

  • Learn how Snowflake #CloudDataPlatform enables #TheDataCloud and how you can seamlessly store, unify, and analyze all your data.
  • Join the thousands of organizations that comprise #TheDataCloud to securely share and monetize your data globally, and acquire shared data and data services.
  • Hear how the latest innovations with Snowflake #CloudDataPlatform improve performance, governance, and analyst productivity.
  • Discover how to build fast and extensible pipelines for #DataScience, #DataWarehousing, #DataEngineering, and #DataApplications from a single platform.

Stay tuned because right after the presentations, you be part of the live Q&A session with Benoit and Christian. Ask how your organization will benefit from #TheDataCloud, and from the latest features available from Snowflake #CloudDataPlatform.

Reserve your spot today – sign up here and block your calendar!

#SayHelloToTheDataCloud

#LetItSnow

Kent

#TheDataWarrior and Chief Technical Evangelist, Snowflake

P.S. While your at it, save the date for Snowflake Summit 2021 in Las Vegas!

Posted in #cloud, Big Data, Data Warehouse, SnowflakeDB and tagged , , , , , , , , , , , ,
18 Mar 2020

Tips for Optimizing the #DataVault Architecture on #Snowflake (Part 2)

SETTING UP FOR MAXIMAL PARALLEL LOADING!

In this post, I discuss how to engineer your Data Vault load in Snowflake Cloud Data Platform for maximum speed.

Because Snowflake separates compute from storage and allows the definition of multiple independent compute clusters, it provides some truly unique opportunities to configure virtual warehouses to support optimal throughput of DV loads.

Along with using larger “T-shirt size” warehouses to increase throughput, using multi-cluster warehouses during data loading increases concurrency for even faster loads at scale.

Get the details –  Tips for Optimizing the Data Vault Architecture on Snowflake (Part 2)

Enjoy!

Kent

The Data Warrior & Chief Technical Evangelist for Snowflake

Posted in Data Modeling, Data Vault, Data Warehouse, SnowflakeDB and tagged , , , , , , , , , ,
15 Nov 2018

Automatic Clustering, Materialized Views and Automatic Maintenance in Snowflake 

Boy are things going bananas at Snowflake these days. The really big news a few weeks back was another round of funding! This time we got another $450 million.

A-MAZ-ING!

We are gaining marketshare everyday with name brands signing up in droves. I am constantly taken aback by the names I see on our win-wire. In my role as evangelist, I am getting to speak with folks at places like Sony, NBC Universal, and CapitalOne to name a few. Not only here in the US but over in EMEA as well (as my frequent flyer status will attest). And early next year I will be heading out to Australia and New Zealand too (stay tuned for details).

As exciting as all that is (#ILoveMyJob), even more exciting is how our engineering team is putting all that funding $$ to use to continue to improve what is already the leading cloud-built data warehouse. This week we announced two new major features.

From today, two new automation and performance capabilities are available in Snowflake. They are the latest advancements to Snowflake’s ability to deliver the best performance and scalability without requiring administration or maintenance from our customers. They also lay the foundation for a series of new features to come in the months ahead.

Read all the details here: Automatic Clustering, Materialized Views & Automatic Maintenance in Snowflake

After reading up on these features, head on over to our site and sign up fro your FREE trial account to see for yourself how awesome, and easy, moving to the cloud can be.

Make it snow!

Kent

Chief Technical Evangelist, Snowflake

The Data Warrior

Posted in Big Data, Data Warehouse, SnowflakeDB and tagged , , , , , ,
13 Nov 2017

Join the Cloud Analytics Academy

Maybe not a cool as Star Fleet Academy, but this is pretty cool.

Snowflake and a number of our partners have come together to create the first, self-paced, vendor agnostic, online training academy for analytics in the cloud. This academy will get you up to speed on what is happening today in the cloud with respect to data warehousing and analytics so that you can be a leader in your organization.

20171111_072127

Reach for the summit above the clouds!

And the best part – it is FREE!

The Cloud Analytics Academy is a training and certification program for data professionals who want to advance their skills for the technology and business demands of today’s data analytics. It’s a collective industry effort from executives at Snowflake Computing, AWS, Looker, Talend and WhereScape.

We decided to launch this academy in part to address the data and analytics skills gap, which Gartner says is “threatening to overwhelm the credibility of data use” in business. At the same time, Gartner also recently projected that the worldwide software-as-a-service (SaaS) market to grow more than 63 percent to by 2020.

The Academy is designed for data professionals of all technical and business levels and backgrounds. You can complete any or all of the following Academy tracks:

  • Executive Fast Track – Learn the key technologies and techniques to foster an effective cloud analytics team.
  • Cloud Foundation Track – Become proficient with the fundamental building blocks of cloud analytics.
  • Modern Data Analytics Track – Learn advanced technical concepts to propel your cloud analytics.

There will be quiz questions at the end of each session to test your retention. By completing the sessions and the quizzes in a track you will get a related academy badge. Anyone who completes all three tracks will be certified as a Cloud Analytics Academy Master.

The Academy launches on November 14th with a live keynote from Tom Davenport. You can get all the details and sign up here. (Don’t worry if you miss it as it will be recorded and available the rest of the year).

So what are you waiting for? Sign up today and take your career to the next level – above the clouds!

To infinity and beyond!

Kent

The Data Warrior

 

 

Posted in Big Data, Data Warehouse, SnowflakeDB, Training and tagged , , , , , , , , | Leave a comment

Post Navigation

← Older Entries
%d bloggers like this: