The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the tag “Snowflake”

15 Feb 2022

Mass Data Fragmentation: Reducing ‘Data Puddles’

Shortly before leaving Snowflake last year, I was interviewed for this post about one of the worst case examples of data siloes I had seen – we called them data puddles!

A few years ago, Kent Graziano joined a big organization to work on its data. The first problem was that nobody really knew what and where all the data was. Graziano took his first three months on the job investigating data sources and targets, ultimately creating an enterprise data map to illustrate all the flows. It wasn’t pretty.

“In the end, I discovered that the same data was being sent to three or four places,” he said. In one case raw data was transformed and stored in a data warehouse, then moved from there into another warehouse—which was also pulling in the original raw data.

Graziano, who recently retired from his post as Chief Technical Evangelist at Snowflake, said this scenario is entirely common. Data scattered and copied in lakes, warehouses, data marts, SaaS platforms, spreadsheets, test systems, and more. That’s mass data fragmentation, or, more colloquially, data sprawl or data puddles. 

Indeed, 75% of organizations do not have a complete architecture in place to manage an end-to-end set of data activities including integration, access, governance, and protection, according to IDC’s State of the CDO research, December 2021. This lack of governance combines with legacy systems, shadow IT, and good intentions to pave the road to a lot of fragmentation.

Check out the rest of the post to learn how data sprawl hurts businesses and what to do about it. Read it all here!

Try not to step into any of those puddles!

Kent

The Data Warrior

Posted in #cloud, Data Warehouse, SnowflakeDB, thought leadership and tagged , , , , , | Leave a comment
16 Dec 2021
12 Comments

3 Key Resources for Data Vault on Snowflake

By now you surely know that you can build a Data Vault on Snowflake. In fact we have many customers doing so today. So much so that we formed a Snowflake Data Vault User Group.

Over the years I have had hundreds of calls and meetings with organizations around the world discussing this topic from just basic Data Vault 101 type questions to best practices to who is doing Data Vault on Snowflake. Because of that we developed a Data Vault Resource Kit that points you to all the key blog posts, videos, and customer stories on the topic (scroll down to see everything!). Be sure to bookmark that page. Most of your questions on this topic can be answered there.

To take it a step further and to a deeper level, I partnered up with Snowflake Field CTO Dmytro Yarashneko (CDVP2) and wrote a post with reference architectures and discussions related to doing real time feeds into a Data Vault 2.0 on Snowflake. Check that out here. This article even has code!

And, at long last, for those that want to jump in feet first and try it for yourself, the team built a Data Vault Quickstart , based on the above article and a hands on lab from WWDVC 2021, that gives you a step-by-step guide and all the code to build and load a Data Vault 2.0 system, including an information mart on top of the Data Vault, all in your very own Snowflake account.

So, what is your excuse now? You have all the resources you need to give it a go!

And please, bookmark this post and/or the links above so you don’t lose them!

Model on!

Kent

The Data Warrior

Posted in Data Vault, SnowflakeDB and tagged , , , , , , , ,
17 Nov 2021

Snowday! Sunny, with a 100% Chance of Innovation

What a great event! So many announcements and great demos, plus and awesome live Q&A with our Snowflake leaders.

At Snowday 2021, Snowflake announced exciting new product capabilities that expand what is possible in the Data Cloud. In addition to announcing Python support in Snowpark (currently in private preview), these latest innovations make it easier for organizations to maintain business continuity across clouds and regions; help data engineers and data scientists build pipelines, ML workflows, and data applications faster; and remove the complexity of getting the right data into the hands of customers.

The Snowflake Data Cloud is a global network connecting organizations through data, creating new opportunities for collaboration to improve business outcomes, and fundamentally changing what is possible across industries. For Kraft Heinz, its data science teams are able to build and test models dramatically faster in Snowflake compared with its prior data lake. For NBCUniversal, it’s building brand-new advertising targeting and measurement products, in a secure and privacy-compliant way using Snowflake’s governance and data sharing capabilities. And for 84.51°, it’s built a Collaborative Cloud that takes complexity off the table and unlocks new possibilities for grocers and CPGs sharing and collaborating on data.

Snowflake continues to expand the scope and possibilities of the Data Cloud, delivering unique innovations that enable customers to:

  • Operate globally
  • Eliminate silos
  • Build faster
  • Create new businesses

Catch up on all the details on the  Snowflake blog.

Check it out!

Kent

The Data Warrior

P.S. Registration for Snowflake Summit 2022 is now open!

 

Posted in #cloud, Big Data, Data Warehouse, SnowflakeDB and tagged , , , , , | Leave a comment
22 Sep 2021

Snowflake Launches Unstructured Data Support in Public Preview

This is great news that many of us have been waiting for! Now we can have all our data in one place.

From Day 1, Snowflake has supported structured and semi-structured data. Snowflake has provided exceptional performance for those data types and has been a pioneer in processing them. Today, Snowflake is adding support for unstructured data to allow customers to deliver more use cases with a single platform. The support for unstructured data management includes built-in capabilities to store, access, process, manage, govern, and share unstructured data in Snowflake. Now you can get all the benefits of the Snowflake Data Cloud with performance, concurrency, and scale for unstructured data.

Read to entire blog for all the details on how you can use this feature.  Unstructured Data Support in Public Preview

This really opens up a lot of new uses cases and makes doing analytics on unstructured data much easier.

Enjoy y’all!

Kent

The Data Warrior

Posted in Big Data, SnowflakeDB and tagged , , , , , , | Leave a comment
21 May 2021

Snowflake Summit 2021

It’s almost time! The annual Snowflake Summit is just a few weeks away.

Data is everywhere and it holds the keys to unlocking your organization’s success today and in the future. Attend Snowflake Summit and you’ll learn how to use the #DataCloud to unify, analyze, and share data previously out of your reach for more impact than you have ever imagined.

Data Together Now will inspire business and technical leaders, data scientists and engineers, data and analytics professionals, and application developers, to lead their organizations to a data-driven future, today. There is something for everyone in the organization.

You can be a DATA LEADER!

SAVE THE DATE:

AMERICAS: June 8-9  | 9  am PT  |  12 pm ET |  View Agenda

ASIA PACIFIC: June 9-10  | 10 am AEST  |  9 am JST |   View Agenda

EMEA AND INDIA: June 9-10  | 9 am BST  |  10 am CEST  |  1.30 pm IST |  View Agenda

So what are you waiting for? Register today.

Let it snow!

Kent

The Data Warrior

Posted in #cloud, Big Data, SnowflakeDB and tagged , , , , , , , | Leave a comment

Post Navigation

← Older Entries
%d bloggers like this: