The Data Warrior

Changing the world, one data model at a time. How can I help you?

Snowflake Launches Unstructured Data Support in Public Preview

This is great news that many of us have been waiting for! Now we can have all our data in one place.

From Day 1, Snowflake has supported structured and semi-structured data. Snowflake has provided exceptional performance for those data types and has been a pioneer in processing them. Today, Snowflake is adding support for unstructured data to allow customers to deliver more use cases with a single platform. The support for unstructured data management includes built-in capabilities to store, access, process, manage, govern, and share unstructured data in Snowflake. Now you can get all the benefits of the Snowflake Data Cloud with performance, concurrency, and scale for unstructured data.

Read to entire blog for all the details on how you can use this feature.  Unstructured Data Support in Public Preview

This really opens up a lot of new uses cases and makes doing analytics on unstructured data much easier.

Enjoy y’all!

Kent

The Data Warrior

A New Ethics of AI

In my latest post I tackle one of those current hot topics – Ethics (and bias) in AI and machine learning.

People tend to simplify. So all types of machine-assisted thinking get dubbed “artificial intelligence,” or AI.

What we’re really talking about with AI or machine learning is an algorithmic approach to analysis: We’re going to look at a bunch of data, and artificial intelligence is going to help us figure some things out. It’s going to tell us things we would have a difficult time finding ourselves.

Here’s where machine learning comes in. It’s all about training a model. When we speak about a model we’re really just talking about code. It’s a coded algorithm—a coded set. A statistical model is the other term for it. So for the data architects of the world, when we think of a data model, we’re thinking of tables, columns, and relationships. In the simplest form, however, we’re talking about a specific set of data.

Check out my thoughts on how we can try to deal with ethics and bias here: A New Ethics of AI

What do you think about this topic?

Cheers!

Kent

The Data Warrior

Snowflake Resources from The Data Warrior

Since you are on this blog, I assume that means you are “following” me in that techie, non-stalker sort of way. 😉

That being the case you are aware of my tenure for the last 5+ years at the hottest data-focused software company in the world – Snowflake. And you know I have produced a lot of content (really – A LOT!). Everything from blogs to ebooks to videos to podcasts – in addition to my usual array of industry and Snowflake sponsored webinars and talks.

But if, like me, you have consumed so much content in the last year or so, you have probably lost track of some of it, right?

Well if you are trying to find something you saw me do (or tweet about doing) but just can’t remember what it was (or when or where) and you want to find it but don’t want to sift through the hundreds of Google search results or the thousands of social media posts I have done, look no further!

I decided to make it easier for you (and me frankly) by putting a pretty comprehensive list together on a permanent page here on my site.

I broke it up into videos/Podcasts, Thought Leader articles, ebooks, and blogs and have included links to all of these so you can quickly get to the content you need when you need it.

So check it out and bookmark the page now, before you forget or lose track of this post too. 🙂

You’re welcome.

Kent

The Data Warrior

Snowflake Summit 2021

It’s almost time! The annual Snowflake Summit is just a few weeks away.

Data is everywhere and it holds the keys to unlocking your organization’s success today and in the future. Attend Snowflake Summit and you’ll learn how to use the #DataCloud to unify, analyze, and share data previously out of your reach for more impact than you have ever imagined.

Data Together Now will inspire business and technical leaders, data scientists and engineers, data and analytics professionals, and application developers, to lead their organizations to a data-driven future, today. There is something for everyone in the organization.

You can be a DATA LEADER!

SAVE THE DATE:

AMERICAS: June 8-9  | 9  am PT  |  12 pm ET |  View Agenda

ASIA PACIFIC: June 9-10  | 10 am AEST  |  9 am JST |   View Agenda

EMEA AND INDIA: June 9-10  | 9 am BST  |  10 am CEST  |  1.30 pm IST |  View Agenda

So what are you waiting for? Register today.

Let it snow!

Kent

The Data Warrior

Building a Real-time Data Vault in Snowflake?

Yes you can! The #DataCloud loves #DataVault!

In this day and age, with the ever-increasing availability and volume of data from many types of sources such as IoT, mobile devices, and weblogs, there is a growing need, and yes, demand, to go from batch load processes to streaming or “real-time” (RT) loading of data. Businesses are changing at an alarming rate and are becoming more competitive all the time. Those that can harness the value of their data faster to drive better business outcomes will be the ones to prevail.

One of the benefits of using the Data Vault 2.0 architecture is that it was designed from inception not only to accept data loaded using traditional batch mode (which was the prevailing mode in the early 2000s when Dan introduced Data Vault) but also to easily accept data loading in real or near-realtime (NRT). In the early 2000s, that was a nice-to-have aspect of the approach and meant the methodology was effectively future-proofed from that perspective. Still, few database systems had the capacity to support that kind of requirement. Today, RT or at least NRT loading is almost becoming a mandatory requirement for modern data platforms. Granted, not all loads or use cases need to be NRT, but most forward-thinking organizations need to onboard data for analytics in an NRT manner.

See all the details (and some code) in the full post over on Data Vault Alliance.

Happy Vaulting!

Kent

The Data Warrior

Post Navigation

%d bloggers like this: