The Snowflake Data Sharehouse. Wow!
Data Sharing for All Your Data
They say the Internet changed everything…
Then Big Data changed everything…
Then the Cloud changed everything…
Well my friends, Snowflake‘s announcement of its new data sharing feature has changed the game again! Your data warehouse in the cloud can now be a data sharehouse.
Building on all these technology evolutions, Snowflake has taken what we can now do with big data in a cloud-native data warehouse to whole new level by introducing, what I like to think of as Data Sharing as a Service (DSaaS).
This may be my new #1 favorite feature of Snowflake.
What is Snowflake Data Sharing?
Snowflake Data Sharing is a new feature that lets you easily, seamlessly, and securely, share tables, views, even entire databases with anyone inside the Snowflake ecosystem, in a read only mode. They can then query the data from within their own Snowflake account and even join it to their own internal data as if it was all in their database.
That means no more needed to reformat and export data to flat files so they can be transmitted (via secure FTP or some other transfer protocol) to then be loaded into your customer’s or partner’s database.
All that time and effort – gone!
Data extraction process – gone!
Data movement – gone!
Data latency – gone!
Extra storage – gone!
You create your database, load the data, then share the data. And once the data object is shared, as you add more data or update the data set, those changes are immediately available for the data consumers to query. No more wasted time waiting for an incremental update file to be built and transmitted.
And you have complete control on who sees what data. In fact you can revoke anyones access instantly with a single command.
Oh – did I mention that the new feature is FREE to all Snowflake customers. It is built into the standard edition! (That’s just crazy!)
How does it work?
The reason that only Snowflake can do this is because of its unique multi-cluster, shared data architecture that completely separates compute resources from storage. That is why the data can be stored once (by the data provider) and then be shared to an unlimited number of data consumers. The global meta data and security services in Snowflake’s cloud services layer are key components that allow sharing to be not only fast but secure. With independent compute clusters (i.e., virtual warehouses), data consumers can use whatever amount of compute they require to query and use the shared data without impact on either the data provider or other data consumers.
So the basic process for data sharing is simple:
- Data Provider creates a share container with the objects (databases, schemas, tables, or views) to be shared.
- Data Provider then grants a Data Consumer account access to the share.
- Data Consumer creates new database that maps to the shared object(s).
- Data Consumer then grants access privileges to a role in their account
- Data Consumer starts querying, using the privileged role and their virtual warehouse.
Code examples:
Data Provider code:
Here is a scenario where the data provider wants to share just a single table in a database to several accounts. This approach allows the provider to verify the configuration and contents of the share before making it visible to other accounts (this is the recommended approach).
CREATE SHARE sales_s1; -- create an empty share
GRANT USAGE on DATABASE sales to SHARE sales_s1; -- add database
GRANT USAGE on SCHEMA sales.east to SHARE sales_s1; -- add schema
GRANT SELECT on TABLE sales.east.new_orders
to SHARE sales_s1; -- add table
SHOW SHARES;
ALTER SHARE sales_s1 ADD ACCOUNTS=a1, a2, a3; -- add accounts
Data Consumer code:
On the consumer side, each account would create a database from the share sales_s1, then grant access to the new database in order to access the table NEW_ORDERS.
CREATE DATABASE External_SalesData from SHARE ProviderAcct1.sales_s1; GRANT IMPORTED PRIVILEGES on DATABASE External_SalesData to MyRole;
Security – Revoking a Share
If for some reason a Data Provider needs to stop sharing their data either to a single account or to everyone, that is also easy to do. They can either REVOKE the privileges granted or completely DROP the share.
REVOKE SELECT ON TABLE sales.east.new_orders FROM SHARE sales_s1;
or just
DROP SHARE sales_s1;
Unlimited Possibilities for the New Data Economy
So, how can your business change and grow with this capability (that costs you nothing)? Do you have partners that have wanted access to your data but found it too difficult to engineer that data pipeline? Is there a market for your data, and the insights it provides, that you have not even explored?
This feature redefines the old Data Warehouse into a modern Data Sharehouse that lets you derive even more value from all your data – with no limits.
With Snowflake Data Sharing, you can now transform your data into a valuable, strategic business asset.
For More Information
For more details on Snowflake Data Sharing, check out these posts:
https://www.snowflake.net/data-sharehouse-brings-forth-new-market/
https://www.snowflake.net/data-sharehouse/
Then download the free ebook “From Data Warehouse to Data Sharehouse” for an even more in-depth look at Snowflake Data Sharing
And signup for the live webinar “A Deeper Look at Data Sharing” coming next week.
So what do you think? How could this change your business?
Cheers.
Kent
The Data Warrior
