The Data Warrior

Changing the world, one data model at a time. How can I help you?

Archive for the tag “#DWAutomation”

26 Jan 2023

Why Column-Aware Metadata Is Key to Automating Data Transformation

So it is 2023, and like everyone, I have a few predictions. Check out my thoughts in this post about automating data transformations using column-aware metadata and why it is critical to the success of more collaboration and data sharing..

Data, data, data. It does seem we are not only surrounded by talk about data, but by the actual data itself. We are collecting data from every nook and cranny of the universe (literally!). IoT devices in every industry; geolocation information on our phones, watches, cars, and every other mobile device; every website or app we access—all are collecting data. 

In order to derive value from this avalanche of data, we have to get more agile when it comes to preparing the data for consumption. This process is known as data transformation, and while automation in many areas of the data ecosystem has changed the data industry over the last decade, data transformations have lagged behind. 

That started to change in 2022, and in 2023 I predict we will see an accelerated adoption of platforms that enable data transformation automation. 

Read the rest of the post here – Why Column-Aware Metadata Is Key to Automating Data Transformation

May 2023 be your most agile year yet!

Kent

The Data Warrior

Posted in Big Data, Data Warehouse, thought leadership and tagged , , , , , , , , , | Leave a comment
27 Apr 2022

Why Automation is No Longer a Choice for Your Data Architecture

Back in the saddle again for The Data Warrior! Here is a piece I just did for the folks at Wherescape about one of my favorite topics – Automation!

The world of data has changed for sure. Especially over the past several years. In fact, the pandemic accelerated some changes, like the migration to cloud-based data platforms. When everyone needed to be remote, it just made sense to move to the cloud and use a service for your data platform.

Along with that came more data, more data types, and an actual business needs to move faster. Companies had to adapt very quickly during the pandemic if they wanted to survive. Many did and thrived while others, well, not so much.

As the demand for data continues to grow at unprecedented rates, and as it becomes a non-negotiable asset for organizational success, the requirement to rapidly deliver value from that data (i.e., turn it into information for data-driven decision making) has become an imperative.

So how do we deliver value faster with our data warehouses, data meshes, and enterprise data hubs? Automate, automate, automate.

Check out the full post here – Why Automation is No Longer a Choice for Your Data Architecture

Enjoy!

Kent

The Data Warrior

Posted in Data Modeling, Data Warehouse and tagged , , , , , | Leave a comment

Post Navigation

%d bloggers like this: