SeattleDataGuy’s Newsletter

Share this post

A Decade In Data Engineering - What Has Changed?

seattledataguy.substack.com

A Decade In Data Engineering - What Has Changed?

SeattleDataGuy
May 18, 2023
∙ Paid
38
6
Share

The concepts and skills data engineers need to know have been around for decades.

However, the role itself has really only been around for a little over 10 years, with companies like Facebook, Netflix and Google leading the charge. 

Throughout those ten years, there were significant breakthroughs and tools through hype, and general acceptance became standard (if even only for a few years). Each of these tools and practices shifted how we as data engineers operate. 

On top of that, various regulations and legislation reignited a need for better security and governance policies that have always been crucial in data management.

Each of these various turning points pushed data engineering as a discipline to the next level. In this article, we will be going over the 10+ years of data engineering history that got us to where we are today.

2011-2013:  Why Did Data Engineering Become Popular - The Rise of Big Data and Hadoop

Keep reading with a 7-day free trial

Subscribe to SeattleDataGuy’s Newsletter to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2023 SeattleDataGuy
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing