SeattleDataGuy’s Newsletter

Share this post

Let's Move Fast And Get Rid Of Data Engineers

seattledataguy.substack.com

Let's Move Fast And Get Rid Of Data Engineers

SeattleDataGuy
Sep 1, 2022
24
Share this post

Let's Move Fast And Get Rid Of Data Engineers

seattledataguy.substack.com

We live in a data world that wants to move fast.

Just shove your data into a data lake and we’ll figure it out later.

Create this table for this one dashboard that we will only look at once and then it will join the hundreds(if not thousands) of other dashboards that are ignored.

All of which can work in the short term but often leaves behind a lot of technical debt. One project I recently worked on literally dumped all of their raw data into an S3 bucket with no form of breakdown source or timing and it was quite chaotic to grasp what was going on.

All of this is driven by executives who need their data yesterday and don’t want to wait as well as by the software and analysts teams who are often driven by very different motivations.

With all this pressure to move fast coming from all sides, an interesting solution I have come across a few times is…Let’s just get rid of data engineering and governance.

Let’s Just Get Rid Of Data Engineers?

Inspired By Codestrap

Keep reading with a 7-day free trial

Subscribe to SeattleDataGuy’s Newsletter to keep reading this post and get 7 days of free access to the full post archives.

Already a paid subscriber? Sign in
© 2023 SeattleDataGuy
Privacy ∙ Terms ∙ Collection notice
Start WritingGet the app
Substack is the home for great writing