Couldn't agree more. Found this article that aptly sums up the issue: "hiring a data analyst won't solve your business problem" rofl https://medium.com/swlh/why-hiring-a-data-analyst-wont-solve...

What about empowering the magician to handle some of the blacksmith's work?

We need to start glorifying the more mundane tasks (data quality management, fixing broken ETLs, aggregating data)and tying them to the bottomline. This comes up a lot at fintech companies, as lordnacho mentions: data science makes the data look pretty for your CEO, but the data wouldn't even be there if it wasn't for the data engineer.

We need self-service data platforms that hold magicians accountable. I'm seeing this more and more, but there's still a lot of work that needs to be done in this arena: https://towardsdatascience.com/how-to-build-your-data-platfo...

Have you heard of Monte Carlo? Data lineage + data catalog + data anomaly detection: https://www.montecarlodata.com/product/

Yeah, that's who the post was written by (Which I actually did read).

> I assume they may be selling something like that, but their "integration with my existing data stack" is pretty opaque.

The issue is that I have no clue what that actually looks like in practice and I'm not going to request a random demo to find out.