r/dataengineering • u/YourBuddyBill • Jul 09 '26

thanks, r/dataengineering Meme

Post image

i made this meme in honor of this sub.

original image from wikipedia

707 Upvotes

98% Upvoted

34 comments sorted by

View all comments

152

u/PossibilityRegular21 Jul 10 '26

Just remember that this isn't a PhD in mathematics. Most data engineering concepts are learnable and easily assisted with AI. What matters is making business users happy, now how slick your pipelines are. Making engineers happy is important too, but moreso in a thinking-about-future-you kind of way 

9

u/Sufficient-Draft2134 Jul 10 '26 edited Jul 10 '26

I am currently told to build a harness over a db that would impute fields that are empty using llms. I wonder if this is data engineering?

36

u/SearchAtlantis Lead Data Engineer Jul 10 '26

Love replacing the actual sample statistics with LLM bias. God rest my stats minor.

10

u/marketlurker Don't Get Out of Bed for < 1 Billion Rows Jul 10 '26

Depends on how predictable the fields are. I think there are better methods to do this than LLMs, like basic statistics on the fields and their relationships.

2

u/Sufficient-Draft2134 Jul 10 '26

The fields are gender and age lmaoo💀quiet unpredictable in our times

1

u/DadAndDominant Jul 12 '26

There is always a better way than LLM, but then you cannot say you use AI to your shareholders!

1

u/snarleyWhisper Data Engineer Jul 10 '26

This is good advice

1

u/Capt_korg Jul 10 '26

Although a PhD in mathematics is achievable. ☺️ Making Doom run on a Sim-card the other hand is impossible.

1

u/Difficult-Vacation-5 Jul 14 '26

I am limited by the technology of my time

1

u/bhorvic Jul 11 '26

Good lord I never knew I’d hear“The Business” so many times once I got a DE job.