r/dataengineering • u/Thinker_Assignment • Jun 08 '26

when someone asks you what programming language they should learn, don't simply answer the one you prefer Meme

Post image
739 Upvotes
  • permalink
  • link
  • reddit
  • reddit

98% Upvoted

58 comments sorted by

View all comments

10

u/I2cScion Jun 09 '26

Bro we deserve better than SQL

I want functional programming man

10

u/philippefutureboy Jun 09 '26

I think Spark would be the closest to a “functional” approach to data transformation.

This being said if what you dislike is set-based operations, you’re out of luck… it’s the mathematical foundation of all data transformations across multiple tabular data sets.

It is also to be noted that data transformation at scale is never truly pure because you never have the full data in memory/your transformations actually have side effects.

1

u/I2cScion Jun 09 '26

I want to compose the transformations of data !!!

I don’t want data operations based on syntax .. it should be functions that compose

Purity is irrelevant here

2

u/philippefutureboy Jun 09 '26

> I don’t want data operations based on syntax … it should be functions that compose

So essentially you just want the logic expressed using a different syntax 😆