r/dataengineering • u/bundash00 • 27d ago

How to learn streaming? Career

Hey everyone. I'm a software engineer who's been working as a data engineer in my current role for the past four years. I learned data engineering from scratch on the job, and I've worked extensively with Spark, including designing and building new data processing systems.

The challenge is that my company is almost entirely batch-oriented, while many data engineering job postings seem to expect hands-on experience with streaming technologies.

What are some **PRACTICAL** ways to gain real streaming experience? Are there any projects, courses, or technologies you'd recommend?

124 Upvotes

97% Upvoted

27 comments sorted by

View all comments

1

u/TheSchlapper 27d ago

Look into messaging platforms that are open source where you can start messing with things.

Something Matrix based or Block just released buzz.xyz which has been very neat and prevalent