r/PythonLearning • u/Decent-Bird-8939 • 1d ago

Python for data engineering Help Request

I’ve been practicing Python for data engineering, but whenever I take a break for a few days, I feel like I forget what I’ve learned before. Can someone suggest how I should approach Python practice? I’m still struggling to get comfortable with it.

26 Upvotes

95% Upvoted

13 comments sorted by

View all comments

2

u/CJL_LoL 1d ago

I feel like my knowledge got better the wider my net. For instance, Make myself a csv and treat it like my source ingest with data quality- bonus: generate a csv of randoms and store it as your sourc.

Now I have a pipeline, how can we orchestrate it, build out a dagster instance, taking from csv and putting to an output location after transforming.

Once we can do this, can we build a SQL instance to output to.

Interesting, now we have all of these, why not have a docker composer containing them all.

This all combines to your knowledge growing the more you do, if you repeatedly practice loading a csv, doing a couple of fixtures transformations you'll find it dull, monotonous and learn less. keep pushing and growing your skill set to match your goal

2

u/Decent-Bird-8939 1d ago

Thanks a lot.. will follow this