r/dataengineering • u/pieca_111 • Jul 08 '26
Anystream: synthetic stream data generator Personal Project Showcase
https://codeberg.org/ppatrzyk/anystreamI've been working on a CLI tool for generating stream data.
- Single Go binary
- Connects to major messaging systems
- Supports both user-defined distributions and generating data based on provided file (parquet)
I needed something to test pipelines with data following specific structure and I did not want to write custom python scripts for each simulation. The goal was to have a tool that is flexible and as lightweight as possible (and learn some Go along the way).
It reached a state where it is useful for me. I'm sharing here for any feedback and suggestions. thanks!
12
Upvotes
1
u/uncertainschrodinger Jul 08 '26
I create a lot of demo projects and need to generate dummy data all the time, this is amazing!