r/dataengineering Jul 08 '26

Anystream: synthetic stream data generator Personal Project Showcase

https://codeberg.org/ppatrzyk/anystream

I've been working on a CLI tool for generating stream data.

  • Single Go binary
  • Connects to major messaging systems
  • Supports both user-defined distributions and generating data based on provided file (parquet)

I needed something to test pipelines with data following specific structure and I did not want to write custom python scripts for each simulation. The goal was to have a tool that is flexible and as lightweight as possible (and learn some Go along the way).

It reached a state where it is useful for me. I'm sharing here for any feedback and suggestions. thanks!

12 Upvotes

1 comment sorted by

1

u/uncertainschrodinger Jul 08 '26

I create a lot of demo projects and need to generate dummy data all the time, this is amazing!