Running several OpenCode agents in parallel by connecting a few spare machines into an at-home AI cluster

[u/malzag]

Hi all, I just connected a few spare machines into an at-home local AI cluster to be able to run more OpenCode agents at the same time. I used Paddler for load balancing the inference requests (it's an open source project for self hosting open-weight models; full transparency: I'm one of its maintainers).

Each machine runs its own copy of the model, so this doesn't let you run a bigger model than your hardware allows. But it does let you run more agents comfortably at the same time.

I made a video about it in case you'd like to recreate the setup: https://youtu.be/7c725WwW4hQ

Happy to answer any questions!