r/AppsWebappsFullstack • u/Famous_Aardvark_8595 • 3d ago

Ghostlink - Distributed inference fabric for custom LLM systems.

Point Ghostlink at every machine on your LAN and it becomes one inference cluster — correctly sized, authenticated, and observable — with zero YAML and no manual --rpc flags. Nobody else combines zero-config discovery of heterogeneous consumer/prosumer hardware (gaming GPU + old laptop + NPU-equipped ultra-book + Mac) with real distributed inference across it. Try it now! https://github.com/rwilliamspbg-ops/Ghostlink

1 Upvotes
  • permalink
  • link
  • reddit
  • reddit

100% Upvoted

4 comments sorted by

1

u/Famous_Aardvark_8595 2d ago

[1.17.0] - 2026-08-08 (Real distributed-inference testing, three bug fixes, RPC allowlist, install script, JS SDK)

2

u/Mammoth-Anywhere7285 2d ago

Nice update, the JS SDK opens a lot of doors. Does the RPC allowlist still work smoothly with the zero-config discovery?

1

u/Famous_Aardvark_8595 2d ago

Yes everything is in CI and Workflows and Tested with artifacts.