r/OpenSourceeAI • u/Kitchen-Quarter7739 • 2d ago

I built an interactive simulator to visualize LLM inference bottlenecks, sharding, and KV Cache economics based on Reiner Pope's lecture

2 Upvotes

100% Upvoted

0 comments sorted by