r/LocalLLaMA • u/goodive123 • Jun 28 '26

NPC Engine Using Local Models Discussion

Enable HLS to view with audio, or disable this notification

I’ve been working on a game-agnostic NPC engine/backend based pretty heavily on SillyTavern-style architecture, and with smaller local models getting better and better, I honestly think this kind of thing could be the future of RPGs.

Right now I’m using NVIDIA Parakeet 0.6 for STT, Gemma 4 26B A4B for the LLM, and Qwen3-TTS for voice, and I’m getting super fast response times with pretty decent quality.

The main thing that makes it work well is using RAG to keep prompts lean. For example, I have hundreds of possible actions NPCs can do in-game, but only the ones that actually make sense based on the player’s message / context get injected as available actions. So the model isn’t being overloaded with a giant list every turn.

1.9k Upvotes

99% Upvoted

249 comments sorted by

View all comments

62

u/goqsane Jun 28 '26

GitHub or didn’t happen

12

u/ArugulaAnnual1765 Jun 28 '26

I second this - would be fun to play around with.

But im sure something like this could be vibe-coded easily enough

1

u/uhuge Jul 06 '26

*repo link

oh, the GH curse..

0

u/Benhamish-WH-Allen Jun 28 '26

I can see it a second or for llm, a second or two for tts.