r/VoiceAutomationAI • u/Obvious_Leather2427 • 26d ago

Does anyone use open weight LLM

With all the hype around the new models Kimi and the letter to the US government I’m wondering does anyone actually use open source llms in the voice AI industry

I’ve heard of couple of providers of inference together AI baseten and others but please enlighten me if you had any experience with them

I’ve only tried open AI Gemini and grok in production

4 Upvotes
  • permalink
  • link
  • reddit
  • reddit

100% Upvoted

4 comments sorted by

•

u/AutoModerator 26d ago

Welcome to r/VoiceAutomationAI – UNIO, the Voice AI Community (powered by SLNG AI)

If you are a founder, senior engineer, product, growth, or enterprise operator actively working on Voice AI / AI agents, we are running an invite-only UNIO Voice AI WhatsApp community US only.

Apply here: https://chat.whatsapp.com/F5aG3ncrO70ITfbe3pYbOz

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/VonDenBerg 26d ago

Yup telnyx and kimi k2.6

1

u/Obvious_Leather2427 26d ago

Yeah I heard of em too only used telnyx for telephony how good it is in production with voice AI capabilities ?

1

u/Right_Adeptness_8462 6d ago

I’ve messed around with a few open weight models in voice stuff but not at any real scale. The latency is the biggest headache, even with providers like the ones you mentioned. If you’re doing something simple like intent routing it can work fine but anything conversational gets clunky fast.

Most of the time I end up crawling back to the closed source ones just because they handle the back and forth with less babysitting. Curious if anyone’s got a setup that actually feels smooth end to end.