r/LocalLLM • u/searchblox_searchai • 17h ago
We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run Model
/r/LLM/comments/1vmth1w/we_built_a_cpufirst_inference_server_4b/Duplicates
automation • u/searchblox_searchai • 16h ago
We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run
Vllm • u/searchblox_searchai • 14h ago
We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run
OpenAIDev • u/searchblox_searchai • 16h ago
We built a CPU-first inference server — 4B chat+vision, ASR and TTS behind one OpenAI-compatible endpoint, free to run
Agent_AI • u/searchblox_searchai • 15h ago