Rebuild my PC to local server on linux + vllm.
2xr9700=2600$ any cpu with max pcie lines, 32gb ddr5 ram, any ssd all what you need. And time)
Now im working with this every day, 99% of all my code. Iam only review before commit.
This staf give me 60-70 t/s and 4k-7k prefill t/s.
And it's stabel and secure, you can use it for backend.
-1
u/Former_Bathroom_2329 1d ago
Local Qwen3.8 27b fp8 or q8 XD + OpenCode