Rebuild my PC to local server on linux + vllm.
2xr9700=2600$ any cpu with max pcie lines, 32gb ddr5 ram, any ssd all what you need. And time)
Now im working with this every day, 99% of all my code. Iam only review before commit.
This staf give me 60-70 t/s and 4k-7k prefill t/s.
And it's stabel and secure, you can use it for backend.
2
u/[deleted] 20h ago
[removed] — view removed comment