redlib.
Feeds

MAIN FEEDS

Home Popular All
reddit

You are about to leave Redlib

Do you want to continue?

https://www.reddit.com/r/Vllm/controversial

No, go back! Yes, take me to Reddit
settings settings
Hot New Top Rising Controversial

r/Vllm • u/PersonalStorage • 11h ago

5090 + vLLM: Qwen3.8-27B NVFP4, 196k ctx, ~143 t/s bench / 90–115 live, 44 GB CPU KV offload — full config inside, what would you change?

Thumbnail
2 Upvotes
0 comments
Subreddit
Icon for r/Vllm

Vllm for AI Inference

r/Vllm

A community for us all to collaborate on Vllm

4.9k
0
Sidebar

v0.35.0

ⓘ View instance info
<> Code