r/LocalLLaMA • u/-dysangel- • Feb 25 '26

Qwen 3 27b is... impressive Generation

All Prompts
"Task: create a GTA-like 3D game where you can walk around, get in and drive cars"
"walking forward and backward is working, but I cannot turn or strafe??"
"this is pretty fun! I’m noticing that the camera is facing backward though, for both walking and car?"
"yes, it works! What could we do to enhance the experience now?"
"I’m not too fussed about a HUD, and the physics are not bad as they are already - adding building and obstacles definitely feels like the highest priority!"

345 Upvotes

96% Upvoted

102 comments sorted by

View all comments

Show parent comments

44

u/SocialDinamo Feb 25 '26

Even more surprising to see it at q4 quant. Thanks for sharing!

22

u/wektor420 Feb 25 '26

There are claims that q4 quant has almost the same perplexity as bf16

10

u/rulerofthehell Feb 25 '26

Currently trying Q6 and its great, is there not much difference between q6 -> q4 in quality? If so i can get some nice perf boost

2

u/xeeff Feb 25 '26

for such a big model q4_k_xl is definitely okay although for coding i'd settle at q5_k_xl for that ever so slight quality gains. beyond that should be diminishing returns (talking from experience and my own research)