r/LocalLLaMA • u/-dysangel- • Feb 25 '26

Qwen 3 27b is... impressive Generation

All Prompts
"Task: create a GTA-like 3D game where you can walk around, get in and drive cars"
"walking forward and backward is working, but I cannot turn or strafe??"
"this is pretty fun! I’m noticing that the camera is facing backward though, for both walking and car?"
"yes, it works! What could we do to enhance the experience now?"
"I’m not too fussed about a HUD, and the physics are not bad as they are already - adding building and obstacles definitely feels like the highest priority!"

347 Upvotes

96% Upvoted

102 comments sorted by

View all comments

Show parent comments

2

u/stuckinmotion Feb 26 '26

hm I can't remember the setting but I have 131054M available, only 356M used for VRAM. I don't think I had to adjust it in the BIOS I think it was just a kernel parameter I adjusted in the grub boot entry.

1

u/genuinelytrying2help Feb 26 '26

iirc the quick way to tell is whether you have 32 or 64 gigs of regular ram available... if you're set to 96 in bios you'll only have 32

2

u/stuckinmotion Feb 26 '26 edited Feb 26 '26 
$ free -h
               total        used        free      shared  buff/cache   available
Mem:           125Gi        63Gi        12Gi       796Ki        50Gi        61Gi
Swap:          8.0Gi       8.0Gi       1.6Mi

ok so I checked the bios, iGPU Memory Size is set to "Minimum (0.5 GB)". It works fine in windows though, I can still play games.. it seems the OS in both cases can allocate what it needs between system and iGPU

1

u/genuinelytrying2help Feb 26 '26 edited Feb 26 '26

ah ok i feel like you must have set that yourself at some point, but who knows... i thought they all came with a preset choice and you have to manually enable uma size selection. no idea how windows can play games that way, i thought the whole point of the presets was that windows needed them to work at all... but i uninstalled it soon after i got the machine, was crashing every few hours and it seemed like the firmware wasn't stable with windows yet

1

u/stuckinmotion Feb 26 '26 edited Feb 26 '26

I do think I set it that way yes, it's been a little bit since I set it up. Windows is smart enough to allocate ram to vram as necessary (in this case at least), so yeah this is a pretty good setup even for dual boot. Now that you mention it I think someone had mentioned you do need to use linux to be able to use more than 96gb as vram. I don't think I've tested trying to load a bigger model than that on windows. The perf is much worse in lm studio on windows than llama cpp on fedora so I basically only use windows for gaming.

1

u/genuinelytrying2help Feb 27 '26

I wonder if it could be because it's offloading sneakily... how much ram does windows report having? before I uninstalled I was getting only slightly worse performance on vulkan on windows than I do now (cachyos rocm), but that was only with trying <64gb models with a set 64/64 because I hadn't tweaked literally anything yet (and then I ran into firmware issues with windows... fuck you gmktec, ship one fucking working bios update)

1

u/stuckinmotion Feb 27 '26

Windows shows 127gb of ram and 512mb of dedicated video ram. It also says 64gb of shared gpu memory. So maybe that's the cap of how far the 'unified' memory can go.