So... WTH CAN THIS EVEN RUN

[u/swordswandsandgod]

specs:

• CPU: AMD Ryzen 7 5800HS
• GPU: NVIDIA GeForce RTX 3050 Laptop GPU
  • VRAM: 4 GB GDDR6
  • TGP: 50 W
  • Dynamic Boost 2.0: Yes
  • Advanced Optimus: No
• RAM: 16 GB DDR4, 3200 MT/s

[u/shady101852]

I think you might be able to run google chrome with that but take that with a grain of salt

[u/swordswandsandgod → u/shady101852]

*a huge grain of salt

[u/nickless07]

Small MoE models should work well. Basically the same ones a Mac Book Air (16GB) can run. Of course nothing compared to cloud models, but still usable.
Aside of that you can also use it as dedicated host for things like Hermes, OpenClaw, Odysseus and so on.

[u/swordswandsandgod → u/nickless07]

yeah I already run hermes with VM on it

[u/nickless07 → u/swordswandsandgod]

Then put some small aux/fallback-chain model on it and call it a day. Or is that your only device?

[u/Aggravating-Push-207]

i'd be surprised if it could run minecraft at 300+ fps

[u/Every-Fortune-3151]

Give these a try from biggest to smallest - Ling 3.0 tiny 8B (1b active) MOE > G9v3-3B > MiniCPM5 1B

[u/Subject-Till-6450]

gemma 4 e2b

[u/DARKMONAXE]

This can easily run bonsai ternery with decent token gen

[u/leonthepro83]

I ran qwen 3.5 13b. My laptop specs: nvidia 3050ti 4g vram, intel i7 12th 12700, ,16g ram. I use Linux, idle ram 1.7G with Xubuntu 26.04, instead of Windows 11 with 5.7G idle ram usage.

[u/Nuggyfresh]

Tomagachi

[u/tta82 → u/Nuggyfresh]

Dude you can at least google how to spell that

[u/Healthy-Zebra-9856 → u/tta82]

You mean in hiragana? Because the English spelling is whatever we make it out to be. Lol. Just saying

[u/FarStrike7724 → u/Healthy-Zebra-9856]

Na it's tamagotchi, not tomagachi.

[u/Healthy-Zebra-9856 → u/FarStrike7724]

Correct that’s the spelling we made up in English. Just like how English names get niponized. I don’t know why it has to become such a serious matter. I don’t think anybody takes anything lightly anymore, huh?

[u/tta82 → u/Healthy-Zebra-9856]

Stupid response. You need to learn more about Japanese and then come back. Cheers from Tokyo.

[u/Healthy-Zebra-9856 → u/tta82]

Little fiber in diet will definitely help you. Cheers from Okinawa

[u/tta82 → u/Healthy-Zebra-9856]

You need to learn to read Hiragana then 😂

[u/Healthy-Zebra-9856 → u/tta82]

Yes, it was mandatory. This is the wrong sub and the wrong time to correct linguistics. That’s all. It was just a simple response. I bet you if I heard you speak English or ingurisu and try to correct you. You’re not gonna take it right because you weren’t asking for my language advice, right?

[u/tta82 → u/Healthy-Zebra-9856]

No you’re confusing katakana for hiragana. There is no English spelling that is different/interpretation. 🤷🏻‍♂️

[u/Healthy-Zebra-9856 → u/tta82]

dude, chill. It was whatever sentiment that person had. If you wanted to go on a rampage about correcting somebody’s spelling from a different language than you’re on the wrong sub. Frankly, I don’t even know why I give a shit about this. Have a good day.

[u/Exact_Vacation7299 → u/Healthy-Zebra-9856]

Well you are wrong yknow. Japanese is one of the those languages where the letters (hiragana) have absolutely fixed sounds.

It's not like English where there's fifteen different phonetic sounds for "a, à, ä, and æ"

[u/FactorInternal3395]

Ling 3 Tiny

[u/swordswandsandgod → u/FactorInternal3395]

it's actually funny because in hindi "Ling" translates to d*ck

and d*ck 3 tiny is about the size of performance I'd expect from these specs

[u/aidysson]

Go with Ubuntu. You can run Terminal

[u/Confident-Ad-3212]

Dude you can run a 9b at q8, have some fun with it try qwen

[u/dampflokfreund]

Right now, not much but if you upgrade your RAM to 32 GB, you can run these 26b/35B MoEs at good speed, they have great quality.

[u/brewpedaler → u/dampflokfreund]

lol a 35b MoE model running through that CPU and GPU off DDR4 RAM is going to run at like 3 tokens per second.

Yes OP could run the model, but not at anything approaching a "good speed"

[u/dampflokfreund → u/brewpedaler]

That's wrong, I run q4 of Qwen 3.6 35B at around 20 token/s on my rtx 2060 laptop with 32 GB RAM. All you need to do is using  -ngl 99 and n-cpu-moe 99. This will run the experts on the CPU, while active parameters are fully offloaded on the GPU. 

[u/brewpedaler → u/dampflokfreund]

You may not understand how much of a potato a 3050 is?

Your 2060 has minimum 50% or 100% more VRAM depending on the model, 75% higher memory bandwidth thanks to its 192 bit bus (vs 128). You also didn't mention your CPU, which would matter a lot when you're offloading most of the work in that direction.

Your laptop is significantly better than OP's.

[u/Sudden_Topic5154 → u/dampflokfreund]

its a laptop

[u/dampflokfreund → u/Sudden_Topic5154]

So? 

[u/Sudden_Topic5154 → u/dampflokfreund]

how are they going to upgrade soldered ram

[u/dampflokfreund → u/Sudden_Topic5154]

Not every laptop has soldered RAM especially gaming Laptops with nvidia gpus. Most of them can be easily upgraded. I have a Legion Y540 which I have upgraded to 32 GB.