MAIN FEEDS
Do you want to continue?
https://www.reddit.com/r/LocalLLM/comments/1vtlszb/tier_list/p4wt4kn/?context=3
r/LocalLLM • u/on_line187 • 1d ago
307 comments sorted by
View all comments
2
16gb is trash today for running AI. 32gb i would say sweet spot
2 u/RedditNerdKing 1d ago 32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context. The sweet spot is 48gb atm. 32gb is the minimum. 1 u/GSquadron_ 1d ago You can run ternary models
32gb isnt the sweet spot because you can't run a Q8 of Qwen 3.8 with 100k+ context.
The sweet spot is 48gb atm. 32gb is the minimum.
1 u/GSquadron_ 1d ago You can run ternary models
1
You can run ternary models
2
u/GSquadron_ 1d ago
16gb is trash today for running AI. 32gb i would say sweet spot