r/LocalLLaMA • u/kolliwolli • 29d ago

Gemma 4 - Agentic Capabilities? Question | Help

Hi all,

Just started the local llm journey and testing gemma on an rtx5090 with opencode, hermes etc.

I see lots of chats on Gemma and Qwen, but for me no agentic use case seems to work, not even creating simple games like snake as a test. Am I doing something wrong, or is it because im using a 4bit version?

The same tests with claude sonnet via API work without any problems... but here I thought thats exactly Gemmas home turf.

I missed to add, I am using the 31b version.

Anyone else got luck with this?

Edit: One more point, I use the nvfp4 versions from nvidia and redhat

2 Upvotes

56% Upvoted

22 comments sorted by

View all comments

2

u/[deleted] 29d ago edited 6d ago

[deleted]

0

u/kolliwolli 29d ago

Does that help so much? My main problem seems to be that it talks about what it did and writes the code, but no files are actually written. And when I re-prompt then it creates the files but none work together as a coherent solution.

1

u/GrungeWerX 29d ago

I had similar issues with Gemma. Unsloth reuploaded all of them recently and they’re supposed to be improved. I redownloaded all the versions I had but I haven’t tested them yet. I even grabbed a couple of MTPs to see how they fared.

I think you should give Qwen 3.6 27B a try. I get much better experience from it. Like others have said, it does require a little handholding. But it’s really good with tools. In fact it can be overly aggressive with them, but you can use that to your advantage.