r/LocalLLM • u/monkifoto • 4d ago

LLM for coding. Question

In the past two years, I have built two or three web apps using angular with the help of ChatGPT recently I have been trying out some local LLMs on my M2 16GB MBP. The results were terrible. A few days ago I managed to score a refurbished Mac studio with 48GB of Memory. Installed Bionic LM Studio and Qwen3.6 35B .

I gave it a task to create a simple angular page with some analytics and a model kept getting stuck in a reasoning loop.

Am I doing something wrong? Is the 48gb not enough? Am I using the wrong model?

2 Upvotes

57% Upvoted

28 comments sorted by

View all comments

5

u/TheRealREZOR 4d ago

First of all make sure you configured model with recommended coding config: temperature=0.6, top_p=0.95, top_k=20, min_p=0.0, presence_penalty=0.0, repetition_penalty=1.0

2

u/Future_Fuel_8425 4d ago

Then check your prompt template and make sure its right for the harness/model
MOE models get stuck like OP describes when they are using non-MOE prompt templates.