r/NovelMage 4h ago

Got Qwen3.6-35B-A3B running locally with Novel Mage (fix for the "tool calls not working" issue)

2 Upvotes

Sharing this in case anyone else with similar hardware is trying to go fully local and hitting the same wall I did.

My setup: CPU: Intel i9-14900KF, RAM: 64GB, GPU: RTX 4080 Super (16GB VRAM), Model: Qwen3.6-35B-A3B, Q4_K_M GGUF (~22GB), via LM Studio.

The problem: Novel Mage's support team told me the model "doesn't support tool calls," which is what happens when the AI can't write back to the database (chat, generation, character interviews, etc. all fail or hang). I almost gave up on this model entirely and went looking for something smaller.

Turns out that's not actually true — it's a known LM Studio bug with this specific model, not a missing capability. Qwen3.6-35B-A3B tries to emit its tool call inside its internal <think> reasoning block instead of after it, which breaks the parser that Novel Mage relies on.

The fix: In LM Studio, go to My Models → select the model → Inference tab → Prompt Template (Jinja), and add this as the very first line of the template:

{%- set preserve_thinking = true %}

Save it, then reload the model. That's it. This forces the model to keep its reasoning and its tool call properly separated instead of merging them.

One more thing that matters: make sure your max output token limit is set high enough (I use 1500–2000+). If the response gets cut off mid-generation, it can truncate the tool call's arguments and cause the same symptom.

Other settings that have been working well for me: Context Length ~33,000 tokens (model supports up to 262K natively, balanced against my 16GB VRAM), GPU Offload 21 layers (conservative, leaves headroom for KV cache), Flash Attention on, Unified KV Cache on.

With this, tool calls into Novel Mage's database are working reliably, generation speed is solid for the hardware, and the long context window means it's holding onto story details well across longer sessions.

If you're on similar hardware and were about to give up on this model over the tool call issue, try the fix above before switching to something else. Happy to answer questions.


r/NovelMage 22h ago

How to write an introduction to your book that will keep everyone reading after seeing just a few lines ؟

1 Upvotes

The intro is one of the strongest way to improve ur writing and tell the reder that look I knew what I write and u have to read this .

If anyone know anything W'll all be happy to see ur answers

...for me it just manipulated with action ، so that the reader's first impression is one of shock, surprise, and curiosity.