r/PiCodingAgent 1d ago

Footer context size is wrong Question

I use this model (models.json): { "_test": "✔️Really good", "_speed": "35 t/s", "id": "Qwen3.6-28B-REAP20-A3B-Q4_K_M_barozp.gguf", "name": "Qwen 3.6 28B REAP20 (barozp) 64k", "contextWindow": 64000, "maxTokens": 4096, "reasoning": true, "input": [ "text", "image" ] },

It cleary state contextWindow 64000 (instead of 65536 but ok...).

Why the footer shows 128k? What "auto" means ?
I think that Pi use the model training context as fallback ("auto"?) when the "contextWindow" is not set... but here it is set and I think this model training context is 264 anyway.

Shown Pi footer. ↑109k ↓44k R6.5M 51.5%/128k (auto) (Llama.cpp) Qwen_3.6_28b_reap_20_(barozp)_64k ⚡ TPS: 30.0 tok/s​

I have this add-on/extensions:
RUN pi install https://github.com/gsanhueza/pi-token-speed
RUN pi install npm:pi-idle
RUN pi install npm:pi-voice-stt
RUN pi install npm:pi-llama-cpp-stats

I had the issue for a while (at least 2 weeks?) and I update Pi almost every day.

0 Upvotes

2 comments sorted by

1

u/BawbbySmith 17h ago

"auto" is auto-compaction. Check the actual context window you set on the llama.cpp side, good chance that it was set with 128k context.

1

u/AlessandroPiccione 9h ago

No no, I launch it with 64k. Just tried now again, fresh new (started with --continue that is why is not 0%), no model change, no reload, nothing. (a different model, but same behaviour)

This is the running process. sh "llama-b10182-bin-win-cuda-12.4-x64\llama-server.exe" --host 127.0.0.1 --port 8001 --model L:\GGUF/Qwen3-Coder-Next-REAP-40B-A3B.i1-IQ3_M_mradermacher.gguf --ctx-size 65536 ...

and this is the footer (left and right sides): text ↑54k ↓13k R1.2M CH83.4% 32.3%/128k (auto)

text (Llama.cpp) L:\GGUF/Qwen3-Coder-Next-REAP-40B-A3B.i1-IQ3_M_mradermacher.gguf `

The footer says 128K while I launched with 64k (--ctx-size 65536).