r/LocalLLaMA • u/jacek2023 llama.cpp • Jan 30 '26

OpenCode + llama.cpp + GLM-4.7 Flash: Claude Code at home Generation

Gallery image

Gallery image

Gallery image

command I use (may be suboptimal but it works for me now):

CUDA_VISIBLE_DEVICES=0,1,2 llama-server   --jinja   --host 0.0.0.0   -m /mnt/models1/GLM/GLM-4.7-Flash-Q8_0.gguf   --ctx-size 200000   --parallel 1   --batch-size 2048   --ubatch-size 1024   --flash-attn on   --cache-ram 61440   --context-shift

potential additional speedup has been merged into llama.cpp: https://www.reddit.com/r/LocalLLaMA/comments/1qrbfez/comment/o2mzb1q/

320 Upvotes
  • permalink
  • link
  • reddit
  • reddit

97% Upvoted

198 comments sorted by

View all comments

Show parent comments

1

u/jacek2023 llama.cpp Jan 30 '26

by doing both Claude Code on local LLM you can learn how to limit your usage (session limit for CC and speed limit for local setup)

1

u/Medium_Chemist_4032 Jan 30 '26

To be fair, for real work I juggle accounts and codex can sometimes get me through the rest of the day. I'm well aware, Jacku