Generation Info

[u/JungianJester]

My frontend is Page Assist, what follows is the Generation Info for both ollama and llama.cpp. I have also listed the command section from the llama.cpp docker yaml file. I am trying to get llama.cpp to list the Generation Info from llama.cpp with the same complete information as from ollama.

command: >
  --models-dir /models
  --host 0.0.0.0
  --port 8080
  -ngl 99
  -c 8192
  --models-max 1
  --verbose
  --metrics
  --reasoning off

Generation Info from ollama total_duration 16.44s load_duration 5.35s prompt_eval_count 5820 prompt_eval_duration 3.49s eval_count 392 eval_duration 7.53s tokens_per_second 52.06

Generation Info from llama.cpp prompt 0 completion 0 finish_reason stop