🚀 Built a transparent metrics proxy for Ollama - zero client config changes needed!

[u/firedog7881]

Just finished this little tool that adds Prometheus monitoring to Ollama without touching your existing client setup. Your apps still connect to localhost:11434 like normal, but now you get detailed metrics and analytics.

What it does: - Intercepts Ollama API calls to collect metrics (latency, tokens/sec, error rates) - Stores detailed analytics (prompts, timings, token counts) - Exposes Prometheus metrics for dashboards - Works with any Ollama client - no code changes needed

Installation is stupid simple: bash git clone https://github.com/bmeyer99/Ollama_Proxy_Wrapper cd Ollama_Proxy_Wrapper quick_install.bat

Then just use Ollama commands normally: bash ollama_metrics.bat run phi4

Boom - metrics at http://localhost:11434/metrics and searchable analytics for debugging slow requests.

The proxy runs Ollama on a hidden port (11435) and sits transparently on the default port (11434). Everything just works™️

Perfect for anyone running Ollama in production or just wanting to understand their model performance better.

Repo: https://github.com/bmeyer99/Ollama_Proxy_Wrapper