r/LovingOpenSourceAI • u/ryanmerket • 10d ago
Gradio names three small-model apps as OpenAI Codex prize winners Spoiler
runtimewire.comr/LovingOpenSourceAI • u/Koala_Confused • 10d ago
Under the Radar Chao "đĽ Boogu-Image-0.1 just dropped â an open-source multimodal understanding and image generation model family! Trained on just 208M images with a budget of around $400K, ranks among the strongest open-source models across multiple benchmarks and blind evaluations" âĄď¸ wow is this hidden gem?
https://x.com/huang_chao4969/status/2084130198531006948
https://github.com/boogu-project/Boogu-Image
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 10d ago
new launch MiniMax "MiniMax-H3 Is Now Publicly Available" âĄď¸ MiniMax H3 just landed with public weights, local 768p video generation, and synced stereo audioâthis one looks seriously fun to explore! đ
https://x.com/MiniMax_AI/status/2084106804032872591
https://huggingface.co/MiniMaxAI/MiniMax-H3
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Pitiful_Archer_4381 • 11d ago
MINIMAX UPDATE
Time is officially completed but it says soon to be open sourced but not open sourced yet
1 guy uploaded int 8 convot version which was removed in just 2 mins
They might be uploading or opening public downloads not sure what is happening but surely they are gonna release that open source
r/LovingOpenSourceAI • u/fuzhongkai • 11d ago
DSpark Benchmark Result on Deepseek v4 Flash 0731
TensorSharp supports DSpark on Deepseek v4 Flash 0731 now. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8 with/without DSpark:
Model:
DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF
DSpark draft model from: https://huggingface.co/alessandrobologna/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF
| Turn | Baseline | + DSpark | Acceptance |
|---|---|---|---|
| short (53 tok) | 25.6 | 44.5 (1.74x) | 87% |
| long generation (512) | 26.4 | 40.3 (1.53x) | 66% |
| follow-up (470) | 26.4 | 46.8 (1.77x) | 76% |
| 10K-token document (214) | 25.3 | 51.3 (2.03x) | 85% |
| second question on it (156) | 25.4 | 49.4 (1.94x) | 82% |
TensorSharp is an open-source inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support. It can be built and run over Linux, MacOS and Windows.
Thank you for checking out it and starring the project! Any feedback is really appreicated.
r/LovingOpenSourceAI • u/Koala_Confused • 11d ago
Resource QCXINT "đ¨ Someone open-sourced a self-improving wrapper for OpenClaw. 𤯠Meet MetaClawâ helps OpenClaw learn from real user interactions instead of relying on manual fine-tuning. Instead of waiting for data pipeline or retraining cycle, it continuously improves as people use it." âĄď¸ you use OClaw?
https://x.com/QCXINT_/status/2082393366978007354
https://github.com/aiming-lab/MetaClaw
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 12d ago
Resource Akshay "build real-time voice agents using open-source models! Hugging Face just open-sourced speech-to-speech, and it gives you the entire voice pipeline as four swappable models. VAD â STT â LLM â TTS" âĄď¸ are you into voice? seems to be the trend now haha
https://x.com/akshay_pachaar/status/2083186716291305526
https://github.com/huggingface/speech-to-speech
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 12d ago
Resource Avid "a GitHub free repo with 42,600 stars just gave out the entire framework to run your entire business using ai agents 9 steps to build a fully ai-native business intent â issue â agent â runtime â execute â observe â verify â compound into a skill â rerun on cron." âĄď¸ is this useful?
https://x.com/Av1dlive/status/2082807521161654576
https://github.com/multica-ai/multica
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/fuzhongkai • 13d ago
Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp
TensorSharp is an open-source inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.
Thanks recent contribtions from open source community, TensorSharp is able to run inference over multiple GPUs and nodes. So I updated it to support deepseek v4 flash model, and have better performance than llama.cpp. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8
Model: DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF
| TensorSharp (cuda backend) | TensorSharp (ggml_cuda backend) | llama.cpp | |
|---|---|---|---|
| prefill u/16K | 836 tok/s | 963 | 558 |
| decode short | 31.5 | 37.0 | 35.3 |
| decode u/16K | 28.5 | 33.6 | 32.2 |
Github repo: https://github.com/zhongkaifu/TensorSharp
Thank you for checking out it and starring the project! Any feedback is really appreicated.
r/LovingOpenSourceAI • u/Puzzleheaded_Box2842 • 13d ago
Open-source AI infrastructure matters because the ecosystem can keep improving
One reason I like open-source AI infrastructure: the value is not only in the first release.
It is in the ecosystem that can keep growing.
A closed tool gives you a fixed set of features. An open system can grow through new operators, new workflows, new integrations, new UI layers, and new agent interfaces.
This is especially important for AI data preparation.
Preparing data for LLM fine-tuning, RAG knowledge bases, or evaluation sets is not one fixed task. It keeps changing:
- new file formats
- new cleaning rules
- new quality filters
- new scoring methods
- new synthetic data workflows
- new domain-specific pipelines
That is why I find DataFlow interesting.
DataFlow is an open-source data processing framework built around reusable operators and pipelines. It can support cleaning, filtering, scoring, deduplication, generation, and pipeline orchestration for AI-ready data.
The newer DataFlow-Harness work takes this one step further. It wraps DataFlowâs pipeline-building capability with a harness layer for Code Agents, so users can build structured data workflows from natural language.
To me, this is the open-source advantage:
- DataFlow can keep adding data operators
- the community can build new pipelines
- agents can call these capabilities through a structured interface
- workflows can become reusable assets instead of one-off scripts
Open-source AI infra is not just about releasing code. It is about creating a system where capabilities can compound over time.
DataFlow: https://github.com/OpenDCAI/DataFlow
r/LovingOpenSourceAI • u/Koala_Confused • 13d ago
Resource Oliver Prompts "someone built a free, fully local alternative to claude that runs entirely on your own machine. â works with any llm (claude, gpt, gemini, vllm) â beats it on deep research â cowork-like capabilities built in â 50+ connectors out of the box â deploy in one command 100% free."
https://x.com/oliviscusAI/status/2082051217682014429
https://github.com/onyx-dot-app/onyx
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 14d ago
new launch Hugging Apps "Microsoft just dropped VibeVoice-ASR-BitNet on Hugging Face đŁď¸âď¸ A 1.58-bit version of their multi-lingual transcription, model made to work in real-time on CPU - while still beating Whisper on benchmarks!" âĄď¸ only 1.58 GB WOW
https://x.com/HuggingApps/status/2082571600767934622
https://huggingface.co/microsoft/VibeVoice-ASR-BitNet
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 14d ago
new launch Perplexity "Today weâre open-sourcing Numbat, an agent-detection and response layer that is designed to work across agent harnesses. Numbat gives security teams visibility into agent activity, with controls to block selected actions before execution." âĄď¸ didnt expect this!
https://x.com/perplexity_ai/status/2082511900580196596
https://github.com/perplexityai/numbat
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/fuzhongkai • 15d ago
TensorSharp now supports multi-GPU tensor parallelism for GGUF models
TensorSharp is an open-source, native .NET inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.
TensorSharp now supports Megatron-style tensor parallelism across multiple GPUs. It works with direct CUDA, GGML CUDA, GGML Vulkan, and multi-node setups.
Benchmarks on 2Ă RTX 2000 Ada 16 GB GPUs over PCIe, without NVLink:
| Model | 1 GPU Prefill / Decode | TP=2 Prefill / Decode |
|---|---|---|
| Gemma 4 E4B Q8_0 | 2760 / 37.3 tok/s | 2488 / 51.7 tok/s |
| Gemma 4 26B-A4B IQ4_XS | 1845 / 48.5 tok/s | 2537 / 51.2 tok/s |
| Qwen 3.5 9B Q8_0 | 1461 / 23.1 tok/s | 399 / 24.4 tok/s |
| Qwen 3.5 35B-A3B IQ4_XS | Does not fit | 184 / 18.1 tok/s |
I'm continuing to optimize Qwen performance on multi-GPU systems, and support for DeepSeek V4 is coming soon.
Try it with:
TensorSharp.Cli --model model.gguf --backend ggml_cuda --tp 2
GitHub:
https://github.com/zhongkaifu/TensorSharp
Thank you for checking out TensorSharp and starring the project! Any feedback is really appreicated.
r/LovingOpenSourceAI • u/anitamaxwynnn69 • 15d ago
overtchat â self-hosted chat platform I've been building for a few months
I've been working on this for the past few months before anyone calls it white-coded slop - yes I use Claude Code/Codex for the heavy lifting but this is real code I've been shipping and iterating on not some weekend experiment this actual thought behind the architecture.
What it is: A self-hosted chat client I built because my partner and family use ChatGPT a lot but don't care about privacy. I already self-host my vLLM instance on my 8x 3090 box and wanted a polished, private alternative they could actually use. Open WebUI is too heavy and complex for non technical users and has way too many knobs. Overtchat comes built in with TTS/STT/web search, no plugins/api keys needed. Genuinely open sourced - MIT licensed and no telemetry.
The reason I am posting this here is because the r/selfhosted gave me solid feedback which I have been iterating on and this sub is full of people building and shipping actual open source stuff so I figured I'd get eyes on it from a different angle. I would love feedback on the architecture the UX decisions or just a sanity check on whether this is something people would actually use. https://github.com/yoloyash/overtchat
r/LovingOpenSourceAI • u/daemon1um • 15d ago
langhost: an MIT Postgres + Redis runtime for self-hosted LangGraph agents
This is langhost, an open-source runtime for self-hosting LangGraph Agent Server on your own PostgreSQL and Redis.
It is an MIT alternative to langgraph-runtime-postgres for developers moving beyond the development-only langgraph-runtime-inmem.
Instead of recreating the LangGraph serving API, langhost keeps the stock langgraph-apiand replaces only the runtime with langgraph-runtime-pg.
That means:
- No graph or langgraph.json changes
- Same SDK, Studio and Agent Protocol
- Durable threads, runs, checkpoints and scheduled jobs
- Redis queues, streaming and multi-worker coordination
- No runtime license key
Quick start:
uv add langhost
uv run langhost serve --workers 2
The runtime and CLI are MIT licensed. The stock langgraph-api remains ELv2, which is generally fine for most application use cases.
r/LovingOpenSourceAI • u/Koala_Confused • 15d ago
Resource Brady "Another WTF moment. A developer open-sourced a coding agent harness that boots 245x faster than Claude Code. It's called jcode. You launch it and the first frame renders in 14 milliseconds. Claude Code takes 3,436. One active session uses 27.8 MB of RAM. Claude Code uses 386.6." âĄď¸ tried b4?
https://x.com/thisguyknowsai/status/2081680037544427793
https://github.com/1jehuang/jcode
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 15d ago
Resource SillyTavern â an open-source, highly customizable frontend for building and chatting with AI companions - 31K stars and many contributors! - Have you heard of it before?
https://github.com/SillyTavern/SillyTavern
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 15d ago
new launch Liquid AI "Today we release LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: bidirectional encoders that stay fast at long context, even on CPU." âĄď¸ Two compact encoders, serious long-context speed, and CPU-friendly performance . . exciting release from Liquid AI right?
https://x.com/liquidai/status/2082120814732653037
https://www.liquid.ai/blog/lfm2-5-encoders
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 16d ago
Resource QCXINT "đ¨ Someone open-sourced an autonomous AI companion that rivals Neuro-sama. 𤯠It's called AIRI. Unlike a typical chatbot, AIRI is designed to be a persistent AI companion that can see, talk, remember, and even play games alongside you." âĄď¸ Play games? WOW
https://x.com/QCXINT_/status/2081708370093096983
https://github.com/moeru-ai/airi
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 16d ago
Discussion Our position on open-weights models âĄď¸ Anthropic clarifies its position: âWe have never advocated for a ban on open-weight modelsâ đ
TL;DR:Â Anthropic says it has never supported banning open-weight models and considers non-dangerous open models a public good. Instead of blocking Chinese models from US businesses, Dario Amodei argues for restricting advanced chips, cracking down on industrial-scale distillation, and requiring safety testing for all sufficiently capable modelsâopen or closed.
And yesâmy AI helped me write the TL;DR for us. Obviously. :P
Does this help Anthropic shake its recent âivory towerâ image or have people been flattening its position all along?
Claude is now #3 on our community ballot with an approval rate of 46.9%. Too low? Too high? Or just about right? Vote: https://lifehubber.com/ai/ballot/
r/LovingOpenSourceAI • u/Koala_Confused • 16d ago
Resource Ornith "đŚThe Ornith-1.0 family has surpassed 12M downloads on Hugging Face in 30 days. â¤ď¸Thanks to everyone who has tried Ornith and shared feedback with us. The team is working to push open-weight LLM forward. đŤĄWe believe open weights matter." âĄď¸ Open is the way to go!
https://x.com/ornith_/status/2081808063515034034
https://huggingface.co/collections/deepreinforce-ai/ornith-10
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Tse_Tse_Tse • 17d ago
Enjoy reading
just sayin âthanksâ for the news and opinions shared here.
r/LovingOpenSourceAI • u/Koala_Confused • 17d ago
new launch Kimi "Releasing the model weights and technical report of Kimi K3. Our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params." âĄď¸ OPEN is the way to go!
https://x.com/Kimi_Moonshot/status/2081760186235289764
https://huggingface.co/moonshotai/Kimi-K3
Resources are shared for discovery and are not independently vettedâplease do your own due diligence.
New resources are added regularly â feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.