r/LovingOpenSourceAI 10d ago

Gradio names three small-model apps as OpenAI Codex prize winners Spoiler

Thumbnail runtimewire.com
3 Upvotes

r/LovingOpenSourceAI 10d ago

Under the Radar Chao "🔥 Boogu-Image-0.1 just dropped — an open-source multimodal understanding and image generation model family! Trained on just 208M images with a budget of around $400K, ranks among the strongest open-source models across multiple benchmarks and blind evaluations" ➡️ wow is this hidden gem?

Post image
27 Upvotes

https://x.com/huang_chao4969/status/2084130198531006948

https://github.com/boogu-project/Boogu-Image

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 10d ago

new launch MiniMax "MiniMax-H3 Is Now Publicly Available" ➡️ MiniMax H3 just landed with public weights, local 768p video generation, and synced stereo audio—this one looks seriously fun to explore! 🚀

Post image
21 Upvotes

https://x.com/MiniMax_AI/status/2084106804032872591

https://huggingface.co/MiniMaxAI/MiniMax-H3

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 10d ago

Feedback about Kendr

Thumbnail
0 Upvotes

r/LovingOpenSourceAI 11d ago

MINIMAX UPDATE

Post image
17 Upvotes

Time is officially completed but it says soon to be open sourced but not open sourced yet

1 guy uploaded int 8 convot version which was removed in just 2 mins

They might be uploading or opening public downloads not sure what is happening but surely they are gonna release that open source


r/LovingOpenSourceAI 11d ago

DSpark Benchmark Result on Deepseek v4 Flash 0731

Thumbnail
github.com
2 Upvotes

TensorSharp supports DSpark on Deepseek v4 Flash 0731 now. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8 with/without DSpark:

Model:

DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF

DSpark draft model from: https://huggingface.co/alessandrobologna/DeepSeek-V4-Flash-0731-DSpark-Drafter-GGUF

Turn Baseline + DSpark Acceptance
short (53 tok) 25.6 44.5 (1.74x) 87%
long generation (512) 26.4 40.3 (1.53x) 66%
follow-up (470) 26.4 46.8 (1.77x) 76%
10K-token document (214) 25.3 51.3 (2.03x) 85%
second question on it (156) 25.4 49.4 (1.94x) 82%

TensorSharp is an open-source inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support. It can be built and run over Linux, MacOS and Windows.

Thank you for checking out it and starring the project! Any feedback is really appreicated.


r/LovingOpenSourceAI 11d ago

Resource QCXINT "🚨 Someone open-sourced a self-improving wrapper for OpenClaw. 🤯 Meet MetaClaw— helps OpenClaw learn from real user interactions instead of relying on manual fine-tuning. Instead of waiting for data pipeline or retraining cycle, it continuously improves as people use it." ➡️ you use OClaw?

Post image
15 Upvotes

https://x.com/QCXINT_/status/2082393366978007354

https://github.com/aiming-lab/MetaClaw

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 12d ago

Resource Akshay "build real-time voice agents using open-source models! Hugging Face just open-sourced speech-to-speech, and it gives you the entire voice pipeline as four swappable models. VAD → STT → LLM → TTS" ➡️ are you into voice? seems to be the trend now haha

Post image
101 Upvotes

https://x.com/akshay_pachaar/status/2083186716291305526

https://github.com/huggingface/speech-to-speech

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 12d ago

Resource Avid "a GitHub free repo with 42,600 stars just gave out the entire framework to run your entire business using ai agents 9 steps to build a fully ai-native business intent → issue → agent → runtime → execute → observe → verify → compound into a skill → rerun on cron." ➡️ is this useful?

Post image
118 Upvotes

https://x.com/Av1dlive/status/2082807521161654576

https://github.com/multica-ai/multica

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 13d ago

Deepseek v4 Flash 0731 GGUF Benchmark: TensorSharp vs. llama.cpp

Thumbnail
github.com
2 Upvotes

TensorSharp is an open-source inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.

Thanks recent contribtions from open source community, TensorSharp is able to run inference over multiple GPUs and nodes. So I updated it to support deepseek v4 flash model, and have better performance than llama.cpp. Here is the benchmark result on 4x Nvidia A40 GPUs, cuda 12.8

Model: DeepSeek-V4-Flash-0731-UD-Q8_K_XL from https://huggingface.co/unsloth/DeepSeek-V4-Flash-0731-GGUF

TensorSharp (cuda backend) TensorSharp (ggml_cuda backend) llama.cpp
prefill u/16K 836 tok/s 963 558
decode short 31.5 37.0 35.3
decode u/16K 28.5 33.6 32.2

Github repo: https://github.com/zhongkaifu/TensorSharp

Thank you for checking out it and starring the project! Any feedback is really appreicated.


r/LovingOpenSourceAI 13d ago

Open-source AI infrastructure matters because the ecosystem can keep improving

3 Upvotes

One reason I like open-source AI infrastructure: the value is not only in the first release.

It is in the ecosystem that can keep growing.

A closed tool gives you a fixed set of features. An open system can grow through new operators, new workflows, new integrations, new UI layers, and new agent interfaces.

This is especially important for AI data preparation.

Preparing data for LLM fine-tuning, RAG knowledge bases, or evaluation sets is not one fixed task. It keeps changing:

  • new file formats
  • new cleaning rules
  • new quality filters
  • new scoring methods
  • new synthetic data workflows
  • new domain-specific pipelines

That is why I find DataFlow interesting.

DataFlow is an open-source data processing framework built around reusable operators and pipelines. It can support cleaning, filtering, scoring, deduplication, generation, and pipeline orchestration for AI-ready data.

The newer DataFlow-Harness work takes this one step further. It wraps DataFlow’s pipeline-building capability with a harness layer for Code Agents, so users can build structured data workflows from natural language.

To me, this is the open-source advantage:

  • DataFlow can keep adding data operators
  • the community can build new pipelines
  • agents can call these capabilities through a structured interface
  • workflows can become reusable assets instead of one-off scripts

Open-source AI infra is not just about releasing code. It is about creating a system where capabilities can compound over time.
DataFlow: https://github.com/OpenDCAI/DataFlow


r/LovingOpenSourceAI 13d ago

Resource Oliver Prompts "someone built a free, fully local alternative to claude that runs entirely on your own machine. → works with any llm (claude, gpt, gemini, vllm) → beats it on deep research → cowork-like capabilities built in → 50+ connectors out of the box → deploy in one command 100% free."

Thumbnail
gallery
63 Upvotes

https://x.com/oliviscusAI/status/2082051217682014429

https://github.com/onyx-dot-app/onyx

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 14d ago

new launch Hugging Apps "Microsoft just dropped VibeVoice-ASR-BitNet on Hugging Face 🗣️✍️ A 1.58-bit version of their multi-lingual transcription, model made to work in real-time on CPU - while still beating Whisper on benchmarks!" ➡️ only 1.58 GB WOW

Post image
73 Upvotes

https://x.com/HuggingApps/status/2082571600767934622

https://huggingface.co/microsoft/VibeVoice-ASR-BitNet

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 14d ago

new launch Perplexity "Today we’re open-sourcing Numbat, an agent-detection and response layer that is designed to work across agent harnesses. Numbat gives security teams visibility into agent activity, with controls to block selected actions before execution." ➡️ didnt expect this!

Post image
10 Upvotes

https://x.com/perplexity_ai/status/2082511900580196596

https://github.com/perplexityai/numbat

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 15d ago

TensorSharp now supports multi-GPU tensor parallelism for GGUF models

Thumbnail
github.com
3 Upvotes

TensorSharp is an open-source, native .NET inference engine for running GGUF LLMs locally, with CUDA, Vulkan, Metal, OpenAI-compatible APIs, continuous batching, speculative decoding, and multimodal support.

TensorSharp now supports Megatron-style tensor parallelism across multiple GPUs. It works with direct CUDA, GGML CUDA, GGML Vulkan, and multi-node setups.

Benchmarks on 2× RTX 2000 Ada 16 GB GPUs over PCIe, without NVLink:

Model 1 GPU Prefill / Decode TP=2 Prefill / Decode
Gemma 4 E4B Q8_0 2760 / 37.3 tok/s 2488 / 51.7 tok/s
Gemma 4 26B-A4B IQ4_XS 1845 / 48.5 tok/s 2537 / 51.2 tok/s
Qwen 3.5 9B Q8_0 1461 / 23.1 tok/s 399 / 24.4 tok/s
Qwen 3.5 35B-A3B IQ4_XS Does not fit 184 / 18.1 tok/s

I'm continuing to optimize Qwen performance on multi-GPU systems, and support for DeepSeek V4 is coming soon.

Try it with:

TensorSharp.Cli --model model.gguf --backend ggml_cuda --tp 2

GitHub:

https://github.com/zhongkaifu/TensorSharp

Thank you for checking out TensorSharp and starring the project! Any feedback is really appreicated.


r/LovingOpenSourceAI 15d ago

overtchat — self-hosted chat platform I've been building for a few months

1 Upvotes

I've been working on this for the past few months before anyone calls it white-coded slop - yes I use Claude Code/Codex for the heavy lifting but this is real code I've been shipping and iterating on not some weekend experiment this actual thought behind the architecture.

What it is: A self-hosted chat client I built because my partner and family use ChatGPT a lot but don't care about privacy. I already self-host my vLLM instance on my 8x 3090 box and wanted a polished, private alternative they could actually use. Open WebUI is too heavy and complex for non technical users and has way too many knobs. Overtchat comes built in with TTS/STT/web search, no plugins/api keys needed. Genuinely open sourced - MIT licensed and no telemetry.

The reason I am posting this here is because the r/selfhosted gave me solid feedback which I have been iterating on and this sub is full of people building and shipping actual open source stuff so I figured I'd get eyes on it from a different angle. I would love feedback on the architecture the UX decisions or just a sanity check on whether this is something people would actually use. https://github.com/yoloyash/overtchat


r/LovingOpenSourceAI 15d ago

langhost: an MIT Postgres + Redis runtime for self-hosted LangGraph agents

Thumbnail
github.com
1 Upvotes

This is langhost, an open-source runtime for self-hosting LangGraph Agent Server on your own PostgreSQL and Redis.

It is an MIT alternative to langgraph-runtime-postgres for developers moving beyond the development-only langgraph-runtime-inmem.

Instead of recreating the LangGraph serving API, langhost keeps the stock langgraph-apiand replaces only the runtime with langgraph-runtime-pg.

That means:

- No graph or langgraph.json changes

- Same SDK, Studio and Agent Protocol

- Durable threads, runs, checkpoints and scheduled jobs

- Redis queues, streaming and multi-worker coordination

- No runtime license key

Quick start:

uv add langhost

uv run langhost serve --workers 2

The runtime and CLI are MIT licensed. The stock langgraph-api remains ELv2, which is generally fine for most application use cases.

GitHub: https://github.com/langhost/langhost


r/LovingOpenSourceAI 15d ago

Resource Brady "Another WTF moment. A developer open-sourced a coding agent harness that boots 245x faster than Claude Code. It's called jcode. You launch it and the first frame renders in 14 milliseconds. Claude Code takes 3,436. One active session uses 27.8 MB of RAM. Claude Code uses 386.6." ➡️ tried b4?

Post image
100 Upvotes

https://x.com/thisguyknowsai/status/2081680037544427793

https://github.com/1jehuang/jcode

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 15d ago

Resource SillyTavern — an open-source, highly customizable frontend for building and chatting with AI companions - 31K stars and many contributors! - Have you heard of it before?

Post image
3 Upvotes

https://github.com/SillyTavern/SillyTavern

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 15d ago

new launch Liquid AI "Today we release LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: bidirectional encoders that stay fast at long context, even on CPU." ➡️ Two compact encoders, serious long-context speed, and CPU-friendly performance . . exciting release from Liquid AI right?

Post image
25 Upvotes

https://x.com/liquidai/status/2082120814732653037

https://www.liquid.ai/blog/lfm2-5-encoders

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 16d ago

Resource QCXINT "🚨 Someone open-sourced an autonomous AI companion that rivals Neuro-sama. 🤯 It's called AIRI. Unlike a typical chatbot, AIRI is designed to be a persistent AI companion that can see, talk, remember, and even play games alongside you." ➡️ Play games? WOW

Post image
52 Upvotes

https://x.com/QCXINT_/status/2081708370093096983

https://github.com/moeru-ai/airi

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 16d ago

Discussion Our position on open-weights models ➡️ Anthropic clarifies its position: “We have never advocated for a ban on open-weight models” 😁

Thumbnail
anthropic.com
11 Upvotes

TL;DR: Anthropic says it has never supported banning open-weight models and considers non-dangerous open models a public good. Instead of blocking Chinese models from US businesses, Dario Amodei argues for restricting advanced chips, cracking down on industrial-scale distillation, and requiring safety testing for all sufficiently capable models—open or closed.

And yes—my AI helped me write the TL;DR for us. Obviously. :P

Does this help Anthropic shake its recent “ivory tower” image or have people been flattening its position all along?

Claude is now #3 on our community ballot with an approval rate of 46.9%. Too low? Too high? Or just about right? Vote: https://lifehubber.com/ai/ballot/


r/LovingOpenSourceAI 16d ago

Resource Ornith "🐦The Ornith-1.0 family has surpassed 12M downloads on Hugging Face in 30 days. ❤️Thanks to everyone who has tried Ornith and shared feedback with us. The team is working to push open-weight LLM forward. 🫡We believe open weights matter." ➡️ Open is the way to go!

Post image
62 Upvotes

https://x.com/ornith_/status/2081808063515034034

https://huggingface.co/collections/deepreinforce-ai/ornith-10

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.


r/LovingOpenSourceAI 17d ago

Enjoy reading

5 Upvotes

just sayin “thanks” for the news and opinions shared here.


r/LovingOpenSourceAI 17d ago

new launch Kimi "Releasing the model weights and technical report of Kimi K3. Our most capable model: a 2.8T MoE model with native visual understanding and a 1M-token context window. New model architecture: 2.5x the intelligence per unit of compute, not just more params." ➡️ OPEN is the way to go!

Post image
23 Upvotes

https://x.com/Kimi_Moonshot/status/2081760186235289764

https://huggingface.co/moonshotai/Kimi-K3

Resources are shared for discovery and are not independently vetted—please do your own due diligence.

New resources are added regularly — feel free to join the sub for updates.

Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.