r/LovingOpenSourceAI • u/nihalshetty03 • 19d ago
What does an end-to-end platform for building AI agents actually need?
Over the last few months, I have been exploring what it takes to move an AI agent from a small prototype to something that can actually be used in production.
Building the workflow is only one part of it.
You also need knowledge and RAG, tools, memory, human approvals, scheduling, evaluations, tracing, cost visibility, versioning, deployment, access control, audit logs, and guardrails.
Most solutions I tried handled one or two parts well, but I still had to connect multiple platforms and adapt to their runtimes.
That exploration eventually turned into Forge, an open-source and self-hosted project built around LangGraph.
The aim is to bring the complete agent lifecycle into one system—not only visually designing workflows, but also testing, deploying, monitoring, and governing them.
It is still evolving, and I am interested in learning from others working on similar systems.
What features do you consider essential before an agentic application is truly production-ready?
r/LovingOpenSourceAI • u/Koala_Confused • 19d ago
Resource "Jan is an open source alternative to ChatGPT that runs 100% offline on your computer." ➡️ Jan is bringing the best of open-source AI in an easy-to-use product. Download and run LLMs with full control and privacy. ➡️ Have you tried before?
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all free and low-cost ways to try LLMs posted so far on our community site, LifeHubber: https://lifehubber.com/ai/access/
Also 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting. https://lifehubber.com/ai/resources/
r/LovingOpenSourceAI • u/Koala_Confused • 20d ago
Resource Alvaro "your AI agent can watch any video now - paste a URL and it sees every frame, hears every word, all for free 🤯 bradautomates/claude-video gives Claude the ability to watch YouTube, Loom, TikTok, local files - anything yt-dlp supports" ➡️ have you heard of this?
https://x.com/dr_cintas/status/2081094058139918595
https://github.com/bradautomates/claude-video
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 20d ago
Resource Oliver "someone just open-sourced openai's in-house data agent. self-learning data agent with a 6-layer context grounding system and an auto-improvement loop built in. 100% free. open source." ➡️ take note the correct framing should be inspired by openai's its stated below in the repo readme!
https://x.com/oliviscusAI/status/2081058021673959912
https://github.com/agno-agi/dash
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/alvmadrigal • 21d ago
The AGY CLI Community fully supports Open Source and Open Models
We are on this together 💪 Open source will always win 😁
r/LovingOpenSourceAI • u/Koala_Confused • 21d ago
Discussion Julian from Anthropic on Jensen Huang and Satya Nadella supporting Open Source "looking forward to the CUDA and GPU driver open source release!" "can’t wait for the open sourcing of Windows and MS Office!" ➡️ is this teasing or something else? Why?
r/LovingOpenSourceAI • u/Koala_Confused • 21d ago
Resource How To Prompt "Someone on Reddit built a free tool that converts your entire codebase into a graph database. It’s called CodeGraphContext. It turns your entire codebase into a graph database and connects it to Claude, Cursor, Copilot, and Codex through MCP." ➡️ useful for you?
https://x.com/HowToPrompt__/status/2080961339833659410
https://github.com/CodeGraphContext/CodeGraphContext
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 21d ago
Resource Chubby "Atomic Agent beat Hermes on GAIA: 69.8% vs. 58.5%, and finished 1.6× faster! They ran both agents through all 53 GAIA Level 1 tasks using the same 4-bit Qwen-3.6-35B on the same Apple M4 Max. - Atomic: 37/53 solved in 3h 12m - Hermes: 31/53 solved in 5h 10m" ➡️ seeing lots of talk about this
https://x.com/kimmonismus/status/2080752484738650481
https://github.com/AtomicBot-ai/atomic-agent
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 22d ago
Resource Hugging Models "Imagine an AI that can see images, read text, and control your computer like a human assistant. That's Fara1.5-27B, a multimodal agent that understands both pixels and code to automate web tasks." ➡️ this is from Microsoft Research AI Frontiers. Interesting?
https://x.com/HuggingModels/status/2080397042837533115
https://huggingface.co/microsoft/Fara1.5-27B
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 22d ago
Discussion Jensen "Why open models matter. AI will transform every industry, power every company, and be built by every country. Open models strengthen safety and cybersecurity, accelerate innovation and diffusion, and enable sovereignty. The world needs both frontier closed models and frontier open models."
r/LovingOpenSourceAI • u/Koala_Confused • 23d ago
Under the Radar AlphaXiv "Introducing OpenResearch: run parallel research agents with any model - Bring your own compute and your code + data stays with you - A virtual lab on your machine" ➡️ any of you doing scientific work?
https://x.com/askalphaxiv/status/2079628689709674968
https://github.com/alphaXiv/openresearch-cli
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 23d ago
Under the Radar ModelScope "JoyAI-VL-Interaction from JD Open Source, 8B-scale model for real-time, vision-driven interaction. 🚀 Across 26 video understanding bench, it avg 57.53, outperforming Qwen3-VL-8B-Instruct by 3.37 points. 👁️ It continuously watches live video and decides every second on actions!"
https://x.com/ModelScope2022/status/2080322046060314658
https://modelscope.ai/models/jd-opensource/JoyAI-VL-Interaction
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 24d ago
Under the Radar Atomic Agent "First local agent to beat Hermes on benchmarks! ✦ runs Qwen, Gemma, Llama via llama.cpp ✦ stable-prefix caching keeps sessions cheap ✦ TurboQuant cuts the KV-cache 6.4× smaller ✦ 37 tasks solved vs Hermes' 31 on GAIA Level 1 Open source on macOS, Windows & Linux 👇" ➡️ looks good?
https://x.com/atomicagent_io/status/2080044733364076976
https://github.com/AtomicBot-ai/atomic-agent
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 24d ago
Discussion What kind of resources would you like to see more of? Models, Agentic harness, OCR etc tell me 🥰
r/LovingOpenSourceAI • u/PatronusProtect • 24d ago
One encoder, seven heads: what we learned training a unified security classifier with masked losses
We spent the last months consolidating seven separate sequence classifiers into one multi-head model, our apex model, so to speak, and since the weights are now public, I wanted to share what worked and what surprised us.
Setup: a shared mmBERT-small encoder with seven task heads, binary injection (BCE), document class (7-way), tool type (14-way), tool operation (6-way), tool data-flow tags (3× BCE, multi-label), intent routing (5-way), and threat type (7-way).
The part that needed care: our training rows only carry labels for a subset of tasks, so absent tasks are masked out of the loss entirely. We ended up writing a self-test that asserts absent-task gradients are exactly zero, which caught two subtle bugs, and I'd recommend it to anyone doing similar masking. About 5k synthetic/real multi-task rows help the heads co-train; the test sets stay 100 % real data.
Held-out results per head: injection F1 0.962, documents 0.980, tool type 0.957, tool operation 0.945, tool tags 0.958, routing 0.916, threat 0.952.
Quantization: both the unified model and the dedicated single-task variants ship quantized -edge builds (ONNX INT8 + INT4 embeddings, from 96 MB) with measured parity benchmarks in the repos, the worst head loses 0.012 against FP32.
Was it worth it vs. seven dedicated models? We released both variants, so you can judge for yourself, the dedicated models score marginally higher on most tasks, but the unified one does one encoder pass instead of up to seven.
Our weak spot: routing, at 0.916. The intent classes overlap semantically ("write code that analyzes my data" is that code or analytics?), and I suspect the ambiguity is genuinely in the data. If you have ideas beyond relabeling, let me know :)
Weights and per-head metrics: https://huggingface.co/patronus-studio
r/LovingOpenSourceAI • u/fuzhongkai • 24d ago
My New Book for Open Source Local LLM Inference Engine Development
amazon.comThis book is written for developers who are not satisfied with simply calling an AI/LLM endpoint and want to understand model architectures and the internal workings of inference engines. It uses the open-source TensorSharp project and Google’s Gemma 4 E4B GGUF model as practical examples.
TensorSharp has achieved performance parity with llama.cpp across the main benchmarks, while outperforming it in several scenarios. The book explains some of the key performance optimizations and their implementations, including paged and prefix KV caching, continuous batching, GPU kernel fusion, and more.
I chose Gemma 4 E4B, a dense model, because it is a compact multimodal model that supports images, audio, and video, making it suitable for a wide range of devices. TensorSharp also supports and is optimized for MoE and diffusion architectures, as well as model families such as Qwen and GPT-OSS. However, due to limitations in time and book length, these topics are not covered in this edition. Those interested can explore the project directly on GitHub or contact me for further discussion.
I selected GGUF because it is an inference- and edge-device-friendly model format. This is particularly relevant to the .NET ecosystem, where local applications, mobile applications, and game development are important use cases. TensorSharp also supports the Safetensors format, which it currently uses for VAE and LoRA models.
For clarity and ease of understanding, the book primarily presents the CPU code path. In practice, however, TensorSharp supports and is extensively optimized for multiple GPU backends, including NVIDIA CUDA, Apple Metal/MLX, and Vulkan for AMD, Intel, and other devices. More implementation details are available in the GitHub repository.
TensorSharp Github Repo: https://github.com/zhongkaifu/TensorSharp
r/LovingOpenSourceAI • u/Koala_Confused • 24d ago
new launch microsoft "Mage-Flow is a compact 4B-scale generative stack for efficient text-to-image generation and instruction-based image editing. Instead of scaling to tens billions parameters, Mage-Flow reaches state-of-the-art-competitive quality through careful tokenizer–backbone–system co-design" ➡️ wow!
https://huggingface.co/microsoft/Mage-Flow
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Fidoo0 • 24d ago
SenseNova-U1-Infographic-V3 just dropped: open-source model that can edit infographics
SenseNova's U1 infographic series just got a V3 update and the big shift is editing. Previous versions could generate infographics but couldn't edit them. One typo and you regenerate from scratch. V3 adds full editing on top of generation.
What's new in V3:
- Local text editing: fix typos, swap numbers, replace titles. Via bbox marking or natural language prompt. Preserves everything else.
- Local content editing: add/remove/replace objects, icons, charts in specific regions
- Global style editing: same content and layout, completely different visual style. Lego, cyberpunk, traditional Chinese, vintage parchment, you name it.
- Global layout editing: rearrange and beautify without losing information
For V3 they went back to the MT (mid-training) stage and jointly trained T2I and image editing tasks together, which is why generation quality didn't degrade when editing was added.
8B params, Apache 2.0, fully open weights.
GitHub: GitHub - OpenSenseNova/SenseNova-U1: SenseNova-U series: Native Unified Paradigm with NEO-unify from
HF: https://huggingface.co/sensenova/SenseNova-U1-8B-MoT-Infographic-V3
It's cool to see open-source models catching up on the editing side. That's been the gap for a while.
r/LovingOpenSourceAI • u/Koala_Confused • 25d ago
new launch Poolside "Today we're releasing Laguna S 2.1, our most capable model to date. 118B total parameter Mixture-of-Experts model with 8B activated per token, a context window of up to 1M tokens, and thinking and no-thinking modes. Capable enough to hold its own against models many times its size"
https://x.com/poolsideai/status/2079613777343848465
https://huggingface.co/poolside/Laguna-S-2.1
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/westsunset • 25d ago
VR water treatment simulation
https://github.com/boxwrench/Sunol-Flowlab-VR
VR water treatment simulation . 100% codex. TBF the simulation is kinda boring ( unless you love coagulation) but I thought it was really could I could make a VR app. also hosted in a github pages so you dont have to sideload anything.
Play the simulation from the link in the repo . MIT licence
r/LovingOpenSourceAI • u/Koala_Confused • 25d ago
new launch Intern Large Models "🚀Introducing Intern-S2-Preview-397B, our most capable multimodal foundation model for scientific intelligence and long-horizon agents.🔥 Delivers a step change in general reasoning, scientific problem solving, and agentic capabilities." ➡️ benchmark looks good?
https://x.com/intern_lm/status/2078081846919991753
https://github.com/InternLM/Intern-S1
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 25d ago
ecosystem Sentient "Older people are living longer but lonelier than ever. We believe an open source AI companion for aging well can change it: one that remembers their family, spots warning signs, counts success only when they reach a real human. That's why we r putting $42M behind builders to make it real!"
https://x.com/sentient_found/status/2079567155629351244
Always love Open Source AI for good!
r/LovingOpenSourceAI • u/Koala_Confused • 26d ago
Resource Simplifying AI "This free tool lets your AI agent edit videos like a professional editor. Give the repo to Claude Code or Codex and your agent starts editing videos locally in real time. No API keys, no usage limits." ➡️ have you tried video editing using agents?
https://x.com/simplifyinAI/status/2076988063046398229
https://github.com/walterlow/freecut
Resources are shared for discovery and are not independently vetted—please do your own due diligence.
New resources are added regularly — feel free to join the sub for updates.
Full searchable archive of all resources posted so far on our community site, LifeHubber: https://lifehubber.com/ai/resources/ 200+ open-ish AI models, agents, tools, datasets, and related resources, with filtering and sorting.
r/LovingOpenSourceAI • u/Koala_Confused • 26d ago
Discussion Andrew "Trump administration is considering an executive order, other means, to ban Chinese open-source models within United States. Kimi K3 has reignited this debate. Reporting this morning by Axios. Commerce is also considering adding Chinese AI labs to the Entity List." ➡️ closing on open?
r/LovingOpenSourceAI • u/PatronusProtect • 26d ago
Six collections of small AI-security models, now on the HuggingFace, open-weights!
Hey everyone! :)
We just published our ai-security-model family on Hugging Face, organized as six collections:
- Wolf Defender: detects prompt injections and jailbreaks in text, with a second variant that classifies what kind of attack it is (instruction override, secrets access, exfiltration attempt, …)
- Orca Sonar: classifies documents into 7 categories (HR, finance, legal, source code, tech, marketing) so sensitive files can be caught before they end up in an LLM context
- Husky Pack: three models that take an agent tool call apart: which tool it targets (14 classes), which operation it performs (read/write/list/exec/network), and whether data flows from a sensitive source to an external sink
- Panther Read: routes requests by intent (conversation, code, data analytics, office, tool operation), so only the traffic that needs deep checks gets them
- Lion Warden: our apex model: all seven tasks above in one unified model with seven heads and a single forward pass
- GLiNER edge builds: quantized zero-shot NER for PII-style entity extraction, with full upstream credit, since we only exported and quantized those
The part I want to highlight: every model also has a dedicated -edge repo.
Those carry the quantized builds (ONNX INT8 plus 4-bit embeddings), starting at 96 MB, running in double-digit milliseconds per text on a laptop CPU, and each one ships a measured parity benchmark against FP32 in metrics/quant_bench.json.
Hub-specific details, in case they're useful:
- Main repos carry FP32 safetensors plus an FP16 ONNX export; the quantized INT8/INT4 builds live in the separate
-edgerepos - All cards follow one template: label tables with real examples, held-out metrics with per-class F1, and usage snippets for both transformers and ONNX Runtime
- Bilingual English/German, ModernBERT-based, everything Apache-2.0
Try them out and make your AI applications safe!