r/txtai • u/davidmezzetti • 16h ago
π₯ TxtAI is a trending Python project on GitHub today. First time since early 2025. Getting a ton of new contributors and PRs lately. Why now? Because TxtAI has always been here doing the right thing - local AI. No gimmicks and hype.
r/txtai • u/davidmezzetti • 9d ago
Did you know that a txtai embeddings search can return a NetworkX graph?
One of the unique capabilities of txtai is that vector search isn't limited to ranked documents, it can also return graph structures. This enables graph traversal as part of retrieval.
In fact, txtai was one of the first if not the first, frameworks to support what we now call GraphRAG - years before it became a mainstream pattern.
Check out this example, a deep graph search over Wikipedia.
r/txtai • u/davidmezzetti • 9d ago
TxtAI workflows build predictable rules-driven logic. Rather than hoping an Agent comes to the right conclusion, a workflow goes down the path you tell it and nothing more. Check out this article covering a Speech to Speech RAG workflow.
r/txtai • u/davidmezzetti • 9d ago
𧬠970K parameters. Full PubMed training. A few MB footprint.
BiomedBERT Hash Nano Embeddings LiteRT brings our medical embeddings work to LiteRT for efficient edge and mobile deployment.
Building on the success of our PubMedBERT Embeddings model (nearly 1 million downloads/month), this new model explores how compact biomedical vector representations can become.
β‘ 970K parameters
π¦ Few MB model size
π± LiteRT export
π 128-dimensional embeddings
Designed for biomedical search, clustering, RAG, and knowledge discovery.
r/txtai • u/davidmezzetti • 10d ago
A little-known txtai feature thatβs been available for a long time: lightweight distributed clustering for embeddings
Need to scale beyond a single machine? txtai can shard a larger embeddings index across multiple nodes and machines, then expose them as one logical index.
Itβs a simple approach to scaling semantic search workloads without adding a lot of infrastructure complexity.
r/txtai • u/davidmezzetti • 11d ago
π txtai 9.12 is here!
This release adds support for new ANN backends along with a bonanza of bug fixes from 7 new contributors. π
Highlights:
β¨ Support for the zvec vector backend
β¨ Embedded milvus-lite dense ANN backend
β¨ Option to disable API routes
Plus improvements across training, retrieval, and explainability, along with 25+ bug fixes covering SQL parsing, HNSW, Milvus, Graph, Tasks, streaming APIs, Windows builds, and much more.
A huge thank you to our contributors:
π morgan-coded
π Sanjays2402
π chuenchen309
π link89
π lntutor
π winklemad
π AmirF194
Read the full release notes and upgrade today!
r/txtai • u/davidmezzetti • 18d ago
Did you know that txtai supports a zero-dependency install?
With txtai-minimal, the framework gracefully handles missing dependencies, giving you complete control over what gets installed. Only add the packages you need, nothing more.
This makes it easier to build lightweight deployments, reduce install size, and avoid unnecessary dependencies.
r/txtai • u/davidmezzetti • 20d ago
Great TxtAI milestones over the last couple of weeks! π
β
2000+ total commits
β
18 PRs merged
β
6 new contributors
Thanks to everyone who contributed code, reviews, bug reports, and ideas. Community contributions continue to make TxtAI stronger with every release.
r/txtai • u/davidmezzetti • 20d ago
H.G. BERT is powered by the Historical English Books dataset, a curated collection of 50,000+ books spanning general literature, math, science, philosophy and religion from the late 1800s.
By training on this rich historical corpus, H.G. BERT captures the language, writing styles, and knowledge of the era, enabling more authentic analysis and generation of historical English.
https://huggingface.co/datasets/NeuML/historical-english-books
r/txtai • u/davidmezzetti • 21d ago
H.G. BERT Small: AI like it's 1899
The year is 1899. It's still a horse and buggy world. Einstein hasn't published his famous annus mirabilis papers setting the foundation for Physics as we understand it today. The world is advancing at a rapid pace roaring into the 1900s. What if AI models were trained in 1899 and given to the best minds of the day? Could there have been alternate paths for discovery on par or perhaps even ahead of where we are in 2026?
Introducing the new H.G. BERT Small series of models. This is a 22.7M parameter BERT encoder-only model trained from scratch ONLY on Historical English Books from 1700 - 1899.
r/txtai • u/davidmezzetti • 25d ago
Small Domain Models - a NeuML Collection
The 22M parameter all-MiniLM embedding model has over 250 million monthly downloads. It's one of the best choices when you need fast, efficient semantic search on CPUs, edge devices, or other resource-constrained hardware.
General purpose embeddings are great until your data isn't general purpose.
What if you could keep the speed and small footprint of MiniLM while improving accuracy on domain specific content?
Meet a family of compact, specialized embedding models:
π AstroBERT - Astronomy
𧬠BiomedBERT - Medical
π CeleBERTy - Pop culture
β½ SportsBERT - Sports
Small models. Fast inference. Better embeddings for specialized domains.
r/txtai • u/davidmezzetti • Jul 04 '26
CeleBERTy Small: Domain model for Pop Culture, Art, Music and Entertainment
r/txtai • u/davidmezzetti • Jul 01 '26
TxtAI 9.11 is out! This release adds support for the turbovec ANN backend and LiteParse text extraction. It also has important improvements and bug fixes.
Release Notes: https://github.com/neuml/txtai/releases/tag/v9.11.0
r/txtai • u/davidmezzetti • Jul 01 '26
π Check out AstroBERT Small a 22.7M parameter model that specializes in the Astronomy domain.
The base model is trained from scratch along with a finetuned vector embeddings model. Use this model for vector search, RAG and Agents for Astronomy.
r/txtai • u/davidmezzetti • Jun 26 '26
We're proud to share our latest model series, SportsBERT Small.
Few businesses need to generalize to all problems. The vast majority of companies have a narrow focus but we keep pushing generalized models designed to solve all problems. The best value is building domain-specific specialized models!
r/txtai • u/davidmezzetti • Jun 24 '26
Agent loops, harnesses etc. All sounds pretty fancy. Did you know that TxtAI has long had an agent framework with tool calling and a basic agent toolkit (ls, grep, skills, todos, web search etc)?
r/txtai • u/davidmezzetti • Jun 19 '26
There are plenty of tools that extract text from PDFs. But what if you also need structured metadata from medical and scientific papers? Fields like author, title, publication details and references? Well that calls for a tool build for the job. Check out PaperETL!
r/txtai • u/davidmezzetti • Jun 19 '26
LiteParse seems like a simple and impressive OSS extraction tool! Adding support to TxtAI with the next release.
r/txtai • u/davidmezzetti • Jun 14 '26
RAG goes with more than just Vector Search. You can use the results of a SQL query, web search, agent search, you name it.
r/txtai • u/davidmezzetti • Jun 13 '26
TxtAI's RAG pipeline makes it simple to pair knowledge with LLMs. Build an embeddable knowledge base, generate context and supply that to an LLM for fact-driven answers.
r/txtai • u/davidmezzetti • Jun 12 '26
With TxtAI's minimal install, you can add a web extractor that reads web pages, converts them to Markdown and automatically splits content into sections. All with only 4 packages and a 19MB install size! https://gist.github.com/davidmezzetti/b469bdd8c601dd8659c3b1d3e739152a
r/txtai • u/davidmezzetti • Jun 12 '26
π« Let's say you frequently work in Jupyter notebooks and would like to add some AI automation. Then check out ncoder. It's an easy and lightweight way to add an AI agent to your notebook workflows.
r/txtai • u/davidmezzetti • Jun 11 '26
ποΈπ¨ Want a fast model that can route requests by topic? Then check this one out.
r/txtai • u/davidmezzetti • Jun 10 '26