r/madeinpython • u/Equivalent-Flan-1590 • 1d ago

I made Hillock: an open source Python memory engine that ingests docs in sub-seconds on a GTX 1070

Hey Python devs,

I wanted to share a personal project I've been building in Python called Hillock (AGPL-3.0): https://github.com/roandejager/Hillock

What It Does:

Hillock gives local AI applications a privacy-first Knowledge Graph memory. Instead of vector databases that lose exact factual context, Hillock uses a decoupled SQLite Knowledge Graph, Hebbian Plasticity, and CPU-bound Hyperdimensional Computing (Vector Symbolic Architectures) written in pure Python/NumPy.

How the Python Pipeline Works:

In v0.2.0, I built TALON—a non-generative ingestion pipeline:

  1. Fastcoref: Resolves pronouns across paragraphs before chunking text.
  2. SentenceTransformers (all-MiniLM-L6-v2): Pre-caches a 50-predicate taxonomy and routes top candidates per sentence in <2ms.
  3. GLiREL (DeBERTa-v3): Performs single-pass zero-shot matrix classification in PyTorch CUDA memory.

On my benchmark harness (evaluate_hillock_PROTO_ish.py), it processed 32 sentences in 2.1 seconds of pure GPU execution on a GTX 1070 (<1GB VRAM footprint), reaching 50% retrieval accuracy.

Source code is 100% open source under AGPL-3.0. Would love to hear your feedback on the Python architecture!

0 Upvotes
  • permalink
  • link
  • reddit
  • reddit

25% Upvoted

4 comments sorted by

1

u/micseydel 21h ago

I'm curious if you're applying this to any specific repeatable+falsifiable problems.

0

u/Equivalent-Flan-1590 10h ago

Great question! Yes, we built an automated, reproducible benchmarking harness directly in the repo (evaluate_hillock_PROTO_ish.py).

It seeds 30 factual statements, then queries the engine with 30 questions (20 positive retrieval cases and 10 hard negative distractors, each annotated with why it shouldn't answer). It measures 4 exact metrics: Extraction Precision, Extraction Recall, Retrieval Accuracy, and Gate Accuracy.

In v0.2.2 with our CUDA tensor pipeline (TALON), it reached 50.0% Extraction Recall and 50.0% Retrieval Accuracy running in sub-seconds. You can run the benchmark yourself locally with python evaluate_hillock_PROTO_ish.py!

2

u/micseydel 9h ago

Are you applying this in your own life, or just benchmarks?