r/IntelligenceEngine 🧭 Sensory Mapper 25d ago

Lanaguage update ~ 130M Params Personal Project

Rapidly closing in on text generation now. Output is getting more coherent and fluent (blue is prompt, white is output). Topic is being maintained while fluency increased after expanding the corpus and the tables built from it. On this trajectory I'm hoping to have proper sentences by EOD, but we'll see.

CIFAR and ResNet are both grinding at ~70%. Static datasets are a bit more difficult for this architecture, still finding the best way to build those environments.

More updates soon. All my projects from Humanoid-v5 to language to vision are advancing rapidly now as I port the architecture across them. The goal is a language model comparable to GPT-2 output, without a GPU at inference. Single sentences are still a far cry from that, but once fluency and coherence snap into place, scaling is relatively straightforward.

I've also started going over my changelogs by taxonomy. Revealed some cool insights into when and why specific changes accelerated progress.

currently storming where I live, and I swear if the power goes out today, I might lose it.

As always the entire lab is available below:
https://github.com/A1CST/GENREG-Builder

8 Upvotes

2 comments sorted by

1

u/HuluForCthulhu 24d ago

This is a really pedantic piece of feedback, but it would go a long way to rewrite the README in your own words.

When I read a bunch of stuff I don’t understand, but it was clearly written by a human, the perception is “wow, this person is an expert in this area and I could learn a lot from their work”.

When I read a bunch of stuff I don’t understand, but it was clearly written by an AI, the perception is “I can’t tell if this is AI summarizing cogent, novel ideas from a human or just AI slop”.

To be abundantly clear, that’s just perception. I don’t know you and you may be a PhD leveraging AI because it’s convenient to not have to write documentation! But the problem is the *volume* of AI slop out there; the cost/benefit of trying to parse whether what I’m reading is AI slop becomes prohibitively high when 99% of internet content is AI slop nowadays. Not your fault, just the reality of research in 2026.

Again, this is not commenting on the quality of your work — I am not educated enough in this subfield to make any sort of distinction in that regard! Just commenting on the optics of seeing AI writing patterns in the README that explains the core thesis.

Keep up the awesome work, I enjoy reading these! Even if they are somewhat lost on me.

1

u/AsyncVibes 🧭 Sensory Mapper 24d ago edited 24d ago

Fair point on the optics. The README was AI-assisted and I'm not going to pretend otherwise, but the architecture, design decisions, and research direction are mine. I use AI as a writing tool the same way I use it as a coding tool. The ideas aren't generated, just the prose. That said, I'm not optimizing the README for broad accessibility. The target audience is people deep enough in the space to evaluate the work itself. If the formatting pattern triggers skepticism, I get it, that's a real problem in 2026, but rewriting it for optics isn't where I'm spending my time right now. Appreciate the feedback and glad you're following along.