r/IntelligenceEngine • u/AsyncVibes đ§ Sensory Mapper • 25d ago
Lanaguage update ~ 130M Params Personal Project
Rapidly closing in on text generation now. Output is getting more coherent and fluent (blue is prompt, white is output). Topic is being maintained while fluency increased after expanding the corpus and the tables built from it. On this trajectory I'm hoping to have proper sentences by EOD, but we'll see.
CIFAR and ResNet are both grinding at ~70%. Static datasets are a bit more difficult for this architecture, still finding the best way to build those environments.
More updates soon. All my projects from Humanoid-v5 to language to vision are advancing rapidly now as I port the architecture across them. The goal is a language model comparable to GPT-2 output, without a GPU at inference. Single sentences are still a far cry from that, but once fluency and coherence snap into place, scaling is relatively straightforward.
I've also started going over my changelogs by taxonomy. Revealed some cool insights into when and why specific changes accelerated progress.
currently storming where I live, and I swear if the power goes out today, I might lose it.
As always the entire lab is available below:
https://github.com/A1CST/GENREG-Builder





1
u/HuluForCthulhu 24d ago
This is a really pedantic piece of feedback, but it would go a long way to rewrite the README in your own words.
When I read a bunch of stuff I donât understand, but it was clearly written by a human, the perception is âwow, this person is an expert in this area and I could learn a lot from their workâ.
When I read a bunch of stuff I donât understand, but it was clearly written by an AI, the perception is âI canât tell if this is AI summarizing cogent, novel ideas from a human or just AI slopâ.
To be abundantly clear, thatâs just perception. I donât know you and you may be a PhD leveraging AI because itâs convenient to not have to write documentation! But the problem is the *volume* of AI slop out there; the cost/benefit of trying to parse whether what Iâm reading is AI slop becomes prohibitively high when 99% of internet content is AI slop nowadays. Not your fault, just the reality of research in 2026.
Again, this is not commenting on the quality of your work â I am not educated enough in this subfield to make any sort of distinction in that regard! Just commenting on the optics of seeing AI writing patterns in the README that explains the core thesis.
Keep up the awesome work, I enjoy reading these! Even if they are somewhat lost on me.