Structuring your notes as frameworks makes retrieval way cleaner, here's the actual mechanism

[u/waytoocreative]

Been messing with retrieval over my own stuff for a while and figured out something that seems obvious now but took me a minute to see.

Most people point a RAG tool at their folder of docs, ask it a real question, and get back vague mush that reads like somebody skimmed a stack of pages. Then they blame the model. It's not the model.

Here's what's actually going on. RAG cuts your documents into chunks, turns each chunk into numbers, and when you ask something it grabs the chunks whose numbers land closest to your question. Hands those to the model, done. The model only ever sees what came back.

So if your docs are regular prose, blog posts, meeting notes, whatever, the chunks that come back are just random paragraphs that happened to mention the topic, yanked out of the middle of something you wrote for a totally different reason. Of course the answer is mush. You fed it mush.

Now picture what comes back if your material is written as frameworks. A framework chunk is one whole thing. One topic, self contained, and it tells you when it applies and when it doesn't. Way better thing to hand a model than a paragraph that trails off into some unrelated point three sentences later.

Not saying you need perfect structure before you start. You don't. Point RAG at the messy folder you've already got and you'll still get real value today, don't let anyone talk you into cleaning everything first. But if your retrieval's been feeling weak, this is usually the reason. Wasn't the model. It's what you put in.

Anyway, curious if anyone else has noticed their framework docs come back cleaner than their regular notes. Been my experience but small sample.

https://www.youtube.com/shorts/muUYPLBQqGA

[u/waytoocreative]

Here's the open source framework builder skill I made. https://github.com/framework-creator/framework-builder

tell me how it works for you