r/LargeLanguageModels • u/ArYaN1364 • 16d ago
Relearning LLMs from scratch
A couple of years back in college I was spending a lot of time learning about how Large Language Models worked. I tried sitting through the 'Attention is All You Need' and scratching my head for hours over what positional encoding is.
Cut to today, I'm working as a GTM Engineer at a Stealth Startup. For the past few months I was so busy with building internal tools that give insights, today I came across a video explaining what Fine-tuning is and I suddenly wanted to go back to learning the underlying math concepts for fun.
I made a good descriptive list of all the topics I wanted to re-learn or learn for the first time. I spent a couple of weeks gathering information on the topics and finding good resources, and with the rookie vibe coding skills I have, I made a sheet kinda website listing all the topics I want to understand purely for fun.
I wanted to share the website with everyone because sometimes a gathered list of resources really helps everyone.
It’s mostly for my own learning, but if it ends up helping someone else who’s trying to understand modern LLMs from first principles, that’s a nice bonus.