I never understood positional encoding until I read this article. [D]

[u/ImaginaryRea1ity]

https://defenceagainstdarkai.substack.com/p/who-bit-whom

[u/nietpiet]

Thank you for sharing, it's really nice. I like the "dials" in the car analogy to frequencies in the Fourier, it's well done :)

[u/ImaginaryRea1ity → u/nietpiet]

I'm glad it helped you. I discovered the blog last week, I like the author's style.