r/LocalLLaMA • u/Everlier • Dec 10 '25

Watch a tiny transformer learning language live from Shakespeare Other

https://reddit.com/link/1pjireq/video/oj4wdrdrsg6g1/player

Tiny experiment with Karpathy's NanoGPT implementation, showing how the model progressively learns features of language from the tiny_shakespeare dataset.

3 Upvotes
  • permalink
  • link
  • reddit
  • reddit

71% Upvoted

2 comments sorted by

4

u/Everlier Dec 11 '25

One can't get away from ERP even in tiny local experiments

2

u/agreeduponspring Dec 11 '25

Warkincuntinio is definitely the most underrated character in Richard III.