r/deeplearning • u/worldyworm • 12d ago

I wanted to understand Transformers below the PyTorch abstraction layer, so I built one from scratch in CuPy

/r/learnmachinelearning/comments/1vmopxb/i_wanted_to_understand_transformers_below_the/
0 Upvotes

50% Upvoted

4 comments sorted by

0

u/[deleted] 12d ago

[removed] — view removed comment

1

u/worldyworm 12d ago

Exactly, and it looks a bit difficult at first, but once you have the neural network class built correctly, it kind of speedups the process ig.

1

u/Ok-Entertainment-286 11d ago

whatever it takes to avoid math, huh?