This is pretty cool. There are good video lectures around for much of the transformer parts (the huggingface stuff, other ml youtubers, etc) but deep dive stuff like this is appreciated.

It's worth noting the actual videos are just unlisted youtube links so you can add them to playlists.