Study Notes on Transformers and Hamiltonian Monte Carlo [P]

I’m sharing my study notes in case they might be useful to someone else. The Transformer notes are mostly based on the original architecture described in Attention Is All You Need. https://doi.org/10.5281/zenodo.22031925 I’ve also written notes on Hamiltonian Monte Carlo (HMC). https://doi.org/10.5281/zenodo.21841086 I’d appreciate any feedback on the notes, including corrections, suggestions for improvement, or topics you think I should add. submitted by /u/aybehrouz [link] [comments]