Code completion with transformers

- https://arxiv.org/pdf/2402.16197

- https://arxiv.org/pdf/2202.13169

Transformer big idea:

- https://jalammar.github.io/illustrated-transformer/

Transformers: more granular

- https://github.com/sgrvinod/a-PyTorch-Tutorial-to-Transformers

Transformers implementation:

- https://github.com/hyunwoongko/transformer

- https://github.com/tunz/transformer-pytorch

  - This one is good because code is short and readable. Files are split up but not over-compartmentalized.

- Picture: https://miro.medium.com/v2/resize:fit:975/1*vrSX_Ku3EmGPyqF_E-2_Vg.png
- Also: https://cdn.prod.website-files.com/62528d398a42420e66390ef9/65cd0d82d6983755c129822a_Untitled.png