> For the complete documentation index, see [llms.txt](https://ai.nuhil.net/llms.txt). Markdown versions of documentation pages are available by appending `.md` to page URLs; this page is available as [Markdown](https://ai.nuhil.net/natural-language-processing/transformers/implementation.md).

# Implementation

## Transformer Implementation from Scratch with PyTorch

{% embed url="<https://www.youtube.com/watch?v=f7TnuO02DjM>" %}

## Build GPT from Scratch

{% embed url="<https://www.youtube.com/watch?v=kCc8FmEb1nY>" %}

##