This Repository is my implementation for Andrej Karpathy's Neural Networks: Zero to Hero playlist.
I followed the original code in videos, with some modifications and more comments to help me understand the code, you may find it useful too.
| Notebook | Exercise | Original Notebook (made in video) | |
|---|---|---|---|
| Micrograd | Micrograd Notebook | Micrograd Exercises | Micograd Original Notebook |
| Makemore | Bigrams | Bigrams Exercises | Bigrams Original Notebook |
| Makemore | MLP | MLP Exercises | MLP Original Notebook |
| Makemore | BatchNorm | BatchNorm Exercises | BatchNorm Original Notebook |
| Makemore | BackProp | - | BackProp Original Notebook |
| Makemore | Wavenet | Wavenet Exercises | Wavenet Original Notebook |
| NanoGPT | NanoGPT | NanoGPT Exercises | minbpe Original Notebook |
| Minbpe | Minbpe | - | Minbpe Original Notebook |
| GPT2 | GPT2 Folder | - | build gpt Original Repo |
- micrograd Repository
- makemore Repository
- nanoGPT Repository
- build nanogpt Repository
- minbpe Repository
other resources and papers links are in the repositories.