Large Language Models from Scratch

Details will follow ...

Table of Contents

Chapter	Main code	Code + supplementary
Ch 1: Understanding Large Language Models	No code	No code
Ch 2: Working with Text Data	ch02.ipynb dataloader.ipynb	./ch02
Ch 3: Understanding Attention Mechanisms	ch03.ipynb multihead-attention.ipynb	./ch03
...	...	...
Appendix A: Introduction to PyTorch	code-part1.ipynb code-part2.ipynb DDP-script.py	./appendix-A