Files
LLMs-from-scratch/ch04/01_main-chapter-code
Sebastian Raschka 2d600ccb5b Use correct input in layernorm example (#960)
* Update CI

* Use correct example in layernorm section

* update
2026-02-18 21:35:57 -06:00
..
2024-06-19 17:36:46 -05:00
2024-06-19 17:48:25 -05:00
2025-10-21 19:42:33 -05:00

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Main Chapter Code

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter