rasbt 98d453b666 update formatting 1 年之前
..
README.md e5e6aaf9f1 flops analysis 1 年之前
ch04.ipynb 98d453b666 update formatting 1 年之前
exercise-solutions.ipynb 98d453b666 update formatting 1 年之前
gpt.py 97ed38116a Rename drop_resid to drop_shortcut (#136) 1 年之前
previous_chapters.py dd51d4ad83 Make datesets and loaders compatible with multiprocessing (#118) 1 年之前
tests.py a2cd8436cb Ch05 supplementary code (#81) 1 年之前

README.md

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model
  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter