GitBross Startseite Erkunden Hilfe
Registrieren Anmelden
sol_87yf6cwp
/
LLMs-from-scratch
Mirror von https://github.com/br8bit/LLMs-from-scratch.git
1
0
Fork 0
Dateien Issues 0 Wiki
Branch: main
Branches Tags
LLMs-from-scrat...
/
ch04
/
01_main-chapter-code
Sebastian Raschka c21bfe4a23 Add PyPI package (#576) vor 8 Monaten
..
README.md 283397aaf2 add main and optional sections vor 1 Jahr
ch04.ipynb c21bfe4a23 Add PyPI package (#576) vor 8 Monaten
exercise-solutions.ipynb a08d7aaa84 Uv workflow improvements (#531) vor 9 Monaten
gpt.py bbb2a0c3d5 fixed num_workers (#229) vor 1 Jahr
previous_chapters.py bbb2a0c3d5 fixed num_workers (#229) vor 1 Jahr
tests.py a2cd8436cb Ch05 supplementary code (#81) vor 1 Jahr

README.md

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Main Chapter Code

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter