GitBross Startsida Utforska Hjälp
Registrera dig Logga in
sol_87yf6cwp
/
LLMs-from-scratch
spegling av https://github.com/br8bit/LLMs-from-scratch.git
1
0
Fork 0
Filer Ärenden 0 Wiki
Gren: main
Grenar Taggar
LLMs-from-scrat...
/
ch04
/
01_main-chapter-code
Sebastian Raschka c21bfe4a23 Add PyPI package (#576) 8 månader sedan
..
README.md 283397aaf2 add main and optional sections 1 år sedan
ch04.ipynb c21bfe4a23 Add PyPI package (#576) 8 månader sedan
exercise-solutions.ipynb a08d7aaa84 Uv workflow improvements (#531) 9 månader sedan
gpt.py bbb2a0c3d5 fixed num_workers (#229) 1 år sedan
previous_chapters.py bbb2a0c3d5 fixed num_workers (#229) 1 år sedan
tests.py a2cd8436cb Ch05 supplementary code (#81) 1 år sedan

README.md

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Main Chapter Code

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter