GitBross Inicio Explorar Ayuda
Registro Iniciar sesión
sol_87yf6cwp
/
LLMs-from-scratch
espejo de https://github.com/br8bit/LLMs-from-scratch.git
1
0
Fork 0
Archivos Incidencias 0 Wiki
Rama: main
Ramas Etiquetas
LLMs-from-scrat...
/
ch04
/
01_main-chapter-code
Sebastian Raschka c21bfe4a23 Add PyPI package (#576) hace 8 meses
..
README.md 283397aaf2 add main and optional sections hace 1 año
ch04.ipynb c21bfe4a23 Add PyPI package (#576) hace 8 meses
exercise-solutions.ipynb a08d7aaa84 Uv workflow improvements (#531) hace 9 meses
gpt.py bbb2a0c3d5 fixed num_workers (#229) hace 1 año
previous_chapters.py bbb2a0c3d5 fixed num_workers (#229) hace 1 año
tests.py a2cd8436cb Ch05 supplementary code (#81) hace 1 año

README.md

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Main Chapter Code

  • ch04.ipynb contains all the code as it appears in the chapter
  • previous_chapters.py is a Python module that contains the MultiHeadAttention module from the previous chapter, which we import in ch04.ipynb to create the GPT model

Optional Code

  • gpt.py is a standalone Python script file with the code that we implemented thus far, including the GPT model we coded in this chapter