GitBross Etusivu Tutki Apua
Rekisteröidy Kirjaudu sisään
sol_87yf6cwp
/
LLMs-from-scratch
peilaus alkaen https://github.com/br8bit/LLMs-from-scratch.git
1
0
Haarauta 0
Tiedostot Esitykset 0 Wiki
Haara: main
Haarat Tunnisteet
LLMs-from-scrat...
/
ch05
/
05_bonus_hparam_tuning
Sebastian Raschka 8b3e4b24b0 Remove unused params for hparam script (#710) 4 kuukautta sitten
..
README.md e757091301 Organized setup instructions (#115) 1 vuosi sitten
hparam_search.py 8b3e4b24b0 Remove unused params for hparam script (#710) 4 kuukautta sitten
the-verdict.txt cf39abac04 Add and link bonus material (#84) 1 vuosi sitten

README.md

Optimizing Hyperparameters for Pretraining

The hparam_search.py script, based on the extended training function in Appendix D: Adding Bells and Whistles to the Training Loop, is designed to find optimal hyperparameters via grid search.

[!NOTE] This script will take a long time to run. You may want to reduce the number of hyperparameter configurations explored in the HPARAM_GRID dictionary at the top.