Daniel Kleine dce46038da add GPT2TokenizerFast to BPE comparison (#498) 10 months ago
..
gpt2_model ca96abac8a Set up basic test gh worklows (#79) 1 year ago
README.md e827b42e1e add readme files 2 years ago
bpe_openai_gpt2.py a2cd8436cb Ch05 supplementary code (#81) 1 year ago
compare-bpe-tiktoken.ipynb dce46038da add GPT2TokenizerFast to BPE comparison (#498) 10 months ago
requirements-extra.txt f526a8d7fb add requirements file for bonus notebook 1 year ago

README.md

Chapter 2: Working with Text Data