LLMs-from-scratch/ch07/05_dataset-generation

Generating Datasets for Instruction Finetuning

This folder contains utility code that can be used for generating a dataset for instruction finetuning.

• llama3-ollama.ipynb: A notebook that creates a synthetic instruction finetuning dataset using Llama 3 and Ollama

• reflection-gpt4.ipynb: A notebook that implements an instruction dataset refinement step based on reflection-tuning