mirror of
https://github.com/rasbt/LLMs-from-scratch.git
synced 2026-04-10 12:33:42 +00:00
9b95557ba2
* typo fixed * only update plot --------- Co-authored-by: rasbt <mail@sebastianraschka.com>
Chapter 7: Finetuning to Follow Instructions
-
create-preference-data-ollama.ipynb: A notebook that creates a synthetic dataset for preference finetuning dataset using Llama 3.1 and Ollama
-
dpo-from-scratch.ipynb: This notebook implements Direct Preference Optimization (DPO) for LLM alignment