Commit Graph

131 Commits

Author SHA1 Message Date
rasbt
60aada801b improve latex rendering in dpo notebook 2024-08-04 09:19:59 -05:00
Sebastian Raschka
52435804eb Direct Preference Optimization from scratch (#294) 2024-08-04 08:57:36 -05:00
rasbt
a7869ad2bf Fix 8-billion-parameter spelling 2024-07-28 10:48:56 -05:00
Daniel Kleine
9a3b04f92f fixed typos and formatting (#291) 2024-07-28 10:04:33 -05:00
rasbt
9eb2e2a5f6 update figure caption 2024-07-27 13:30:18 -05:00
rasbt
c87e4364b7 formatting 2024-07-27 09:51:24 -05:00
Sebastian Raschka
99af403b9f Generate preference dataset with Llama 3.1 70B (#289) 2024-07-27 09:44:04 -05:00
Sebastian Raschka
08040f024c Test code in pytorch 2.4 (#285)
* test code in pytorch 2.4

* update
2024-07-24 21:53:41 -05:00
rasbt
46fcde15d8 use utf-8 encoding in json 2024-07-22 07:01:54 -05:00
Sebastian Raschka
8d02cb1cee Add download help message (#274) 2024-07-19 08:29:29 -05:00
rasbt
be14f06442 explain extra padding token 2024-07-17 07:38:25 -05:00
Jeroen Van Goey
48bd72c890 fix typos, add codespell pre-commit hook (#264)
* fix typos, add codespell pre-commit hook

* Update .pre-commit-config.yaml

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-07-16 07:07:04 -05:00
Sebastian Raschka
e0148f6ecc break long lines in ch07 (#263) 2024-07-13 07:26:23 -05:00
Sebastian Raschka
4f0a107692 show how to use the finetuned model 2024-07-09 06:43:26 -07:00
Daniel Kleine
90b25ece3d fixed spelling typos (#258) 2024-07-03 07:47:33 -05:00
rasbt
f5a4f9dee3 add spearman and kendall-tau analysis 2024-07-02 07:55:32 -05:00
Sebastian Raschka
f6bcdd37bd Fix links in summary sections (#254) 2024-06-29 07:51:31 -05:00
rasbt
31806828d0 add links to summary sections 2024-06-29 07:33:26 -05:00
Daniel Kleine
1e69c8e0b5 fixed minor issues (#252)
* fixed typo

* fixed var name in md text
2024-06-29 06:38:25 -05:00
Sebastian Raschka
e296e8f6be Use deterministic ollama settings (#250)
* deterministic ollama settings

* add missing file
2024-06-27 07:16:48 -05:00
Daniel Kleine
1db1999951 minor fixes (#248)
* removed duplicated numpy req

* labels to array

* autopep8 NBs
2024-06-26 08:52:51 -05:00
Daniel Kleine
81c843bdc0 minor fixes (#246)
* removed duplicated white spaces

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/05_dataset-generation/llama3-ollama.ipynb

* removed duplicated white spaces

* fixed title again

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-25 17:30:30 -05:00
Sebastian Raschka
9a9b3530c9 Update title 2024-06-25 10:01:12 -05:00
Sebastian Raschka
dbcdc7593b Generating a synthetic dataset for instruction finetuning (#245)
* Generating a synthetic dataset for instruction finetuning

* fix link
2024-06-23 21:48:25 -05:00
rasbt
0734570b28 refresh figures 2024-06-23 10:41:29 -05:00
Sebastian Raschka
4c69df6070 removes redundent figsize code (#244) 2024-06-23 09:24:07 -05:00
Sebastian Raschka
f78ad1f95b Update README.md 2024-06-23 08:25:01 -05:00
Sebastian Raschka
cf0df54d7d Show epochs as integers on x-axis (#241)
* Show epochs as integers on x-axis

* Update ch07/01_main-chapter-code/previous_chapters.py

* remove extra s

* modify exercise plots

* update chapter 7 plot

* resave ch07 for better file diff
2024-06-23 07:41:25 -05:00
Daniel Kleine
51ca343e83 fixed typo (#243)
* fixed copy-paste typo

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

* Update ch07/01_main-chapter-code/ch07.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-23 07:11:04 -05:00
Daniel Kleine
3ac363d005 updated .gitignore for ch07/01 artefacts (#242)
* fixed markdown

* removed redundant imports

* updated .gitignore for ch07/01 artefacts
2024-06-22 18:12:01 -05:00
rasbt
523a3b9bb4 spelling fix 2024-06-22 12:22:21 -05:00
rasbt
c21b9937e9 simplify 2024-06-22 11:10:05 -05:00
Sebastian Raschka
72f46297d9 Exercise solution for LoRA instruction finetuning (#240) 2024-06-22 10:05:32 -05:00
Sebastian Raschka
ec5baa1f33 Add CI tests for chapter 7 (#239) 2024-06-22 08:57:18 -05:00
Sebastian Raschka
b90c7ad2d6 Exercise solutions (#237) 2024-06-22 08:30:45 -05:00
Daniel Kleine
ad9dd994dc minor fixes (#235)
* removed unnecessary imports

* removed unnecessary semicolons

* format markdown

* format markdown

* fixed markdown
2024-06-21 08:40:54 -05:00
rasbt
4c2b503785 update 2024-06-21 06:31:31 -05:00
Sebastian Raschka
6c0dc2362b Add standalone finetuning and evaluation scripts for chapter 7 (#234)
* add finetuning and eval scripts

* update link

* update links

* fix link
2024-06-21 05:23:24 -05:00
Sebastian Raschka
8ccca3a882 Add standalone instruction finetuning script (#233) 2024-06-20 07:37:47 -05:00
rasbt
c595f3da3f example code to use the finetuned model 2024-06-19 20:21:14 -05:00
rasbt
8773981de0 consistency 2024-06-19 19:47:31 -05:00
rasbt
283397aaf2 add main and optional sections 2024-06-19 17:48:25 -05:00
Daniel Kleine
bbb2a0c3d5 fixed num_workers (#229)
* fixed num_workers

* ch06 & ch07: added num_workers to create_dataloader_v1
2024-06-19 17:36:46 -05:00
Daniel Kleine
44cda14494 minor: fixed API name (#227)
* fixed api name

* Update ch07/01_main-chapter-code/ch07.ipynb

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-19 07:09:32 -05:00
Jinge Wang
8d43b4bfea Fix some typos in ch07.ipynb (#224)
* Fixed some typos in ch06.ipynb

* Fix some typos in ch07.ipynb
2024-06-19 06:14:25 -05:00
Sebastian Raschka
1ba1bb4c77 add mps runtime (#223) 2024-06-18 20:58:59 -05:00
Daniel Kleine
fba205985d minor fixes (#222)
* fixed labels

* fixed typo

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
2024-06-18 19:37:26 -05:00
rasbt
7b2174b115 formating updates 2024-06-17 07:40:04 -05:00
rasbt
f6274117b9 formatting 2024-06-16 08:27:25 -05:00
Sebastian Raschka
aba7ed2eb1 Updated ch07 (#213)
* Updated ch07

* fix links

* check links
2024-06-15 15:10:01 -05:00