LLMs-from-scratch

books/LLMs-from-scratch

Fork 0

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Commit Graph

Select branches

Hide Pull Requests

cleaning

debug-exclude-newer

dockerfile

fix-qwen3-tokeniizer-eos

fix_masking_kv_cache

gemma-3

head-dim

main

qwen-tokenizer-fix

requirements-update

uv-improvements

weezymatt-bugfix/semantic-error

#1

#10

#100

#1000

#1003

#1004

#1004

#101

#102

#104

#105

#106

#107

#109

#110

#111

#113

#115

#116

#117

#118

#119

#12

#120

#121

#122

#124

#125

#127

#128

#13

#131

#132

#133

#134

#135

#136

#137

#138

#139

#14

#141

#142

#143

#144

#149

#151

#152

#153

#154

#156

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#169

#17

#170

#171

#173

#174

#176

#177

#178

#179

#18

#180

#182

#183

#184

#187

#189

#19

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#203

#204

#205

#206

#207

#208

#211

#212

#213

#216

#218

#219

#22

#222

#223

#224

#227

#228

#229

#233

#234

#235

#236

#237

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#250

#252

#253

#254

#258

#259

#26

#260

#261

#263

#264

#265

#269

#27

#270

#274

#278

#28

#281

#285

#288

#289

#29

#290

#291

#294

#295

#297

#298

#3

#300

#301

#303

#304

#305

#307

#31

#313

#314

#318

#319

#32

#320

#321

#323

#324

#325

#329

#33

#333

#335

#336

#337

#339

#344

#345

#346

#349

#352

#353

#356

#36

#360

#361

#366

#367

#368

#369

#37

#372

#373

#375

#376

#378

#38

#380

#381

#383

#384

#386

#388

#389

#39

#391

#393

#395

#396

#397

#398

#4

#400

#401

#403

#404

#405

#406

#407

#408

#412

#413

#414

#419

#420

#421

#423

#427

#432

#436

#437

#438

#439

#441

#451

#458

#461

#465

#465

#466

#468

#469

#470

#471

#473

#479

#481

#483

#484

#487

#492

#495

#496

#498

#5

#50

#500

#504

#506

#507

#509

#511

#512

#516

#518

#519

#52

#520

#521

#522

#523

#524

#525

#526

#529

#530

#531

#533

#534

#535

#536

#537

#539

#54

#540

#541

#542

#543

#544

#545

#546

#547

#549

#55

#550

#551

#553

#555

#557

#56

#560

#561

#562

#563

#565

#571

#572

#573

#574

#575

#576

#577

#578

#581

#582

#583

#584

#585

#588

#589

#590

#591

#592

#593

#596

#597

#598

#6

#600

#602

#604

#605

#606

#611

#612

#613

#614

#615

#616

#617

#620

#621

#627

#628

#629

#63

#630

#638

#64

#640

#642

#643

#646

#649

#65

#653

#658

#66

#660

#661

#663

#665

#667

#668

#671

#672

#673

#674

#676

#677

#678

#68

#680

#682

#685

#687

#688

#69

#695

#696

#697

#698

#699

#7

#70

#700

#702

#703

#704

#705

#706

#708

#709

#71

#710

#711

#713

#714

#715

#716

#719

#722

#723

#725

#726

#727

#728

#729

#73

#730

#732

#733

#735

#737

#738

#74

#741

#744

#747

#748

#749

#75

#750

#752

#758

#76

#760

#761

#764

#767

#768

#769

#77

#770

#771

#773

#774

#775

#776

#78

#780

#781

#786

#788

#79

#793

#798

#799

#800

#801

#802

#805

#807

#809

#81

#810

#811

#812

#814

#815

#817

#818

#819

#82

#820

#823

#826

#828

#829

#83

#830

#831

#832

#833

#834

#839

#84

#841

#842

#843

#845

#847

#849

#850

#851

#858

#859

#861

#862

#863

#865

#866

#867

#869

#870

#874

#875

#876

#878

#879

#880

#881

#883

#887

#888

#89

#890

#891

#892

#893

#897

#898

#9

#90

#900

#901

#903

#904

#906

#909

#910

#914

#915

#916

#918

#920

#925

#926

#927

#933

#935

#937

#938

#940

#942

#943

#945

#946

#949

#950

#951

#952

#953

#954

#957

#958

#959

#96

#960

#961

#962

#965

#969

#97

#974

#975

#976

#981

#987

#989

#99

#991

#993

#994

#998

#999

d0f3b034d8 Add download help message (#274) Sebastian Raschka 2024-07-19 06:29:29 -07:00
8d02cb1cee Add download help message (#274) Sebastian Raschka 2024-07-19 06:29:29 -07:00
06ed31f347 Updated test badges Sebastian Raschka 2024-07-18 20:26:51 -05:00
eb6ca4311f Updated test badges Sebastian Raschka 2024-07-18 20:26:51 -05:00
3195594680 explain extra padding token rasbt 2024-07-17 07:38:19 -05:00
be14f06442 explain extra padding token rasbt 2024-07-17 07:38:19 -05:00
a2bb045984 fix typos & inconsistent texts (#269) Thanh Tran 2024-07-17 21:34:51 +09:00
070a69fc8b fix typos & inconsistent texts (#269) Thanh Tran 2024-07-17 21:34:51 +09:00
ee1d4730ba fixes bold font #267 rasbt 2024-07-16 17:51:15 -05:00
a33e89c12c fixes bold font #267 rasbt 2024-07-16 17:51:15 -05:00
311a3837e4 Gh workflow for spelling errors (#265) Sebastian Raschka 2024-07-16 06:17:20 -07:00
45d0318ae6 Gh workflow for spelling errors (#265) Sebastian Raschka 2024-07-16 06:17:20 -07:00
70cfced899 fix typos, add codespell pre-commit hook (#264) Jeroen Van Goey 2024-07-16 14:07:04 +02:00
48bd72c890 fix typos, add codespell pre-commit hook (#264) Jeroen Van Goey 2024-07-16 14:07:04 +02:00
3b79631672 add missing "be" to figure rasbt 2024-07-15 08:06:05 -05:00
6ffd628bb6 add missing "be" to figure rasbt 2024-07-15 08:06:05 -05:00
2ab7a9aa9d clarify libraries rasbt 2024-07-14 08:53:16 -05:00
7e632f90eb clarify libraries rasbt 2024-07-14 08:53:16 -05:00
377c14c25e break long lines in ch07 (#263) Sebastian Raschka 2024-07-13 05:26:23 -07:00
e0148f6ecc break long lines in ch07 (#263) Sebastian Raschka 2024-07-13 05:26:23 -07:00
3549c2b0d4 Add download instructions Sebastian Raschka 2024-07-13 06:31:14 -05:00
17ff4c6328 Add download instructions Sebastian Raschka 2024-07-13 06:31:14 -05:00
2ce1d16de0 show how to use the finetuned model Sebastian Raschka 2024-07-09 06:43:26 -07:00
4f0a107692 show how to use the finetuned model Sebastian Raschka 2024-07-09 06:43:26 -07:00
28041d7e4c Update README.md Sebastian Raschka 2024-07-06 08:26:50 -05:00
e2918af036 Update README.md Sebastian Raschka 2024-07-06 08:26:50 -05:00
7e0dd7f765 minor: removed redundant imports (#260) Daniel Kleine 2024-07-05 22:33:19 +02:00
88186bf64a minor: removed redundant imports (#260) Daniel Kleine 2024-07-05 22:33:19 +02:00
bd216fdade update decode method rasbt 2024-07-05 08:34:27 -05:00
b92dea8bc6 update decode method rasbt 2024-07-05 08:34:27 -05:00
46f4d9e575 fixing the regular expression used in the SimpleTokenizer (#259) Suman Debnath 2024-07-04 13:27:27 -04:00
2cdcf68598 fixing the regular expression used in the SimpleTokenizer (#259) Suman Debnath 2024-07-04 13:27:27 -04:00
3e47407646 Update README.md Sebastian Raschka 2024-07-03 20:28:04 -05:00
b02ccb5f6f Update README.md Sebastian Raschka 2024-07-03 20:28:04 -05:00
17a590e411 Update README.md Sebastian Raschka 2024-07-03 20:27:54 -05:00
e7ab84d98c Update README.md Sebastian Raschka 2024-07-03 20:27:54 -05:00
87f47a281a fixed spelling typos (#258) Daniel Kleine 2024-07-03 14:47:33 +02:00
90b25ece3d fixed spelling typos (#258) Daniel Kleine 2024-07-03 14:47:33 +02:00
fe23241ba0 Update README.md Sebastian Raschka 2024-07-03 05:56:46 -05:00
78b783f6fd Update README.md Sebastian Raschka 2024-07-03 05:56:46 -05:00
52e10c7360 use correct chapter reference rasbt 2024-07-02 17:29:57 -05:00
921e91a05f use correct chapter reference rasbt 2024-07-02 17:29:57 -05:00
64536ca40f update figures rasbt 2024-07-02 17:12:42 -05:00
0988996eb8 update figures rasbt 2024-07-02 17:12:42 -05:00
2b379abf70 add spearman and kendall-tau analysis rasbt 2024-07-02 07:55:32 -05:00
f5a4f9dee3 add spearman and kendall-tau analysis rasbt 2024-07-02 07:55:32 -05:00
2d8eacb0fa Fix links in summary sections (#254) Sebastian Raschka 2024-06-29 07:51:31 -05:00
f6bcdd37bd Fix links in summary sections (#254) Sebastian Raschka 2024-06-29 07:51:31 -05:00
5e24a042c1 add links to summary sections rasbt 2024-06-29 07:33:26 -05:00
31806828d0 add links to summary sections rasbt 2024-06-29 07:33:26 -05:00
0f43890a15 refresh cross entropy figure rasbt 2024-06-29 07:22:23 -05:00
219f45f808 refresh cross entropy figure rasbt 2024-06-29 07:22:23 -05:00
01c4b8f645 add clarification about :num_tokens rasbt 2024-06-29 07:16:42 -05:00
c7f892550e add clarification about :num_tokens rasbt 2024-06-29 07:16:42 -05:00
1ffb7500e4 add clarifying note about GELU rasbt 2024-06-29 07:14:36 -05:00
796f0e2a30 add clarifying note about GELU rasbt 2024-06-29 07:14:36 -05:00
1e61943bf2 force refresh figure rasbt 2024-06-29 07:01:37 -05:00
ab23ca5b1b force refresh figure rasbt 2024-06-29 07:01:37 -05:00
8b50915fc9 remove redundant plus sign rasbt 2024-06-29 06:59:36 -05:00
6a8acf5135 remove redundant plus sign rasbt 2024-06-29 06:59:36 -05:00
fb4e37ae15 fixed minor issues (#252) Daniel Kleine 2024-06-29 13:38:25 +02:00
1e69c8e0b5 fixed minor issues (#252) Daniel Kleine 2024-06-29 13:38:25 +02:00
65d68097ee Use deterministic ollama settings (#250) Sebastian Raschka 2024-06-27 07:16:48 -05:00
e296e8f6be Use deterministic ollama settings (#250) Sebastian Raschka 2024-06-27 07:16:48 -05:00
99058c3d07 minor fixes (#248) Daniel Kleine 2024-06-26 15:52:51 +02:00
1db1999951 minor fixes (#248) Daniel Kleine 2024-06-26 15:52:51 +02:00
4fef19e016 remove redundant code lines (#247) Sebastian Raschka 2024-06-25 21:44:19 -05:00
7e78b52a30 remove redundant code lines (#247) Sebastian Raschka 2024-06-25 21:44:19 -05:00
f46441d53f update with latest versions rasbt 2024-06-25 21:09:21 -05:00
7095e84fab update with latest versions rasbt 2024-06-25 21:09:21 -05:00
7a54d383e7 minor fixes (#246) Daniel Kleine 2024-06-26 00:30:30 +02:00
81c843bdc0 minor fixes (#246) Daniel Kleine 2024-06-26 00:30:30 +02:00
5629d4d147 Update title Sebastian Raschka 2024-06-25 10:01:12 -05:00
9a9b3530c9 Update title Sebastian Raschka 2024-06-25 10:01:12 -05:00
1c89f0fc93 Generating a synthetic dataset for instruction finetuning (#245) Sebastian Raschka 2024-06-23 21:48:25 -05:00
dbcdc7593b Generating a synthetic dataset for instruction finetuning (#245) Sebastian Raschka 2024-06-23 21:48:25 -05:00
530fa48d3f refresh figures rasbt 2024-06-23 10:41:29 -05:00
0734570b28 refresh figures rasbt 2024-06-23 10:41:29 -05:00
b7a7ac6068 removes redundent figsize code (#244) Sebastian Raschka 2024-06-23 09:24:07 -05:00
4c69df6070 removes redundent figsize code (#244) Sebastian Raschka 2024-06-23 09:24:07 -05:00
1002f3079d Update README.md Sebastian Raschka 2024-06-23 08:25:01 -05:00
f78ad1f95b Update README.md Sebastian Raschka 2024-06-23 08:25:01 -05:00
def84a039c Show epochs as integers on x-axis (#241) Sebastian Raschka 2024-06-23 07:41:25 -05:00
cf0df54d7d Show epochs as integers on x-axis (#241) Sebastian Raschka 2024-06-23 07:41:25 -05:00
36a29e783a fixed typo (#243) Daniel Kleine 2024-06-23 14:11:04 +02:00
51ca343e83 fixed typo (#243) Daniel Kleine 2024-06-23 14:11:04 +02:00
82c06420ac updated .gitignore for ch07/01 artefacts (#242) Daniel Kleine 2024-06-23 01:12:01 +02:00
3ac363d005 updated .gitignore for ch07/01 artefacts (#242) Daniel Kleine 2024-06-23 01:12:01 +02:00
519bfd6dc5 spelling fix rasbt 2024-06-22 12:22:15 -05:00
523a3b9bb4 spelling fix rasbt 2024-06-22 12:22:15 -05:00
fef88072eb Update README.md Sebastian Raschka 2024-06-22 12:09:02 -05:00
5944ab0678 Update README.md Sebastian Raschka 2024-06-22 12:09:02 -05:00
0026e6206b update generate to match output in main chapter rasbt 2024-06-22 12:01:51 -05:00
143a529c33 update generate to match output in main chapter rasbt 2024-06-22 12:01:51 -05:00
549e015548 simplify rasbt 2024-06-22 11:10:05 -05:00
c21b9937e9 simplify rasbt 2024-06-22 11:10:05 -05:00
2ffedf5b98 Exercise solution for LoRA instruction finetuning (#240) Sebastian Raschka 2024-06-22 10:05:32 -05:00
72f46297d9 Exercise solution for LoRA instruction finetuning (#240) Sebastian Raschka 2024-06-22 10:05:32 -05:00
eb85c43bc3 Add CI tests for chapter 7 (#239) Sebastian Raschka 2024-06-22 08:57:18 -05:00
ec5baa1f33 Add CI tests for chapter 7 (#239) Sebastian Raschka 2024-06-22 08:57:18 -05:00

... 7 8 9 10 11 ...