LLMs-from-scratch

books/LLMs-from-scratch

Fork 0

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Commit Graph

Select branches

Hide Pull Requests

cleaning

debug-exclude-newer

dockerfile

fix-qwen3-tokeniizer-eos

fix_masking_kv_cache

gemma-3

head-dim

main

qwen-tokenizer-fix

requirements-update

uv-improvements

weezymatt-bugfix/semantic-error

#1

#10

#100

#1000

#1003

#1004

#1004

#101

#102

#104

#105

#106

#107

#109

#110

#111

#113

#115

#116

#117

#118

#119

#12

#120

#121

#122

#124

#125

#127

#128

#13

#131

#132

#133

#134

#135

#136

#137

#138

#139

#14

#141

#142

#143

#144

#149

#151

#152

#153

#154

#156

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#169

#17

#170

#171

#173

#174

#176

#177

#178

#179

#18

#180

#182

#183

#184

#187

#189

#19

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#203

#204

#205

#206

#207

#208

#211

#212

#213

#216

#218

#219

#22

#222

#223

#224

#227

#228

#229

#233

#234

#235

#236

#237

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#250

#252

#253

#254

#258

#259

#26

#260

#261

#263

#264

#265

#269

#27

#270

#274

#278

#28

#281

#285

#288

#289

#29

#290

#291

#294

#295

#297

#298

#3

#300

#301

#303

#304

#305

#307

#31

#313

#314

#318

#319

#32

#320

#321

#323

#324

#325

#329

#33

#333

#335

#336

#337

#339

#344

#345

#346

#349

#352

#353

#356

#36

#360

#361

#366

#367

#368

#369

#37

#372

#373

#375

#376

#378

#38

#380

#381

#383

#384

#386

#388

#389

#39

#391

#393

#395

#396

#397

#398

#4

#400

#401

#403

#404

#405

#406

#407

#408

#412

#413

#414

#419

#420

#421

#423

#427

#432

#436

#437

#438

#439

#441

#451

#458

#461

#465

#465

#466

#468

#469

#470

#471

#473

#479

#481

#483

#484

#487

#492

#495

#496

#498

#5

#50

#500

#504

#506

#507

#509

#511

#512

#516

#518

#519

#52

#520

#521

#522

#523

#524

#525

#526

#529

#530

#531

#533

#534

#535

#536

#537

#539

#54

#540

#541

#542

#543

#544

#545

#546

#547

#549

#55

#550

#551

#553

#555

#557

#56

#560

#561

#562

#563

#565

#571

#572

#573

#574

#575

#576

#577

#578

#581

#582

#583

#584

#585

#588

#589

#590

#591

#592

#593

#596

#597

#598

#6

#600

#602

#604

#605

#606

#611

#612

#613

#614

#615

#616

#617

#620

#621

#627

#628

#629

#63

#630

#638

#64

#640

#642

#643

#646

#649

#65

#653

#658

#66

#660

#661

#663

#665

#667

#668

#671

#672

#673

#674

#676

#677

#678

#68

#680

#682

#685

#687

#688

#69

#695

#696

#697

#698

#699

#7

#70

#700

#702

#703

#704

#705

#706

#708

#709

#71

#710

#711

#713

#714

#715

#716

#719

#722

#723

#725

#726

#727

#728

#729

#73

#730

#732

#733

#735

#737

#738

#74

#741

#744

#747

#748

#749

#75

#750

#752

#758

#76

#760

#761

#764

#767

#768

#769

#77

#770

#771

#773

#774

#775

#776

#78

#780

#781

#786

#788

#79

#793

#798

#799

#800

#801

#802

#805

#807

#809

#81

#810

#811

#812

#814

#815

#817

#818

#819

#82

#820

#823

#826

#828

#829

#83

#830

#831

#832

#833

#834

#839

#84

#841

#842

#843

#845

#847

#849

#850

#851

#858

#859

#861

#862

#863

#865

#866

#867

#869

#870

#874

#875

#876

#878

#879

#880

#881

#883

#887

#888

#89

#890

#891

#892

#893

#897

#898

#9

#90

#900

#901

#903

#904

#906

#909

#910

#914

#915

#916

#918

#920

#925

#926

#927

#933

#935

#937

#938

#940

#942

#943

#945

#946

#949

#950

#951

#952

#953

#954

#957

#958

#959

#96

#960

#961

#962

#965

#969

#97

#974

#975

#976

#981

#987

#989

#99

#991

#993

#994

#998

#999

b8ba2c257a make consistent with the latest production version rasbt 2024-05-18 12:08:39 -05:00
3b57b6d8c4 make consistent with the latest production version rasbt 2024-05-18 12:08:39 -05:00
678fad50bc formatting for consistency with production chapter rasbt 2024-05-18 11:03:42 -05:00
ea9da3a89c formatting for consistency with production chapter rasbt 2024-05-18 11:03:42 -05:00
cdd51f216e Merge pull request #163 from rasbt/add-gradient-accumulation Sebastian Raschka 2024-05-17 22:45:57 -04:00
217ab77a6c Merge pull request #163 from rasbt/add-gradient-accumulation Sebastian Raschka 2024-05-17 22:45:57 -04:00
10ebc47720 Add experiment with gradient accumulation rasbt 2024-05-17 21:31:22 -05:00
42cb0cbd59 Add experiment with gradient accumulation rasbt 2024-05-17 21:31:22 -05:00
623bc19665 fix no padding option rasbt 2024-05-17 21:06:51 -05:00
fc88fefd9c fix no padding option rasbt 2024-05-17 21:06:51 -05:00
42d003c4ee Merge pull request #162 from d-kleine/main Sebastian Raschka 2024-05-17 16:45:43 -04:00
08f0cfd438 Merge pull request #162 from d-kleine/main Sebastian Raschka 2024-05-17 16:45:43 -04:00
37a760bcf3 Merge branch 'rasbt:main' into main Daniel Kleine 2024-05-17 15:59:44 +02:00
d7fb3f34ec Merge branch 'rasbt:main' into main Daniel Kleine 2024-05-17 15:59:44 +02:00
b9c3e10dd3 fixed var name Daniel Kleine 2024-05-17 13:58:07 +00:00
7e3638649e fixed var name Daniel Kleine 2024-05-17 13:58:07 +00:00
8480638964 Merge pull request #161 from rasbt/no-padding Sebastian Raschka 2024-05-17 09:35:02 -04:00
ceb53648ae Merge pull request #161 from rasbt/no-padding Sebastian Raschka 2024-05-17 09:35:02 -04:00
05738f8be6 fix link rasbt 2024-05-17 08:20:35 -05:00
cbe9664ef4 fix link rasbt 2024-05-17 08:20:35 -05:00
f1db50fe9a fix indent rasbt 2024-05-17 07:58:01 -05:00
5cfc64d038 fix indent rasbt 2024-05-17 07:58:01 -05:00
2653c36957 Add new experiment without padding rasbt 2024-05-17 07:55:51 -05:00
04b9540938 Add new experiment without padding rasbt 2024-05-17 07:55:51 -05:00
e230576413 Merge pull request #160 from d-kleine/main Sebastian Raschka 2024-05-17 07:51:26 -04:00
b8451e5077 Merge pull request #160 from d-kleine/main Sebastian Raschka 2024-05-17 07:51:26 -04:00
e6012b944e fixed empty space Daniel Kleine 2024-05-17 10:44:18 +02:00
cf8b6c1094 fixed empty space Daniel Kleine 2024-05-17 10:44:18 +02:00
018a22338f added missing step 2 and prettyfied readme Daniel Kleine 2024-05-17 10:43:35 +02:00
cb0e1b2f37 added missing step 2 and prettyfied readme Daniel Kleine 2024-05-17 10:43:35 +02:00
6c6321f671 simplify code rasbt 2024-05-16 20:16:25 -05:00
37a17e2228 simplify code rasbt 2024-05-16 20:16:25 -05:00
d0777e3aa0 Merge pull request #157 from DrCesar/main Sebastian Raschka 2024-05-15 20:58:43 -04:00
738ec44bf9 Merge pull request #157 from DrCesar/main Sebastian Raschka 2024-05-15 20:58:43 -04:00
df5f680383 Merge pull request #159 from ehberg/main Sebastian Raschka 2024-05-15 20:46:31 -04:00
c5db9c4cea Merge pull request #159 from ehberg/main Sebastian Raschka 2024-05-15 20:46:31 -04:00
3614f6efa9 Update README.md, minor path change Eric Berg 2024-05-15 13:51:51 -04:00
f611e6c5c5 Update README.md, minor path change Eric Berg 2024-05-15 13:51:51 -04:00
a26fd9d02a Merge pull request #158 from d-kleine/main Sebastian Raschka 2024-05-15 06:17:57 -05:00
a64d5acc21 Merge pull request #158 from d-kleine/main Sebastian Raschka 2024-05-15 06:17:57 -05:00
5411f31186 added missing word Daniel Kleine 2024-05-15 06:33:25 +00:00
9664e2a252 added missing word Daniel Kleine 2024-05-15 06:33:25 +00:00
c78ceafe51 updated .gitignore with appendix artifacts Daniel Kleine 2024-05-15 06:30:24 +00:00
fabdefe959 updated .gitignore with appendix artifacts Daniel Kleine 2024-05-15 06:30:24 +00:00
d2410cb0c6 fix move model to device before calculating loss DrCesar 2024-05-14 22:28:00 -07:00
ecd2855334 fix move model to device before calculating loss DrCesar 2024-05-14 22:28:00 -07:00
bbb4703cf3 added csv extension Daniel Kleine 2024-05-15 05:26:57 +00:00
1e039287c9 added csv extension Daniel Kleine 2024-05-15 05:26:57 +00:00
e4227c899b Merge pull request #156 from rasbt/improve-bonus-code-ch06 Sebastian Raschka 2024-05-14 19:44:20 -05:00
7d14270546 Merge pull request #156 from rasbt/improve-bonus-code-ch06 Sebastian Raschka 2024-05-14 19:44:20 -05:00
47b3ff15ec improve bonus code in chapter 06 Sebastian Raschka 2024-05-14 20:35:50 -04:00
e631823762 improve bonus code in chapter 06 Sebastian Raschka 2024-05-14 20:35:50 -04:00
dad6eb4456 Merge pull request #154 from d-kleine/main Sebastian Raschka 2024-05-14 08:30:26 -05:00
eafd2de881 Merge pull request #154 from d-kleine/main Sebastian Raschka 2024-05-14 08:30:26 -05:00
30010c7a91 Merge branch 'main' into main Sebastian Raschka 2024-05-14 08:28:02 -05:00
717b294680 Merge branch 'main' into main Sebastian Raschka 2024-05-14 08:28:02 -05:00
6aff47ba60 fix file path name rasbt 2024-05-14 08:27:46 -05:00
52f15dff30 fix file path name rasbt 2024-05-14 08:27:46 -05:00
2f1e1a3d4b Merge branch 'main' into main Sebastian Raschka 2024-05-14 08:12:19 -05:00
fa52c3bc78 Merge branch 'main' into main Sebastian Raschka 2024-05-14 08:12:19 -05:00
0b176bb1fc add previous chapters file rasbt 2024-05-14 08:11:58 -05:00
6cfec73490 add previous chapters file rasbt 2024-05-14 08:11:58 -05:00
d499c90903 Merge branch 'main' into main Sebastian Raschka 2024-05-14 08:07:58 -05:00
abd29ce7c2 Merge branch 'main' into main Sebastian Raschka 2024-05-14 08:07:58 -05:00
df4c59cf6e add missing gpt-download.py rasbt 2024-05-14 08:05:56 -05:00
25fb63e14a add missing gpt-download.py rasbt 2024-05-14 08:05:56 -05:00
c754b14a79 added missing python run statement Daniel Kleine 2024-05-14 12:17:09 +00:00
4bf268f398 added missing python run statement Daniel Kleine 2024-05-14 12:17:09 +00:00
d2fe7287a2 updated .gitignore with 06/02 und /03 artifacts Daniel Kleine 2024-05-14 12:16:24 +00:00
88ee7793d4 updated .gitignore with 06/02 und /03 artifacts Daniel Kleine 2024-05-14 12:16:24 +00:00
87bf79e888 tokens seen -> examples seen rasbt 2024-05-13 20:08:48 -05:00
c7c83904a0 tokens seen -> examples seen rasbt 2024-05-13 20:08:48 -05:00
d9e364c04a spelling rasbt 2024-05-13 20:06:38 -05:00
16d19751b0 spelling rasbt 2024-05-13 20:06:38 -05:00
b350daaa93 add readme rasbt 2024-05-13 08:50:55 -05:00
cd7ea15e8d add readme rasbt 2024-05-13 08:50:55 -05:00
f8589c05c1 Merge pull request #153 from rasbt/ch06-exercises Sebastian Raschka 2024-05-13 08:14:08 -05:00
968af7e0ba Merge pull request #153 from rasbt/ch06-exercises Sebastian Raschka 2024-05-13 08:14:08 -05:00
58aa3020b4 update readme rasbt 2024-05-13 07:57:30 -05:00
56f713fb69 update readme rasbt 2024-05-13 07:57:30 -05:00
c95abad6d1 pep8 fixes rasbt 2024-05-13 07:50:51 -05:00
b28cc0cb8c pep8 fixes rasbt 2024-05-13 07:50:51 -05:00
13e4282567 tests and exercises rasbt 2024-05-13 07:45:59 -05:00
a740a62239 tests and exercises rasbt 2024-05-13 07:45:59 -05:00
7370ad1615 val before test acc Sebastian Raschka 2024-05-13 07:36:18 -05:00
5094eb7567 val before test acc Sebastian Raschka 2024-05-13 07:36:18 -05:00
c8bcdf5206 fix tests rasbt 2024-05-12 19:03:14 -05:00
8bc15ab316 fix tests rasbt 2024-05-12 19:03:14 -05:00
37c33d6fee add chapter 6 unit test rasbt 2024-05-12 18:51:28 -05:00
21172a6a7e add chapter 6 unit test rasbt 2024-05-12 18:51:28 -05:00
6b5bc7a1cd add missing figure rasbt 2024-05-12 18:37:02 -05:00
281400feca add missing figure rasbt 2024-05-12 18:37:02 -05:00
ccb862cc36 chapter 06 summary file rasbt 2024-05-12 18:27:50 -05:00
88176a82eb chapter 06 summary file rasbt 2024-05-12 18:27:50 -05:00
351b0483c1 10 -> 5 rasbt 2024-05-12 10:42:25 -05:00
209f63943b 10 -> 5 rasbt 2024-05-12 10:42:25 -05:00
73e1c68f45 use validation path rasbt 2024-05-12 09:41:46 -05:00
ad41c6e3cc use validation path rasbt 2024-05-12 09:41:46 -05:00
1c13810d30 use path rasbt 2024-05-12 09:36:35 -05:00
33dda489a1 use path rasbt 2024-05-12 09:36:35 -05:00

... 11 12 13 14 15 ...