LLMs-from-scratch

books/LLMs-from-scratch

Fork 0

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Commit Graph

Select branches

Hide Pull Requests

cleaning

debug-exclude-newer

dockerfile

fix-qwen3-tokeniizer-eos

fix_masking_kv_cache

gemma-3

head-dim

main

qwen-tokenizer-fix

requirements-update

uv-improvements

weezymatt-bugfix/semantic-error

#1

#10

#100

#1000

#1003

#1004

#1004

#101

#102

#104

#105

#106

#107

#109

#110

#111

#113

#115

#116

#117

#118

#119

#12

#120

#121

#122

#124

#125

#127

#128

#13

#131

#132

#133

#134

#135

#136

#137

#138

#139

#14

#141

#142

#143

#144

#149

#151

#152

#153

#154

#156

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#169

#17

#170

#171

#173

#174

#176

#177

#178

#179

#18

#180

#182

#183

#184

#187

#189

#19

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#203

#204

#205

#206

#207

#208

#211

#212

#213

#216

#218

#219

#22

#222

#223

#224

#227

#228

#229

#233

#234

#235

#236

#237

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#250

#252

#253

#254

#258

#259

#26

#260

#261

#263

#264

#265

#269

#27

#270

#274

#278

#28

#281

#285

#288

#289

#29

#290

#291

#294

#295

#297

#298

#3

#300

#301

#303

#304

#305

#307

#31

#313

#314

#318

#319

#32

#320

#321

#323

#324

#325

#329

#33

#333

#335

#336

#337

#339

#344

#345

#346

#349

#352

#353

#356

#36

#360

#361

#366

#367

#368

#369

#37

#372

#373

#375

#376

#378

#38

#380

#381

#383

#384

#386

#388

#389

#39

#391

#393

#395

#396

#397

#398

#4

#400

#401

#403

#404

#405

#406

#407

#408

#412

#413

#414

#419

#420

#421

#423

#427

#432

#436

#437

#438

#439

#441

#451

#458

#461

#465

#465

#466

#468

#469

#470

#471

#473

#479

#481

#483

#484

#487

#492

#495

#496

#498

#5

#50

#500

#504

#506

#507

#509

#511

#512

#516

#518

#519

#52

#520

#521

#522

#523

#524

#525

#526

#529

#530

#531

#533

#534

#535

#536

#537

#539

#54

#540

#541

#542

#543

#544

#545

#546

#547

#549

#55

#550

#551

#553

#555

#557

#56

#560

#561

#562

#563

#565

#571

#572

#573

#574

#575

#576

#577

#578

#581

#582

#583

#584

#585

#588

#589

#590

#591

#592

#593

#596

#597

#598

#6

#600

#602

#604

#605

#606

#611

#612

#613

#614

#615

#616

#617

#620

#621

#627

#628

#629

#63

#630

#638

#64

#640

#642

#643

#646

#649

#65

#653

#658

#66

#660

#661

#663

#665

#667

#668

#671

#672

#673

#674

#676

#677

#678

#68

#680

#682

#685

#687

#688

#69

#695

#696

#697

#698

#699

#7

#70

#700

#702

#703

#704

#705

#706

#708

#709

#71

#710

#711

#713

#714

#715

#716

#719

#722

#723

#725

#726

#727

#728

#729

#73

#730

#732

#733

#735

#737

#738

#74

#741

#744

#747

#748

#749

#75

#750

#752

#758

#76

#760

#761

#764

#767

#768

#769

#77

#770

#771

#773

#774

#775

#776

#78

#780

#781

#786

#788

#79

#793

#798

#799

#800

#801

#802

#805

#807

#809

#81

#810

#811

#812

#814

#815

#817

#818

#819

#82

#820

#823

#826

#828

#829

#83

#830

#831

#832

#833

#834

#839

#84

#841

#842

#843

#845

#847

#849

#850

#851

#858

#859

#861

#862

#863

#865

#866

#867

#869

#870

#874

#875

#876

#878

#879

#880

#881

#883

#887

#888

#89

#890

#891

#892

#893

#897

#898

#9

#90

#900

#901

#903

#904

#906

#909

#910

#914

#915

#916

#918

#920

#925

#926

#927

#933

#935

#937

#938

#940

#942

#943

#945

#946

#949

#950

#951

#952

#953

#954

#957

#958

#959

#96

#960

#961

#962

#965

#969

#97

#974

#975

#976

#981

#987

#989

#99

#991

#993

#994

#998

#999

029efee920 reorg first section rasbt 2024-06-10 08:20:12 -05:00
888ce71796 reorg first section rasbt 2024-06-10 08:20:12 -05:00
b9ed5811c3 fix gradient comment rasbt 2024-06-09 20:23:18 -05:00
1d278c65da fix gradient comment rasbt 2024-06-09 20:23:18 -05:00
c3c7e64a63 ch07 first draft (#203) Sebastian Raschka 2024-06-09 10:35:26 -05:00
4eea9ce12c ch07 first draft (#203) Sebastian Raschka 2024-06-09 10:35:26 -05:00
f0e4c99bc3 fix typo in comment rasbt 2024-06-09 06:14:02 -05:00
1b1fd21d64 fix typo in comment rasbt 2024-06-09 06:14:02 -05:00
e1adeb14f3 add allowed_special={"<|endoftext|>"} rasbt 2024-06-09 06:04:02 -05:00
39c4a887eb add allowed_special={"<|endoftext|>"} rasbt 2024-06-09 06:04:02 -05:00
40ba3a4068 Remove leftover instances of self.tokenizer (#201) Sebastian Raschka 2024-06-08 14:57:34 -05:00
72a073bbbf Remove leftover instances of self.tokenizer (#201) Sebastian Raschka 2024-06-08 14:57:34 -05:00
98d23751f7 Explain value truncation in some figures (#199) Sebastian Raschka 2024-06-08 13:24:37 -05:00
c303a7f36d Explain value truncation in some figures (#199) Sebastian Raschka 2024-06-08 13:24:37 -05:00
d4dba08922 make error more explicit rasbt 2024-06-08 13:21:40 -05:00
3b696a0b3c make error more explicit rasbt 2024-06-08 13:21:40 -05:00
a6113fcd33 clarify truncation rasbt 2024-06-08 13:13:43 -05:00
1e12da90e6 clarify truncation rasbt 2024-06-08 13:13:43 -05:00
b80e7804b3 add instruction dataset rasbt 2024-06-08 10:38:41 -05:00
4ac480c9ae add instruction dataset rasbt 2024-06-08 10:38:41 -05:00
517d86e58e Add A.1 and A.2 solutions (#198) Sebastian Raschka 2024-06-08 09:50:01 -05:00
233c861930 Add A.1 and A.2 solutions (#198) Sebastian Raschka 2024-06-08 09:50:01 -05:00
fbecc2b48b remove redundant file rasbt 2024-06-07 08:37:41 -05:00
f42290e83b remove redundant file rasbt 2024-06-07 08:37:41 -05:00
42ecfc1c81 fixed code (#197) Daniel Kleine 2024-06-07 13:52:05 +02:00
b178040b79 fixed code (#197) Daniel Kleine 2024-06-07 13:52:05 +02:00
017f73d50c update ollama instructions rasbt 2024-06-06 21:03:40 -05:00
53060dfdfc update ollama instructions rasbt 2024-06-06 21:03:40 -05:00
de36026e5a correlation analysis (#196) Sebastian Raschka 2024-06-06 09:15:08 -05:00
e27d9475cb correlation analysis (#196) Sebastian Raschka 2024-06-06 09:15:08 -05:00
9e257212b2 explain ollama serve command rasbt 2024-06-06 06:42:54 -05:00
d271f317e0 explain ollama serve command rasbt 2024-06-06 06:42:54 -05:00
e637393056 updated Dockerfile and Additional Classification Finetuning Experiments (#195) Daniel Kleine 2024-06-06 03:17:49 +02:00
ba1c1e74aa updated Dockerfile and Additional Classification Finetuning Experiments (#195) Daniel Kleine 2024-06-06 03:17:49 +02:00
1efd9313b1 remove empty cell rasbt 2024-06-05 18:18:16 -05:00
c6efa78325 remove empty cell rasbt 2024-06-05 18:18:16 -05:00
429cde81b5 Merge pull request #193 from rasbt/ollama-eval Sebastian Raschka 2024-06-05 08:26:06 -05:00
32251f27d5 Merge pull request #193 from rasbt/ollama-eval Sebastian Raschka 2024-06-05 08:26:06 -05:00
1c7c937602 Merge branch 'main' into ollama-eval Sebastian Raschka 2024-06-05 08:23:45 -05:00
ef580a0d57 Merge branch 'main' into ollama-eval Sebastian Raschka 2024-06-05 08:23:45 -05:00
9f8c3f2b35 Ollama-based model evaluation rasbt 2024-06-05 08:21:28 -05:00
30ebd7427c Ollama-based model evaluation rasbt 2024-06-05 08:21:28 -05:00
cdb7bf71df remove redundant dependency Sebastian Raschka 2024-06-04 20:54:19 -05:00
6290dade88 remove redundant dependency Sebastian Raschka 2024-06-04 20:54:19 -05:00
c97c717a7b remove redundant import rasbt 2024-06-04 07:11:12 -05:00
f5c4e0778f remove redundant import rasbt 2024-06-04 07:11:12 -05:00
089dfb756a restore file rasbt 2024-06-03 07:17:56 -05:00
054cdfa4b1 restore file rasbt 2024-06-03 07:17:56 -05:00
d51099a9e7 add number of workers to data loader rasbt 2024-06-03 07:12:47 -05:00
7fdbd16551 add number of workers to data loader rasbt 2024-06-03 07:12:47 -05:00
5a1e0eecce fix learning rate scheduler rasbt 2024-06-03 07:06:42 -05:00
6f0a5c320b fix learning rate scheduler rasbt 2024-06-03 07:06:42 -05:00
5adc6a8f69 easier to read tensor formatting rasbt 2024-06-02 20:41:34 -05:00
f95e0a910d easier to read tensor formatting rasbt 2024-06-02 20:41:34 -05:00
20f1ef553c update figure 2.13 rasbt 2024-06-01 09:38:33 -05:00
60f64bdc23 update figure 2.13 rasbt 2024-06-01 09:38:33 -05:00
64fdb4a249 Merge pull request #189 from rasbt/kuutsav/main Sebastian Raschka 2024-05-31 08:06:57 -05:00
da26b54b82 Merge pull request #189 from rasbt/kuutsav/main Sebastian Raschka 2024-05-31 08:06:57 -05:00
f7e528fca6 update loss rasbt 2024-05-31 07:30:57 -05:00
b352d9ef0a update loss rasbt 2024-05-31 07:30:57 -05:00
b48d436bfc Update ch05.ipynb Kumar Utsav 2024-05-29 20:34:23 +05:30
bc5d73857c Update ch05.ipynb Kumar Utsav 2024-05-29 20:34:23 +05:30
688df76bc0 Merge pull request #184 from rasbt/api-key-approach Sebastian Raschka 2024-05-27 08:47:04 -04:00
c577f52bfc Merge pull request #184 from rasbt/api-key-approach Sebastian Raschka 2024-05-27 08:47:04 -04:00
c0f564ee87 update mha dim rasbt 2024-05-27 07:46:29 -05:00
71831890a0 update mha dim rasbt 2024-05-27 07:46:29 -05:00
9a4861ee7f revert rasbt 2024-05-27 07:37:53 -05:00
554cbd6bff revert rasbt 2024-05-27 07:37:53 -05:00
f86a929665 revert unnecessary changes rasbt 2024-05-27 07:37:06 -05:00
42af52fef4 revert unnecessary changes rasbt 2024-05-27 07:37:06 -05:00
134334ce21 Revert "Revert "newline"" rasbt 2024-05-27 07:32:45 -05:00
87c3e78dcb Revert "Revert "newline"" rasbt 2024-05-27 07:32:45 -05:00
6aa2a587d2 Revert "newline" rasbt 2024-05-27 07:32:22 -05:00
a53ca10508 Revert "newline" rasbt 2024-05-27 07:32:22 -05:00
9eeeb67329 newline rasbt 2024-05-27 07:30:27 -05:00
23982ed3fa newline rasbt 2024-05-27 07:30:27 -05:00
474ad17546 Update API approach and add progress bar rasbt 2024-05-27 07:29:06 -05:00
8ad5facfb8 Update API approach and add progress bar rasbt 2024-05-27 07:29:06 -05:00
b2ad4fb0d6 add comment rasbt 2024-05-27 07:18:07 -05:00
dd7ba32b56 add comment rasbt 2024-05-27 07:18:07 -05:00
36e169f3ab add keys rasbt 2024-05-27 07:13:59 -05:00
306336c32d add keys rasbt 2024-05-27 07:13:59 -05:00
68123a5433 Merge pull request #183 from superkostya/fix-mha-wrapper-class Sebastian Raschka 2024-05-26 17:09:19 -04:00
f359db8a10 Merge pull request #183 from superkostya/fix-mha-wrapper-class Sebastian Raschka 2024-05-26 17:09:19 -04:00
ec6e09136a update pr rasbt 2024-05-26 15:38:35 -05:00
050c8b7b73 update pr rasbt 2024-05-26 15:38:35 -05:00
2088d75966 Merge branch 'main' into fix-mha-wrapper-class Sebastian Raschka 2024-05-26 16:20:06 -04:00
e2aeb80fdb Merge branch 'main' into fix-mha-wrapper-class Sebastian Raschka 2024-05-26 16:20:06 -04:00
3853ce48c5 Merge pull request #182 from rasbt/refine-duplicate-search Sebastian Raschka 2024-05-26 16:19:17 -04:00
ffe8bb7489 Merge pull request #182 from rasbt/refine-duplicate-search Sebastian Raschka 2024-05-26 16:19:17 -04:00
18b5724e75 Fix an incorrect input dimension Kostyantyn Borysenko 2024-05-26 13:05:07 -07:00
76cdf5e299 Fix an incorrect input dimension Kostyantyn Borysenko 2024-05-26 13:05:07 -07:00
5044ee2dda fixes rasbt 2024-05-26 14:28:30 -05:00
fa757e5e48 fixes rasbt 2024-05-26 14:28:30 -05:00
9950761642 refine similarity search rasbt 2024-05-26 14:25:09 -05:00
bd23d7e515 refine similarity search rasbt 2024-05-26 14:25:09 -05:00
8f362634b8 Merge pull request #180 from rasbt/model-eval Sebastian Raschka 2024-05-26 12:02:36 -04:00
82ede6010b Merge pull request #180 from rasbt/model-eval Sebastian Raschka 2024-05-26 12:02:36 -04:00
91339535e1 Add openai model eval utility code rasbt 2024-05-26 10:44:15 -05:00
771992c486 Add openai model eval utility code rasbt 2024-05-26 10:44:15 -05:00

... 9 10 11 12 13 ...