LLMs-from-scratch

books/LLMs-from-scratch

Fork 0

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Commit Graph

Select branches

Hide Pull Requests

cleaning

debug-exclude-newer

dockerfile

fix-qwen3-tokeniizer-eos

fix_masking_kv_cache

gemma-3

head-dim

main

qwen-tokenizer-fix

requirements-update

uv-improvements

weezymatt-bugfix/semantic-error

#1

#10

#100

#1000

#1003

#1004

#1004

#101

#102

#104

#105

#106

#107

#109

#110

#111

#113

#115

#116

#117

#118

#119

#12

#120

#121

#122

#124

#125

#127

#128

#13

#131

#132

#133

#134

#135

#136

#137

#138

#139

#14

#141

#142

#143

#144

#149

#151

#152

#153

#154

#156

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#169

#17

#170

#171

#173

#174

#176

#177

#178

#179

#18

#180

#182

#183

#184

#187

#189

#19

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#203

#204

#205

#206

#207

#208

#211

#212

#213

#216

#218

#219

#22

#222

#223

#224

#227

#228

#229

#233

#234

#235

#236

#237

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#250

#252

#253

#254

#258

#259

#26

#260

#261

#263

#264

#265

#269

#27

#270

#274

#278

#28

#281

#285

#288

#289

#29

#290

#291

#294

#295

#297

#298

#3

#300

#301

#303

#304

#305

#307

#31

#313

#314

#318

#319

#32

#320

#321

#323

#324

#325

#329

#33

#333

#335

#336

#337

#339

#344

#345

#346

#349

#352

#353

#356

#36

#360

#361

#366

#367

#368

#369

#37

#372

#373

#375

#376

#378

#38

#380

#381

#383

#384

#386

#388

#389

#39

#391

#393

#395

#396

#397

#398

#4

#400

#401

#403

#404

#405

#406

#407

#408

#412

#413

#414

#419

#420

#421

#423

#427

#432

#436

#437

#438

#439

#441

#451

#458

#461

#465

#465

#466

#468

#469

#470

#471

#473

#479

#481

#483

#484

#487

#492

#495

#496

#498

#5

#50

#500

#504

#506

#507

#509

#511

#512

#516

#518

#519

#52

#520

#521

#522

#523

#524

#525

#526

#529

#530

#531

#533

#534

#535

#536

#537

#539

#54

#540

#541

#542

#543

#544

#545

#546

#547

#549

#55

#550

#551

#553

#555

#557

#56

#560

#561

#562

#563

#565

#571

#572

#573

#574

#575

#576

#577

#578

#581

#582

#583

#584

#585

#588

#589

#590

#591

#592

#593

#596

#597

#598

#6

#600

#602

#604

#605

#606

#611

#612

#613

#614

#615

#616

#617

#620

#621

#627

#628

#629

#63

#630

#638

#64

#640

#642

#643

#646

#649

#65

#653

#658

#66

#660

#661

#663

#665

#667

#668

#671

#672

#673

#674

#676

#677

#678

#68

#680

#682

#685

#687

#688

#69

#695

#696

#697

#698

#699

#7

#70

#700

#702

#703

#704

#705

#706

#708

#709

#71

#710

#711

#713

#714

#715

#716

#719

#722

#723

#725

#726

#727

#728

#729

#73

#730

#732

#733

#735

#737

#738

#74

#741

#744

#747

#748

#749

#75

#750

#752

#758

#76

#760

#761

#764

#767

#768

#769

#77

#770

#771

#773

#774

#775

#776

#78

#780

#781

#786

#788

#79

#793

#798

#799

#800

#801

#802

#805

#807

#809

#81

#810

#811

#812

#814

#815

#817

#818

#819

#82

#820

#823

#826

#828

#829

#83

#830

#831

#832

#833

#834

#839

#84

#841

#842

#843

#845

#847

#849

#850

#851

#858

#859

#861

#862

#863

#865

#866

#867

#869

#870

#874

#875

#876

#878

#879

#880

#881

#883

#887

#888

#89

#890

#891

#892

#893

#897

#898

#9

#90

#900

#901

#903

#904

#906

#909

#910

#914

#915

#916

#918

#920

#925

#926

#927

#933

#935

#937

#938

#940

#942

#943

#945

#946

#949

#950

#951

#952

#953

#954

#957

#958

#959

#96

#960

#961

#962

#965

#969

#97

#974

#975

#976

#981

#987

#989

#99

#991

#993

#994

#998

#999

0114dee9f6 Exercise solutions (#237) Sebastian Raschka 2024-06-22 08:30:45 -05:00
b90c7ad2d6 Exercise solutions (#237) Sebastian Raschka 2024-06-22 08:30:45 -05:00
e387742b77 minor markdown fixes (#236) Daniel Kleine 2024-06-21 20:55:34 +02:00
06921f3333 minor markdown fixes (#236) Daniel Kleine 2024-06-21 20:55:34 +02:00
7e0c5c0975 minor fixes (#235) Daniel Kleine 2024-06-21 15:40:54 +02:00
ad9dd994dc minor fixes (#235) Daniel Kleine 2024-06-21 15:40:54 +02:00
7b67302da3 update rasbt 2024-06-21 06:31:31 -05:00
4c2b503785 update rasbt 2024-06-21 06:31:31 -05:00
87deec0f5f Add standalone finetuning and evaluation scripts for chapter 7 (#234) Sebastian Raschka 2024-06-21 05:23:24 -05:00
6c0dc2362b Add standalone finetuning and evaluation scripts for chapter 7 (#234) Sebastian Raschka 2024-06-21 05:23:24 -05:00
e1046746e8 remove redundant line rasbt 2024-06-20 10:12:28 -05:00
6c84900af7 remove redundant line rasbt 2024-06-20 10:12:28 -05:00
cb194fa8fa fix device loading rasbt 2024-06-20 08:07:00 -05:00
977f9c6eac fix device loading rasbt 2024-06-20 08:07:00 -05:00
d440eb17bc Add standalone instruction finetuning script (#233) Sebastian Raschka 2024-06-20 07:37:47 -05:00
8ccca3a882 Add standalone instruction finetuning script (#233) Sebastian Raschka 2024-06-20 07:37:47 -05:00
bebd3f453f example code to use the finetuned model rasbt 2024-06-19 20:21:14 -05:00
c595f3da3f example code to use the finetuned model rasbt 2024-06-19 20:21:14 -05:00
3ba51abf53 consistency rasbt 2024-06-19 19:47:31 -05:00
8773981de0 consistency rasbt 2024-06-19 19:47:31 -05:00
c1f9361428 add main and optional sections rasbt 2024-06-19 17:48:25 -05:00
283397aaf2 add main and optional sections rasbt 2024-06-19 17:48:25 -05:00
eb1da36e98 note about dropout rasbt 2024-06-19 17:37:42 -05:00
85827e0a0b note about dropout rasbt 2024-06-19 17:37:42 -05:00
73be1c592f fixed num_workers (#229) Daniel Kleine 2024-06-20 00:36:46 +02:00
bbb2a0c3d5 fixed num_workers (#229) Daniel Kleine 2024-06-20 00:36:46 +02:00
c935725a26 Add pytest retry for link checks (#228) Sebastian Raschka 2024-06-19 07:37:41 -05:00
24523bd34d Add pytest retry for link checks (#228) Sebastian Raschka 2024-06-19 07:37:41 -05:00
49c77d9724 minor: fixed API name (#227) Daniel Kleine 2024-06-19 14:09:32 +02:00
44cda14494 minor: fixed API name (#227) Daniel Kleine 2024-06-19 14:09:32 +02:00
605ec00a2a Fix some typos in ch07.ipynb (#224) Jinge Wang 2024-06-19 19:14:25 +08:00
8d43b4bfea Fix some typos in ch07.ipynb (#224) Jinge Wang 2024-06-19 19:14:25 +08:00
f4c8bb024c add mps runtime (#223) Sebastian Raschka 2024-06-18 20:58:59 -05:00
1ba1bb4c77 add mps runtime (#223) Sebastian Raschka 2024-06-18 20:58:59 -05:00
b114053378 minor fixes (#222) Daniel Kleine 2024-06-19 02:37:26 +02:00
fba205985d minor fixes (#222) Daniel Kleine 2024-06-19 02:37:26 +02:00
3874c477fa update report template rasbt 2024-06-18 19:21:00 -05:00
b41a2ef570 update report template rasbt 2024-06-18 19:21:00 -05:00
f0d2af06de update report template rasbt 2024-06-18 19:20:45 -05:00
1e0147c4ff update report template rasbt 2024-06-18 19:20:45 -05:00
bd93790de3 remove unknown option from env Sebastian Raschka 2024-06-18 07:52:54 -05:00
44972d64d9 remove unknown option from env Sebastian Raschka 2024-06-18 07:52:54 -05:00
1aa1b44222 Update compute env Sebastian Raschka 2024-06-18 07:51:54 -05:00
368953f89d Update compute env Sebastian Raschka 2024-06-18 07:51:54 -05:00
9f7a8c52d8 select computing env Sebastian Raschka 2024-06-18 07:51:22 -05:00
d7318def52 select computing env Sebastian Raschka 2024-06-18 07:51:22 -05:00
bfe5219366 Update ask-a-question.md Sebastian Raschka 2024-06-18 07:37:28 -05:00
9eb5507764 Update ask-a-question.md Sebastian Raschka 2024-06-18 07:37:28 -05:00
9f1c969a26 update bug report template rasbt 2024-06-18 07:34:43 -05:00
a84f296fa2 update bug report template rasbt 2024-06-18 07:34:43 -05:00
97966efb79 indentation rasbt 2024-06-18 07:11:22 -05:00
39b9b2bf0a indentation rasbt 2024-06-18 07:11:22 -05:00
4a6043d16c update template rasbt 2024-06-18 07:09:47 -05:00
06e4aaa009 update template rasbt 2024-06-18 07:09:47 -05:00
a85ee2759a update template rasbt 2024-06-18 07:08:25 -05:00
8ae509b5e4 update template rasbt 2024-06-18 07:08:25 -05:00
bbe8b4edf7 update template rasbt 2024-06-18 07:07:55 -05:00
b95aaa4a9c update template rasbt 2024-06-18 07:07:55 -05:00
4758b7bd03 Update issue templates Sebastian Raschka 2024-06-18 07:03:55 -05:00
09cb5d92cb Update issue templates Sebastian Raschka 2024-06-18 07:03:55 -05:00
2c326213bb Update year Sebastian Raschka 2024-06-18 05:59:18 -05:00
02ae4b7f40 Update year Sebastian Raschka 2024-06-18 05:59:18 -05:00
8e2c8d0987 Fixed some typos in ch06.ipynb (#219) Jinge Wang 2024-06-18 18:54:01 +08:00
10018e00ff Fixed some typos in ch06.ipynb (#219) Jinge Wang 2024-06-18 18:54:01 +08:00
c8c0fd4fb5 fix spelling rasbt 2024-06-18 05:50:40 -05:00
3e0b0c66a8 fix spelling rasbt 2024-06-18 05:50:40 -05:00
88ad21490c replace figure rasbt 2024-06-18 05:46:36 -05:00
19c5784f82 replace figure rasbt 2024-06-18 05:46:36 -05:00
fde5bea1d9 Update dependency checker (#218) Sebastian Raschka 2024-06-17 21:09:31 -05:00
e3cd400e5f Update dependency checker (#218) Sebastian Raschka 2024-06-17 21:09:31 -05:00
e2f0d936f8 update dotted line rasbt 2024-06-17 20:17:46 -05:00
5d1fbbbfd2 update dotted line rasbt 2024-06-17 20:17:46 -05:00
d74689fc5f dealing with numpy 2.0 (#216) Sebastian Raschka 2024-06-17 10:22:36 -05:00
2a2676e1b2 dealing with numpy 2.0 (#216) Sebastian Raschka 2024-06-17 10:22:36 -05:00
339a7ce040 formating updates rasbt 2024-06-17 07:40:04 -05:00
7b2174b115 formating updates rasbt 2024-06-17 07:40:04 -05:00
0ee9312662 formatting rasbt 2024-06-16 08:27:25 -05:00
f6274117b9 formatting rasbt 2024-06-16 08:27:25 -05:00
232c4f338b Updated ch07 (#213) Sebastian Raschka 2024-06-15 15:10:01 -05:00
aba7ed2eb1 Updated ch07 (#213) Sebastian Raschka 2024-06-15 15:10:01 -05:00
fcf8bcab0d Remove duplicated cell (#212) Sebastian Raschka 2024-06-15 12:48:34 -05:00
7bf70baf10 Remove duplicated cell (#212) Sebastian Raschka 2024-06-15 12:48:34 -05:00
a796b9d657 explain truncation in ch05 rasbt 2024-06-12 19:50:11 -05:00
c6466990bb explain truncation in ch05 rasbt 2024-06-12 19:50:11 -05:00
8fa64806fc dim-consistency rasbt 2024-06-12 19:43:25 -05:00
aaa54b10b3 dim-consistency rasbt 2024-06-12 19:43:25 -05:00
8d3e58ff81 check gpt files (#208) Sebastian Raschka 2024-06-12 07:19:10 -05:00
bcccda728b check gpt files (#208) Sebastian Raschka 2024-06-12 07:19:10 -05:00
e5c3c5ce99 minor bug fixes (#207) Daniel Kleine 2024-06-12 13:27:56 +02:00
ef40f2f9ad minor bug fixes (#207) Daniel Kleine 2024-06-12 13:27:56 +02:00
b2ff989174 distinguish better between main chapter code and bonus materials rasbt 2024-06-11 21:07:42 -05:00
e24fd98cdf distinguish better between main chapter code and bonus materials rasbt 2024-06-11 21:07:42 -05:00
79210eb393 fixes for code (#206) Daniel Kleine 2024-06-12 03:59:48 +02:00
dcbdc1d2e5 fixes for code (#206) Daniel Kleine 2024-06-12 03:59:48 +02:00
e91718f1e7 Add eos token to each response (#205) Sebastian Raschka 2024-06-11 08:57:12 -05:00
1a65020d81 Add eos token to each response (#205) Sebastian Raschka 2024-06-11 08:57:12 -05:00
cbbd4c5600 add performance of llama 3 models for reference rasbt 2024-06-10 18:21:58 -05:00
101f3b949a add performance of llama 3 models for reference rasbt 2024-06-10 18:21:58 -05:00
9a81230968 ch07 fixes (#204) Daniel Kleine 2024-06-11 00:31:13 +02:00
da9f64215a ch07 fixes (#204) Daniel Kleine 2024-06-11 00:31:13 +02:00

... 8 9 10 11 12 ...