LLMs-from-scratch

books/LLMs-from-scratch

Fork 0

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Commit Graph

Select branches

Hide Pull Requests

cleaning

debug-exclude-newer

dockerfile

fix-qwen3-tokeniizer-eos

fix_masking_kv_cache

gemma-3

head-dim

main

qwen-tokenizer-fix

requirements-update

uv-improvements

weezymatt-bugfix/semantic-error

#1

#10

#100

#1000

#1003

#1004

#1004

#101

#102

#104

#105

#106

#107

#109

#110

#111

#113

#115

#116

#117

#118

#119

#12

#120

#121

#122

#124

#125

#127

#128

#13

#131

#132

#133

#134

#135

#136

#137

#138

#139

#14

#141

#142

#143

#144

#149

#151

#152

#153

#154

#156

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#169

#17

#170

#171

#173

#174

#176

#177

#178

#179

#18

#180

#182

#183

#184

#187

#189

#19

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#203

#204

#205

#206

#207

#208

#211

#212

#213

#216

#218

#219

#22

#222

#223

#224

#227

#228

#229

#233

#234

#235

#236

#237

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#250

#252

#253

#254

#258

#259

#26

#260

#261

#263

#264

#265

#269

#27

#270

#274

#278

#28

#281

#285

#288

#289

#29

#290

#291

#294

#295

#297

#298

#3

#300

#301

#303

#304

#305

#307

#31

#313

#314

#318

#319

#32

#320

#321

#323

#324

#325

#329

#33

#333

#335

#336

#337

#339

#344

#345

#346

#349

#352

#353

#356

#36

#360

#361

#366

#367

#368

#369

#37

#372

#373

#375

#376

#378

#38

#380

#381

#383

#384

#386

#388

#389

#39

#391

#393

#395

#396

#397

#398

#4

#400

#401

#403

#404

#405

#406

#407

#408

#412

#413

#414

#419

#420

#421

#423

#427

#432

#436

#437

#438

#439

#441

#451

#458

#461

#465

#465

#466

#468

#469

#470

#471

#473

#479

#481

#483

#484

#487

#492

#495

#496

#498

#5

#50

#500

#504

#506

#507

#509

#511

#512

#516

#518

#519

#52

#520

#521

#522

#523

#524

#525

#526

#529

#530

#531

#533

#534

#535

#536

#537

#539

#54

#540

#541

#542

#543

#544

#545

#546

#547

#549

#55

#550

#551

#553

#555

#557

#56

#560

#561

#562

#563

#565

#571

#572

#573

#574

#575

#576

#577

#578

#581

#582

#583

#584

#585

#588

#589

#590

#591

#592

#593

#596

#597

#598

#6

#600

#602

#604

#605

#606

#611

#612

#613

#614

#615

#616

#617

#620

#621

#627

#628

#629

#63

#630

#638

#64

#640

#642

#643

#646

#649

#65

#653

#658

#66

#660

#661

#663

#665

#667

#668

#671

#672

#673

#674

#676

#677

#678

#68

#680

#682

#685

#687

#688

#69

#695

#696

#697

#698

#699

#7

#70

#700

#702

#703

#704

#705

#706

#708

#709

#71

#710

#711

#713

#714

#715

#716

#719

#722

#723

#725

#726

#727

#728

#729

#73

#730

#732

#733

#735

#737

#738

#74

#741

#744

#747

#748

#749

#75

#750

#752

#758

#76

#760

#761

#764

#767

#768

#769

#77

#770

#771

#773

#774

#775

#776

#78

#780

#781

#786

#788

#79

#793

#798

#799

#800

#801

#802

#805

#807

#809

#81

#810

#811

#812

#814

#815

#817

#818

#819

#82

#820

#823

#826

#828

#829

#83

#830

#831

#832

#833

#834

#839

#84

#841

#842

#843

#845

#847

#849

#850

#851

#858

#859

#861

#862

#863

#865

#866

#867

#869

#870

#874

#875

#876

#878

#879

#880

#881

#883

#887

#888

#89

#890

#891

#892

#893

#897

#898

#9

#90

#900

#901

#903

#904

#906

#909

#910

#914

#915

#916

#918

#920

#925

#926

#927

#933

#935

#937

#938

#940

#942

#943

#945

#946

#949

#950

#951

#952

#953

#954

#957

#958

#959

#96

#960

#961

#962

#965

#969

#97

#974

#975

#976

#981

#987

#989

#99

#991

#993

#994

#998

#999

835832a0f9 move access token to config.json rasbt 2024-09-23 08:56:16 -05:00
6bc3de165c move access token to config.json rasbt 2024-09-23 08:56:16 -05:00
5e6c7230ac add llama3 comparison rasbt 2024-09-23 08:17:10 -05:00
58df945ed4 add llama3 comparison rasbt 2024-09-23 08:17:10 -05:00
c38b003aa9 GPT to Llama (#368) Sebastian Raschka 2024-09-23 05:34:06 -07:00
0467c8289b GPT to Llama (#368) Sebastian Raschka 2024-09-23 05:34:06 -07:00
7e35370518 note about random numbers rasbt 2024-09-22 12:02:03 -05:00
dc1b1a05b0 note about random numbers rasbt 2024-09-22 12:02:03 -05:00
9bc5a7dd65 removed unnecessary imports (#367) Daniel Kleine 2024-09-22 18:59:37 +02:00
5f36d2af4c removed unnecessary imports (#367) Daniel Kleine 2024-09-22 18:59:37 +02:00
7a9a17608d Add user interface to ch06 and ch07 (#366) Sebastian Raschka 2024-09-21 18:33:00 -07:00
76e9a9ec02 Add user interface to ch06 and ch07 (#366) Sebastian Raschka 2024-09-21 18:33:00 -07:00
0f395921d7 remove unused function from user interface rasbt 2024-09-21 14:17:35 -05:00
6f6dfb6796 remove unused function from user interface rasbt 2024-09-21 14:17:35 -05:00
081676d8dd Add missing bullet point Sebastian Raschka 2024-09-21 12:59:12 -05:00
52ee1c7cdb Add missing bullet point Sebastian Raschka 2024-09-21 12:59:12 -05:00
2aa964765e update gpt-2 paper url Sebastian Raschka 2024-09-20 07:00:06 -07:00
222f7b16f8 update gpt-2 paper url Sebastian Raschka 2024-09-20 07:00:06 -07:00
92ad9570e4 Chainlit bonus material fixes (#361) Daniel Kleine 2024-09-18 17:08:50 +02:00
eefe4bf12b Chainlit bonus material fixes (#361) Daniel Kleine 2024-09-18 17:08:50 +02:00
1bc560fb13 Add chatpgpt-like user interface (#360) Sebastian Raschka 2024-09-17 08:26:44 -05:00
ea9b4e83a4 Add chatpgpt-like user interface (#360) Sebastian Raschka 2024-09-17 08:26:44 -05:00
53d61d8d94 update link checking rasbt 2024-09-15 08:16:23 -05:00
b4f72812ed update link checking rasbt 2024-09-15 08:16:23 -05:00
79ba591fbc Clarify API usage limits in bonus content rasbt 2024-09-15 08:05:04 -05:00
6110858d5b Clarify API usage limits in bonus content rasbt 2024-09-15 08:05:04 -05:00
a72b5079e3 improved .vscode setup instructions (#353) Daniel Kleine 2024-09-15 14:43:43 +02:00
cc0c28dbf5 improved .vscode setup instructions (#353) Daniel Kleine 2024-09-15 14:43:43 +02:00
0dbc203f66 Fix 2 typos in 04_preferene-tuning-with-dpo (#356) Jinge Wang 2024-09-15 20:36:22 +08:00
4210386cec Fix 2 typos in 04_preferene-tuning-with-dpo (#356) Jinge Wang 2024-09-15 20:36:22 +08:00
adbcf8c7b6 update setup guide rasbt 2024-09-13 08:16:53 -05:00
962dc6f5de update setup guide rasbt 2024-09-13 08:16:53 -05:00
21e6971b11 Run generate example in ch06 optionally on GPU (#352) Mingyuan Xu 2024-09-13 21:01:52 +08:00
f77c376b05 Run generate example in ch06 optionally on GPU (#352) Mingyuan Xu 2024-09-13 21:01:52 +08:00
0da32f3976 Clarify extension instalation rasbt 2024-09-12 07:59:10 -05:00
6f92909e58 Clarify extension instalation rasbt 2024-09-12 07:59:10 -05:00
58f0872013 Simplify conda section Sebastian Raschka 2024-09-11 21:17:59 -05:00
11f97a13b6 Simplify conda section Sebastian Raschka 2024-09-11 21:17:59 -05:00
3b9592830d clarifications rasbt 2024-09-11 20:16:35 -05:00
f1accdf273 clarifications rasbt 2024-09-11 20:16:35 -05:00
435f153dac update title rasbt 2024-09-10 21:43:32 -05:00
fe2136e7c9 update title rasbt 2024-09-10 21:43:32 -05:00
f6f9825098 reflection-tuning dataset generation (#349) Sebastian Raschka 2024-09-10 21:42:12 -05:00
835ed29dbf reflection-tuning dataset generation (#349) Sebastian Raschka 2024-09-10 21:42:12 -05:00
f57088285b update gpt-2 paper link rasbt 2024-09-09 06:31:28 -05:00
8ad50a3315 update gpt-2 paper link rasbt 2024-09-09 06:31:28 -05:00
e105df0ced update gpt-2 paper link rasbt 2024-09-08 15:49:44 -05:00
1e48c13e89 update gpt-2 paper link rasbt 2024-09-08 15:49:44 -05:00
3cebcce639 minor spelling fix rasbt 2024-09-08 15:35:31 -05:00
b94546aa14 minor spelling fix rasbt 2024-09-08 15:35:31 -05:00
9674e62166 nbviewer links / typo (#346) Daniel Kleine 2024-09-07 07:27:28 +02:00
2ee3df622e nbviewer links / typo (#346) Daniel Kleine 2024-09-07 07:27:28 +02:00
9bb203b1b7 Einsum multi-head attention (#345) Sebastian Raschka 2024-09-05 18:24:33 +02:00
ad12c8da06 Einsum multi-head attention (#345) Sebastian Raschka 2024-09-05 18:24:33 +02:00
190910e3d6 updating REAMDE from chapter 02 inclund 04_bonus section (#344) Gustavo Monti 2024-09-05 03:09:46 -03:00
34e16991bb updating REAMDE from chapter 02 inclund 04_bonus section (#344) Gustavo Monti 2024-09-05 03:09:46 -03:00
e8b29c886a Revert nbviewer links Sebastian Raschka 2024-09-05 08:09:33 +02:00
91db4e3a0f Revert nbviewer links Sebastian Raschka 2024-09-05 08:09:33 +02:00
be31eaf418 consistent header for appendix E rasbt 2024-08-30 08:07:54 +02:00
9de277421e consistent header for appendix E rasbt 2024-08-30 08:07:54 +02:00
de9ec16570 use nbviewer links (#339) Sebastian Raschka 2024-08-29 09:09:10 +02:00
d391796ec2 use nbviewer links (#339) Sebastian Raschka 2024-08-29 09:09:10 +02:00
ce80a192cd refresh figures rasbt 2024-08-27 08:26:40 +02:00
3760adbd3d refresh figures rasbt 2024-08-27 08:26:40 +02:00
95926535f8 ch06/03 fixes (#336) Daniel Kleine 2024-08-27 08:23:25 +02:00
c7267c3b09 ch06/03 fixes (#336) Daniel Kleine 2024-08-27 08:23:25 +02:00
8eb6fc0ad0 sklearn baseline and roberta-large update rasbt 2024-08-26 10:31:54 +02:00
91cdfe3309 sklearn baseline and roberta-large update rasbt 2024-08-26 10:31:54 +02:00
5acab58d41 add RoBERTa and params frozen (#335) TITC 2024-08-26 16:27:09 +08:00
4f791e6cc2 add RoBERTa and params frozen (#335) TITC 2024-08-26 16:27:09 +08:00
12655594d5 Update README.md Sebastian Raschka 2024-08-24 07:22:18 -05:00
26f94876f7 Update README.md Sebastian Raschka 2024-08-24 07:22:18 -05:00
296a91afb8 add BERT experiment results (#333) Sebastian Raschka 2024-08-23 08:40:40 -05:00
564362044a add BERT experiment results (#333) Sebastian Raschka 2024-08-23 08:40:40 -05:00
7cbfe418bf grammar fix Sebastian Raschka 2024-08-21 19:16:21 -05:00
ed257789a4 grammar fix Sebastian Raschka 2024-08-21 19:16:21 -05:00
092b5b5429 topk comment Sebastian Raschka 2024-08-20 20:44:15 -05:00
c2117ca073 topk comment Sebastian Raschka 2024-08-20 20:44:15 -05:00
f4e45a3f40 add note about duplicated cell rasbt 2024-08-19 21:04:18 -05:00
9f0bda7af5 add note about duplicated cell rasbt 2024-08-19 21:04:18 -05:00
11e2f56af5 Note about MPS devices (#329) Sebastian Raschka 2024-08-19 20:58:45 -05:00
01cb137bfd Note about MPS devices (#329) Sebastian Raschka 2024-08-19 20:58:45 -05:00
a82169290e Note about MPS in ch06 and ch07 (#325) Sebastian Raschka 2024-08-19 08:11:33 -05:00
c443035d56 Note about MPS in ch06 and ch07 (#325) Sebastian Raschka 2024-08-19 08:11:33 -05:00
0991c1ff24 Note about ch05 mps support (#324) Sebastian Raschka 2024-08-19 07:40:24 -05:00
8ef5022511 Note about ch05 mps support (#324) Sebastian Raschka 2024-08-19 07:40:24 -05:00
1a962f3983 update lora experiments rasbt 2024-08-16 08:57:46 -05:00
e7cb2ebd8d update lora experiments rasbt 2024-08-16 08:57:46 -05:00
742525cb28 remove redundant indentation rasbt 2024-08-16 07:53:49 -05:00
b2858a91c5 remove redundant indentation rasbt 2024-08-16 07:53:49 -05:00
70a7cddf9c typo fix (#323) TITC 2024-08-16 19:57:30 +08:00
d2befdf00e typo fix (#323) TITC 2024-08-16 19:57:30 +08:00
e1072bbcd6 typo fix (#321) TITC 2024-08-15 21:45:34 +08:00
f6526f7766 typo fix (#321) TITC 2024-08-15 21:45:34 +08:00
e4cfcc5b66 Update README.md Sebastian Raschka 2024-08-15 08:22:47 -05:00
4ea526908e Update README.md Sebastian Raschka 2024-08-15 08:22:47 -05:00
bf1d8687f4 added std error bars (#320) Daniel Kleine 2024-08-14 03:57:41 +02:00
c65928f7dc added std error bars (#320) Daniel Kleine 2024-08-14 03:57:41 +02:00
bb73efb5cf Consistency update in README.md Sebastian Raschka 2024-08-13 07:33:10 -05:00
9713e70a20 Consistency update in README.md Sebastian Raschka 2024-08-13 07:33:10 -05:00

... 5 6 7 8 9 ...