LLMs-from-scratch

books/LLMs-from-scratch

Fork 0

mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Commit Graph

Select branches

Hide Pull Requests

cleaning

debug-exclude-newer

dockerfile

fix-qwen3-tokeniizer-eos

fix_masking_kv_cache

gemma-3

head-dim

main

qwen-tokenizer-fix

requirements-update

uv-improvements

weezymatt-bugfix/semantic-error

#1

#10

#100

#1000

#1003

#1004

#1004

#101

#102

#104

#105

#106

#107

#109

#110

#111

#113

#115

#116

#117

#118

#119

#12

#120

#121

#122

#124

#125

#127

#128

#13

#131

#132

#133

#134

#135

#136

#137

#138

#139

#14

#141

#142

#143

#144

#149

#151

#152

#153

#154

#156

#157

#158

#159

#160

#161

#162

#163

#164

#165

#166

#169

#17

#170

#171

#173

#174

#176

#177

#178

#179

#18

#180

#182

#183

#184

#187

#189

#19

#193

#195

#196

#197

#198

#199

#2

#20

#200

#201

#203

#204

#205

#206

#207

#208

#211

#212

#213

#216

#218

#219

#22

#222

#223

#224

#227

#228

#229

#233

#234

#235

#236

#237

#239

#24

#240

#241

#242

#243

#244

#245

#246

#247

#248

#250

#252

#253

#254

#258

#259

#26

#260

#261

#263

#264

#265

#269

#27

#270

#274

#278

#28

#281

#285

#288

#289

#29

#290

#291

#294

#295

#297

#298

#3

#300

#301

#303

#304

#305

#307

#31

#313

#314

#318

#319

#32

#320

#321

#323

#324

#325

#329

#33

#333

#335

#336

#337

#339

#344

#345

#346

#349

#352

#353

#356

#36

#360

#361

#366

#367

#368

#369

#37

#372

#373

#375

#376

#378

#38

#380

#381

#383

#384

#386

#388

#389

#39

#391

#393

#395

#396

#397

#398

#4

#400

#401

#403

#404

#405

#406

#407

#408

#412

#413

#414

#419

#420

#421

#423

#427

#432

#436

#437

#438

#439

#441

#451

#458

#461

#465

#465

#466

#468

#469

#470

#471

#473

#479

#481

#483

#484

#487

#492

#495

#496

#498

#5

#50

#500

#504

#506

#507

#509

#511

#512

#516

#518

#519

#52

#520

#521

#522

#523

#524

#525

#526

#529

#530

#531

#533

#534

#535

#536

#537

#539

#54

#540

#541

#542

#543

#544

#545

#546

#547

#549

#55

#550

#551

#553

#555

#557

#56

#560

#561

#562

#563

#565

#571

#572

#573

#574

#575

#576

#577

#578

#581

#582

#583

#584

#585

#588

#589

#590

#591

#592

#593

#596

#597

#598

#6

#600

#602

#604

#605

#606

#611

#612

#613

#614

#615

#616

#617

#620

#621

#627

#628

#629

#63

#630

#638

#64

#640

#642

#643

#646

#649

#65

#653

#658

#66

#660

#661

#663

#665

#667

#668

#671

#672

#673

#674

#676

#677

#678

#68

#680

#682

#685

#687

#688

#69

#695

#696

#697

#698

#699

#7

#70

#700

#702

#703

#704

#705

#706

#708

#709

#71

#710

#711

#713

#714

#715

#716

#719

#722

#723

#725

#726

#727

#728

#729

#73

#730

#732

#733

#735

#737

#738

#74

#741

#744

#747

#748

#749

#75

#750

#752

#758

#76

#760

#761

#764

#767

#768

#769

#77

#770

#771

#773

#774

#775

#776

#78

#780

#781

#786

#788

#79

#793

#798

#799

#800

#801

#802

#805

#807

#809

#81

#810

#811

#812

#814

#815

#817

#818

#819

#82

#820

#823

#826

#828

#829

#83

#830

#831

#832

#833

#834

#839

#84

#841

#842

#843

#845

#847

#849

#850

#851

#858

#859

#861

#862

#863

#865

#866

#867

#869

#870

#874

#875

#876

#878

#879

#880

#881

#883

#887

#888

#89

#890

#891

#892

#893

#897

#898

#9

#90

#900

#901

#903

#904

#906

#909

#910

#914

#915

#916

#918

#920

#925

#926

#927

#933

#935

#937

#938

#940

#942

#943

#945

#946

#949

#950

#951

#952

#953

#954

#957

#958

#959

#96

#960

#961

#962

#965

#969

#97

#974

#975

#976

#981

#987

#989

#99

#991

#993

#994

#998

#999

a0adf0d5d3 basepath rasbt 2024-05-12 09:27:38 -05:00
188d3cd262 basepath rasbt 2024-05-12 09:27:38 -05:00
913662ebeb basepath rasbt 2024-05-12 09:25:56 -05:00
a733a7eb42 basepath rasbt 2024-05-12 09:25:56 -05:00
98c0723b3d update dataset naming rasbt 2024-05-12 09:22:42 -05:00
2e47a6e61c update dataset naming rasbt 2024-05-12 09:22:42 -05:00
beeaf323f1 rename download_and_unzip to make it more specific rasbt 2024-05-12 08:36:24 -05:00
55c3a91838 rename download_and_unzip to make it more specific rasbt 2024-05-12 08:36:24 -05:00
49306b271f add header Sebastian Raschka 2024-05-11 14:37:21 -05:00
58c591c0e0 add header Sebastian Raschka 2024-05-11 14:37:21 -05:00
84edcfaf43 use spam / not spam labels rasbt 2024-05-11 13:42:18 -05:00
4b4e1e1ad5 use spam / not spam labels rasbt 2024-05-11 13:42:18 -05:00
7b34833ee1 fix 1024 characters to 1024 tokens (#152) speed 2024-05-12 03:17:07 +09:00
45f6e72f40 fix 1024 characters to 1024 tokens (#152) speed 2024-05-12 03:17:07 +09:00
c94f24e759 reorder section 6.6 rasbt 2024-05-11 08:27:07 -05:00
02ad1bef3a reorder section 6.6 rasbt 2024-05-11 08:27:07 -05:00
db29f5c685 explain how class labels are obtained rasbt 2024-05-11 07:42:13 -05:00
694a57a472 explain how class labels are obtained rasbt 2024-05-11 07:42:13 -05:00
03d3b6ca72 Update README.md Sebastian Raschka 2024-05-11 06:42:05 -05:00
6fe8d1a10e Update README.md Sebastian Raschka 2024-05-11 06:42:05 -05:00
cf299777b6 Move GPU column so that test accuracy is always visible Sebastian Raschka 2024-05-11 06:41:25 -05:00
a3e1fa35f5 Move GPU column so that test accuracy is always visible Sebastian Raschka 2024-05-11 06:41:25 -05:00
cfa1d0f997 Add LoRA experiments (#151) Sebastian Raschka 2024-05-10 07:26:41 -05:00
41288a3d3a Add LoRA experiments (#151) Sebastian Raschka 2024-05-10 07:26:41 -05:00
774974de97 6 -> 4 rasbt 2024-05-10 07:02:14 -05:00
51ac283257 6 -> 4 rasbt 2024-05-10 07:02:14 -05:00
d8de9377de Merge branch 'main' of https://github.com/rasbt/LLMs-from-scratch rasbt 2024-05-10 06:45:14 -05:00
ca84d797a7 Merge branch 'main' of https://github.com/rasbt/LLMs-from-scratch rasbt 2024-05-10 06:45:14 -05:00
216dd010f6 fix punctuation and improve explanation Sebastian Raschka 2024-05-09 21:15:09 -05:00
b67ef1a2b2 fix punctuation and improve explanation Sebastian Raschka 2024-05-09 21:15:09 -05:00
dadd0f7ea3 clarify overfitting rasbt 2024-05-09 09:09:26 -05:00
0b6665939b clarify overfitting rasbt 2024-05-09 09:09:26 -05:00
2b3d86fe9a Merge branch 'main' of https://github.com/rasbt/LLMs-from-scratch rasbt 2024-05-09 08:17:43 -05:00
037aab0959 Merge branch 'main' of https://github.com/rasbt/LLMs-from-scratch rasbt 2024-05-09 08:17:43 -05:00
ad200a4f3f experiments with largest model (#149) Sebastian Raschka 2024-05-09 07:48:56 -05:00
86cf5878fd experiments with largest model (#149) Sebastian Raschka 2024-05-09 07:48:56 -05:00
75545e4c1b experiments with largest model rasbt 2024-05-09 07:40:09 -05:00
756ff780de experiments with largest model rasbt 2024-05-09 07:40:09 -05:00
1638dc8b7f spelling improvements rasbt 2024-05-09 07:25:52 -05:00
2df81f59d3 spelling improvements rasbt 2024-05-09 07:25:52 -05:00
1e34f5a429 add note about worker number rasbt 2024-05-08 21:20:43 -05:00
80cd98884e add note about worker number rasbt 2024-05-08 21:20:43 -05:00
1e7d1f3bcb update figure 6.6 rasbt 2024-05-08 20:46:54 -05:00
10d3370f74 update figure 6.6 rasbt 2024-05-08 20:46:54 -05:00
a31d571625 text -> dataset rasbt 2024-05-08 08:14:03 -05:00
a09a70c345 text -> dataset rasbt 2024-05-08 08:14:03 -05:00
6cc9cf9f4e make spam spelling consistent rasbt 2024-05-08 06:48:28 -05:00
24e9110fa8 make spam spelling consistent rasbt 2024-05-08 06:48:28 -05:00
41ff2ae4c7 Explain hardware requirements Sebastian Raschka 2024-05-07 20:47:06 -05:00
9682b0e22d Explain hardware requirements Sebastian Raschka 2024-05-07 20:47:06 -05:00
7f841611df fix sentence rasbt 2024-05-07 07:05:47 -05:00
68c33a64e6 fix sentence rasbt 2024-05-07 07:05:47 -05:00
d0d79103d5 add additional lora figure rasbt 2024-05-07 07:04:35 -05:00
d18f92fa34 add additional lora figure rasbt 2024-05-07 07:04:35 -05:00
73c29fd9db spelling fix rasbt 2024-05-07 06:46:33 -05:00
c93c90eb1e spelling fix rasbt 2024-05-07 06:46:33 -05:00
85050ace50 spelling and consistency improvements rasbt 2024-05-06 21:02:13 -05:00
e99c511721 spelling and consistency improvements rasbt 2024-05-06 21:02:13 -05:00
7082ecac80 formatting improvements rasbt 2024-05-06 20:35:51 -05:00
0dd80359df formatting improvements rasbt 2024-05-06 20:35:51 -05:00
0448162fdc show downloads rasbt 2024-05-06 07:40:09 -05:00
16e276f8df show downloads rasbt 2024-05-06 07:40:09 -05:00
78829f28e9 tokenizing example rasbt 2024-05-06 07:16:40 -05:00
cddcbc8b49 tokenizing example rasbt 2024-05-06 07:16:40 -05:00
15d6f29cf8 ch06 csv rasbt 2024-05-06 07:16:30 -05:00
258dcad5ee ch06 csv rasbt 2024-05-06 07:16:30 -05:00
c6528ede9e ch06 dataset rasbt 2024-05-06 06:55:56 -05:00
83d5cea795 ch06 dataset rasbt 2024-05-06 06:55:56 -05:00
e574d04eba classfication -> classification rasbt 2024-05-06 06:50:38 -05:00
8d78098dfa classfication -> classification rasbt 2024-05-06 06:50:38 -05:00
9457676640 ouput -> output rasbt 2024-05-05 12:21:10 -05:00
6f486460bc ouput -> output rasbt 2024-05-05 12:21:10 -05:00
d361cef65f Update ch06.ipynb (#143) Ikko Eltociear Ashimine 2024-05-06 02:18:20 +09:00
b3215e3351 Update ch06.ipynb (#143) Ikko Eltociear Ashimine 2024-05-06 02:18:20 +09:00
dd31946b2a Appendix E: Parameter-efficient Finetuning with LoRA (#142) Sebastian Raschka 2024-05-05 12:05:17 -05:00
978ef48ccc Appendix E: Parameter-efficient Finetuning with LoRA (#142) Sebastian Raschka 2024-05-05 12:05:17 -05:00
a63b0f626c make code more general for larger models rasbt 2024-05-05 10:18:40 -05:00
3a632323df make code more general for larger models rasbt 2024-05-05 10:18:40 -05:00
3328b29521 cosmetics Sebastian Raschka 2024-05-05 08:15:46 -05:00
2e9d5acb5e cosmetics Sebastian Raschka 2024-05-05 08:15:46 -05:00
244593ce01 add text-to-token-id fn rasbt 2024-05-05 08:05:20 -05:00
e9bdbf0725 add text-to-token-id fn rasbt 2024-05-05 08:05:20 -05:00
c6fcadb087 Add figures for ch06 (#141) Sebastian Raschka 2024-05-05 07:10:04 -05:00
d3201f5aad Add figures for ch06 (#141) Sebastian Raschka 2024-05-05 07:10:04 -05:00
f917fc76fe update link rasbt 2024-05-04 08:08:58 -05:00
b8324061d0 update link rasbt 2024-05-04 08:08:58 -05:00
2c06f824aa table-update rasbt 2024-05-04 07:58:18 -05:00
dddf87296e table-update rasbt 2024-05-04 07:58:18 -05:00
97106950c1 add description rasbt 2024-05-04 07:34:29 -05:00
d60dcc6724 add description rasbt 2024-05-04 07:34:29 -05:00
004b0614fc Ch06 draft (#138) Sebastian Raschka 2024-05-03 08:37:58 -05:00
da61d5b76a Ch06 draft (#138) Sebastian Raschka 2024-05-03 08:37:58 -05:00
9e149417b2 fix swiglu acronym rasbt 2024-05-01 20:26:17 -05:00
c735c21e87 fix swiglu acronym rasbt 2024-05-01 20:26:17 -05:00
bb59cbc525 link formatting rasbt 2024-04-30 06:26:23 -05:00
aec169dc12 link formatting rasbt 2024-04-30 06:26:23 -05:00
c5886b7865 Merge branch 'main' of https://github.com/rasbt/LLMs-from-scratch rasbt 2024-04-30 06:25:37 -05:00
d249960bdc Merge branch 'main' of https://github.com/rasbt/LLMs-from-scratch rasbt 2024-04-30 06:25:37 -05:00
8d84800bcf use training set len (#137) Sebastian Raschka 2024-04-29 21:56:05 -05:00
82d6bd47a4 use training set len (#137) Sebastian Raschka 2024-04-29 21:56:05 -05:00

... 12 13 14 15 16 ...