books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
906 Commits 12 Branches 0 Tags
a200698698d2b36e533e4f321093cb43a64ff10f
Commit Graph

63 Commits

Author SHA1 Message Date
Sebastian Raschka
b5bd8d2de2 Update Qwen3 tokenizer test (#727) 
* Update Qwen3 tokenizer test

* add tokenizers to dev dependencies

* add tokenizers to dev dependencies
 2025-07-08 06:59:46 -05:00
Martin Ma
ad16b1fbee Fix bug in masking when kv cache is used. (#697) 
* Fix bug in masking when kv cache is used.

* add tests

* dd tests

* upd

* add kv cache test to gh workflow

* explicit mask slicing

* upd

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-06-23 13:12:56 -05:00
Sebastian Raschka
d5eaa36416 Ch06 and Ch07 videos (#613) 
* Ch06 and Ch07 videos

* exclude google scholar from link checking
 2025-04-12 14:51:02 -05:00
Sebastian Raschka
97a199e40b Disable mask saving as weight in Llama 3 model (#604) 
* Disable mask saving as weight

* update pixi

* update pixi
 2025-04-06 09:33:36 -05:00
Sebastian Raschka
4128a91c1d Add Llama 3.2 to pkg (#591) 
* Add Llama 3.2 to pkg

* remove redundant attributes

* update tests

* updates

* updates

* updates

* fix link

* fix link
 2025-03-31 18:59:47 -05:00
Sebastian Raschka
7114ccd10d Add PyPI package (#576) 
* Add PyPI package

* fixes

* fixes
 2025-03-23 19:28:49 -05:00
Sebastian Raschka
6aec412421 Fix BPE bonus materials (#561) 
* Fix BPE bonus materials

* fix bpe implementation

* update

* Add 'Hello, world. Is this-- a test?' test case

* update link to test file

* update path handling

* update path handling

* fix pytest paths
 2025-03-08 17:21:30 -06:00
Sebastian Raschka
b6f9c8956f Add setup video tutorial (#547) 
* Add setup video tutorial

* updated link checks

* updated link checks
 2025-02-26 13:53:22 -06:00
Sebastian Raschka
11801be0e9 Simplify the setup in CI (#542) 
* Simplify the setup in CI

* windows --no-binary option

* windows uv workflow

* add path

* some fixes

* some fixes

* some fixes

* cleanup

* cleanup

* cleanup

* cleanup

* cleanup

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* revert
 2025-02-20 11:56:52 -06:00
Tim Hopper
2254102270 Don't explicitly install Python. Use uv sync instead of uv add. (#540) 
* Don't explicitly install Python. Use uv sync instead of uv add.

* updates

* update

* updated 3.11 workflows

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-02-19 10:42:13 -06:00
rasbt
47030fd8c1 update badges 2025-02-17 12:00:46 -06:00
rasbt
1d1ac0b9a2 update readme badges 2025-02-17 11:49:41 -06:00
Matthew Feickert
bd0484c1be feat: Add pixi environment (#534) 
* feat: Add pixi environment

* Add pixi manifest pixi.toml for Linux x86, macOS arm64, Windows 64.

* ci: Update CI workflow and unify to one

* Enable workflow dispatch.
* Add concurrency limits.
* Use pixi for CI workflow.
* Unify to a single workflow for all OS tested

* feat: Add pixi lock file

* Ensure tensorflow-cpu installed on Windows

* fix package check

* fix package check

* simplification plus uv and pip runners

* some fixes to pixi and pip

* create pixi.lock

* fix pixi.lock issue

* another attempt trying to fix get_packages

* another attempt trying to fix get_packages

* clean up python_environment_check.py

* updated runner and docs

* use bash

* proper env activiation

* proper env activiation

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-02-17 11:33:53 -06:00
Sebastian Raschka
5016499d1d Uv workflow improvements (#531) 
* Uv workflow improvements

* Uv workflow improvements

* linter improvements

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix
 2025-02-16 13:16:51 -06:00
Sebastian Raschka
4ab8719e9d Switch from pip to uv (#529) 
* Replace pip by more modern uv

* uv tests

* update yaml

* update yaml

* update yaml

* update flake8

* update windows commands

* fix windows test

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix
 2025-02-15 13:13:13 -06:00
Sebastian Raschka
9dce43ec31 Upgrade to NumPy 2.0 (#520) 
* Upgrade to NumPy 2.0

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* update

* update packages
 2025-02-09 06:21:58 -06:00
Sebastian Raschka
5efa731c0f Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519) 
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch

* bump pytorch version
 2025-02-06 14:59:52 -06:00
Sebastian Raschka
c1c10c89c8 Test PyTorch nightly releases (#509) 2025-01-30 12:45:48 -06:00
Sebastian Raschka
bb13ff519e Test for PyTorch 2.6 release candidate (#500) 
* Test for PyTorch 2.6 release candidate

* update

* update

* remove extra added file
 2025-01-22 18:37:48 -06:00
Sebastian Raschka
841b64f2b9 Add flexible padding bonus experiment (#438) 
* Add flexible padding bonus experiment

* fix links
 2024-11-15 08:51:01 +09:00
Sebastian Raschka
c4bac22bff Test PyTorch 2.5 (#405) 2024-10-20 10:23:31 -05:00
Sebastian Raschka
35ecca0feb Update check-links.yml 2024-10-11 12:20:49 -05:00
Sebastian Raschka
1715aaacbc Update check-links.yml 2024-10-08 08:38:48 -05:00
Sebastian Raschka
58c3bb3d9d Llama 3 (#384) 
* Implement Llama 3.2

* Add Llama 3.2 files

* exclude IMDB link because stanford website seems down
 2024-10-05 07:52:15 -05:00
Sebastian Raschka
b8497c1bf5 Add llama2 unit tests (#372) 
* add llama2 unit tests

* update

* updates

* updates

* update file path

* update requirements file

* rmsnorm test

* update
 2024-09-25 19:40:36 -05:00
rasbt
53d61d8d94 update link checking 2024-09-15 08:16:23 -05:00
Sebastian Raschka
2c6cdb497f Update matplotlib tests on Windows (#295) 2024-08-04 09:18:19 -05:00
Sebastian Raschka
f66c089f0b Test with PyTorch 2.0 and 2.4 (#290) 
* Test with PyTorch 2.0 and 2.4

* Update basic-tests-old-pytorch.yml

* skip version cell
 2024-07-27 15:09:02 -05:00
Sebastian Raschka
311a3837e4 Gh workflow for spelling errors (#265) 
* Gh workflow for spelling errors

* add files to check
 2024-07-16 08:17:20 -05:00
Daniel Kleine
99058c3d07 minor fixes (#248) 
* removed duplicated numpy req

* labels to array

* autopep8 NBs
 2024-06-26 08:52:51 -05:00
Sebastian Raschka
87deec0f5f Add standalone finetuning and evaluation scripts for chapter 7 (#234) 
* add finetuning and eval scripts

* update link

* update links

* fix link
 2024-06-21 05:23:24 -05:00
Sebastian Raschka
c935725a26 Add pytest retry for link checks (#228) 
* add pytest retry for link checks

* Update .github/workflows/check-links.yml

* newline
 2024-06-19 07:37:41 -05:00
Daniel Kleine
b114053378 minor fixes (#222) 
* fixed labels

* fixed typo

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-06-18 19:37:26 -05:00
rasbt
3874c477fa update report template 2024-06-18 19:21:00 -05:00
Sebastian Raschka
bd93790de3 remove unknown option from env 2024-06-18 07:52:54 -05:00
Sebastian Raschka
1aa1b44222 Update compute env 2024-06-18 07:51:54 -05:00
Sebastian Raschka
9f7a8c52d8 select computing env 2024-06-18 07:51:22 -05:00
Sebastian Raschka
bfe5219366 Update ask-a-question.md 2024-06-18 07:37:28 -05:00
rasbt
9f1c969a26 update bug report template 2024-06-18 07:34:43 -05:00
rasbt
97966efb79 indentation 2024-06-18 07:11:22 -05:00
rasbt
4a6043d16c update template 2024-06-18 07:09:47 -05:00
rasbt
a85ee2759a update template 2024-06-18 07:08:25 -05:00
rasbt
bbe8b4edf7 update template 2024-06-18 07:07:55 -05:00
Sebastian Raschka
4758b7bd03 Update issue templates 2024-06-18 07:03:55 -05:00
Sebastian Raschka
232c4f338b Updated ch07 (#213) 
* Updated ch07

* fix links

* check links
 2024-06-15 15:10:01 -05:00
rasbt
5d48181434 skip platform links 2024-05-25 18:09:19 -05:00
rasbt
c8bcdf5206 fix tests 2024-05-12 19:03:14 -05:00
rasbt
37c33d6fee add chapter 6 unit test 2024-05-12 18:51:28 -05:00
Sebastian Raschka
d088753fca Formatting improvements (#134) 
* formatting improvements

* .yml triggers
 2024-04-28 12:05:32 -05:00
Sebastian Raschka
5ae5e9df3b Try windows runners (#133) 
* try windows runners

* update triggers

* trigger with code file update

* add new status badges
 2024-04-28 07:39:23 -05:00