books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
902 Commits 12 Branches 0 Tags
b5bd8d2de26aff87fbe6c8faa5eaec8f59892ed3
Commit Graph

50 Commits

Author SHA1 Message Date
Sebastian Raschka
b5bd8d2de2 Update Qwen3 tokenizer test (#727) 
* Update Qwen3 tokenizer test

* add tokenizers to dev dependencies

* add tokenizers to dev dependencies
 2025-07-08 06:59:46 -05:00
Martin Ma
ad16b1fbee Fix bug in masking when kv cache is used. (#697) 
* Fix bug in masking when kv cache is used.

* add tests

* dd tests

* upd

* add kv cache test to gh workflow

* explicit mask slicing

* upd

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-06-23 13:12:56 -05:00
Sebastian Raschka
d5eaa36416 Ch06 and Ch07 videos (#613) 
* Ch06 and Ch07 videos

* exclude google scholar from link checking
 2025-04-12 14:51:02 -05:00
Sebastian Raschka
97a199e40b Disable mask saving as weight in Llama 3 model (#604) 
* Disable mask saving as weight

* update pixi

* update pixi
 2025-04-06 09:33:36 -05:00
Sebastian Raschka
4128a91c1d Add Llama 3.2 to pkg (#591) 
* Add Llama 3.2 to pkg

* remove redundant attributes

* update tests

* updates

* updates

* updates

* fix link

* fix link
 2025-03-31 18:59:47 -05:00
Sebastian Raschka
7114ccd10d Add PyPI package (#576) 
* Add PyPI package

* fixes

* fixes
 2025-03-23 19:28:49 -05:00
Sebastian Raschka
6aec412421 Fix BPE bonus materials (#561) 
* Fix BPE bonus materials

* fix bpe implementation

* update

* Add 'Hello, world. Is this-- a test?' test case

* update link to test file

* update path handling

* update path handling

* fix pytest paths
 2025-03-08 17:21:30 -06:00
Sebastian Raschka
b6f9c8956f Add setup video tutorial (#547) 
* Add setup video tutorial

* updated link checks

* updated link checks
 2025-02-26 13:53:22 -06:00
Sebastian Raschka
11801be0e9 Simplify the setup in CI (#542) 
* Simplify the setup in CI

* windows --no-binary option

* windows uv workflow

* add path

* some fixes

* some fixes

* some fixes

* cleanup

* cleanup

* cleanup

* cleanup

* cleanup

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* more windows issues

* revert
 2025-02-20 11:56:52 -06:00
Tim Hopper
2254102270 Don't explicitly install Python. Use uv sync instead of uv add. (#540) 
* Don't explicitly install Python. Use uv sync instead of uv add.

* updates

* update

* updated 3.11 workflows

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-02-19 10:42:13 -06:00
rasbt
47030fd8c1 update badges 2025-02-17 12:00:46 -06:00
rasbt
1d1ac0b9a2 update readme badges 2025-02-17 11:49:41 -06:00
Matthew Feickert
bd0484c1be feat: Add pixi environment (#534) 
* feat: Add pixi environment

* Add pixi manifest pixi.toml for Linux x86, macOS arm64, Windows 64.

* ci: Update CI workflow and unify to one

* Enable workflow dispatch.
* Add concurrency limits.
* Use pixi for CI workflow.
* Unify to a single workflow for all OS tested

* feat: Add pixi lock file

* Ensure tensorflow-cpu installed on Windows

* fix package check

* fix package check

* simplification plus uv and pip runners

* some fixes to pixi and pip

* create pixi.lock

* fix pixi.lock issue

* another attempt trying to fix get_packages

* another attempt trying to fix get_packages

* clean up python_environment_check.py

* updated runner and docs

* use bash

* proper env activiation

* proper env activiation

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
 2025-02-17 11:33:53 -06:00
Sebastian Raschka
5016499d1d Uv workflow improvements (#531) 
* Uv workflow improvements

* Uv workflow improvements

* linter improvements

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* pytproject.toml fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* windows fixes

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix

* win32 fix
 2025-02-16 13:16:51 -06:00
Sebastian Raschka
4ab8719e9d Switch from pip to uv (#529) 
* Replace pip by more modern uv

* uv tests

* update yaml

* update yaml

* update yaml

* update flake8

* update windows commands

* fix windows test

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix

* windows fix
 2025-02-15 13:13:13 -06:00
Sebastian Raschka
9dce43ec31 Upgrade to NumPy 2.0 (#520) 
* Upgrade to NumPy 2.0

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* bump pytorch

* update

* update packages
 2025-02-09 06:21:58 -06:00
Sebastian Raschka
5efa731c0f Mention small discrepancy due to Dropout non-reproducibility in PyTorch (#519) 
* Mention small discrepancy due to Dropout non-reproducibility in PyTorch

* bump pytorch version
 2025-02-06 14:59:52 -06:00
Sebastian Raschka
c1c10c89c8 Test PyTorch nightly releases (#509) 2025-01-30 12:45:48 -06:00
Sebastian Raschka
bb13ff519e Test for PyTorch 2.6 release candidate (#500) 
* Test for PyTorch 2.6 release candidate

* update

* update

* remove extra added file
 2025-01-22 18:37:48 -06:00
Sebastian Raschka
841b64f2b9 Add flexible padding bonus experiment (#438) 
* Add flexible padding bonus experiment

* fix links
 2024-11-15 08:51:01 +09:00
Sebastian Raschka
c4bac22bff Test PyTorch 2.5 (#405) 2024-10-20 10:23:31 -05:00
Sebastian Raschka
35ecca0feb Update check-links.yml 2024-10-11 12:20:49 -05:00
Sebastian Raschka
1715aaacbc Update check-links.yml 2024-10-08 08:38:48 -05:00
Sebastian Raschka
58c3bb3d9d Llama 3 (#384) 
* Implement Llama 3.2

* Add Llama 3.2 files

* exclude IMDB link because stanford website seems down
 2024-10-05 07:52:15 -05:00
Sebastian Raschka
b8497c1bf5 Add llama2 unit tests (#372) 
* add llama2 unit tests

* update

* updates

* updates

* update file path

* update requirements file

* rmsnorm test

* update
 2024-09-25 19:40:36 -05:00
rasbt
53d61d8d94 update link checking 2024-09-15 08:16:23 -05:00
Sebastian Raschka
2c6cdb497f Update matplotlib tests on Windows (#295) 2024-08-04 09:18:19 -05:00
Sebastian Raschka
f66c089f0b Test with PyTorch 2.0 and 2.4 (#290) 
* Test with PyTorch 2.0 and 2.4

* Update basic-tests-old-pytorch.yml

* skip version cell
 2024-07-27 15:09:02 -05:00
Sebastian Raschka
311a3837e4 Gh workflow for spelling errors (#265) 
* Gh workflow for spelling errors

* add files to check
 2024-07-16 08:17:20 -05:00
Sebastian Raschka
87deec0f5f Add standalone finetuning and evaluation scripts for chapter 7 (#234) 
* add finetuning and eval scripts

* update link

* update links

* fix link
 2024-06-21 05:23:24 -05:00
Sebastian Raschka
c935725a26 Add pytest retry for link checks (#228) 
* add pytest retry for link checks

* Update .github/workflows/check-links.yml

* newline
 2024-06-19 07:37:41 -05:00
Sebastian Raschka
232c4f338b Updated ch07 (#213) 
* Updated ch07

* fix links

* check links
 2024-06-15 15:10:01 -05:00
rasbt
5d48181434 skip platform links 2024-05-25 18:09:19 -05:00
rasbt
c8bcdf5206 fix tests 2024-05-12 19:03:14 -05:00
rasbt
37c33d6fee add chapter 6 unit test 2024-05-12 18:51:28 -05:00
Sebastian Raschka
d088753fca Formatting improvements (#134) 
* formatting improvements

* .yml triggers
 2024-04-28 12:05:32 -05:00
Sebastian Raschka
5ae5e9df3b Try windows runners (#133) 
* try windows runners

* update triggers

* trigger with code file update

* add new status badges
 2024-04-28 07:39:23 -05:00
Sebastian Raschka
0f03c20483 Data loader intuition with numbers (#132) 
* data loader intuition with numbers

* fix link

* fix tests
 2024-04-27 07:56:41 -05:00
rasbt
6aa58ee2a9 shorten badge names 2024-04-14 12:41:23 -05:00
Sebastian Raschka
bbce1cb143 Automated link checking (#117) 
* Automated link checking

* Fix links in Jupyter Nbs
 2024-04-12 19:08:34 -04:00
Sebastian Raschka
d1a4157d71 improve check-links.yml 2024-04-11 17:23:15 -04:00
Sebastian Raschka
790d0808b2 Organized setup instructions (#115) 
* Organized setup instructions

* update tets

* link checker action

* raise error upon broken link

* fix links

* fix links

* delete duplicated paragraph
 2024-04-10 22:09:46 -04:00
Daniel Kleine
a6bd197897 updated github actions versions (#96) 
* added status badges

* updated github actions versions

* Update README.md

* Update README.md

---------

Co-authored-by: Sebastian Raschka <mail@sebastianraschka.com>
 2024-03-31 10:49:12 -05:00
Sebastian Raschka
a2cd8436cb Ch05 supplementary code (#81) 2024-03-19 09:26:26 -05:00
Sebastian Raschka
ca96abac8a Set up basic test gh worklows (#79) 
* Set up basic test gh worklows

* update file paths

* env check

* add env check

* Update requirements.txt

* simplify

* upd
 2024-03-18 11:58:37 -05:00
Sebastian Raschka
e316cafd9f Update pep8-linter.yml 2024-03-18 08:16:08 -05:00
Sebastian Raschka
3e122fa656 Update pep8-linter.yml 2024-03-18 07:57:17 -05:00
Sebastian Raschka
805e352737 Update pep8-linter.yml 2024-03-18 07:47:30 -05:00
Sebastian Raschka
9acb589650 Update pep8-linter.yml 2024-03-18 07:41:23 -05:00
Sebastian Raschka
e213a0cede Create pep8-linter.yml 2024-03-18 07:00:28 -05:00