books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add simpler BPE, and make previous BPE better (#870)

Browse Source 
* Add simpler BPE, and make previous BPE better

* update

* Update README.md
This commit is contained in:
Sebastian Raschka
2025-10-08 22:22:34 -05:00
committed by GitHub
parent 1164cb3e8f
commit fecfdd16ff
6 changed files with 1223 additions and 122 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
.gitignore vendored
View File

@@ -85,6 +85,8 @@ Qwen3-0.6B/
tokenizer-base.json
tokenizer-reasoning.json
tokenizer.json
config.json
bpe_merges.txt
# Datasets
the-verdict.txt