books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity
Files
a8b8eb47314cfa78ee84b96ca35ec5ac49fa4d1b
LLMs-from-scratch/ch02/05_bpe-from-scratch/bpe-from-scratch.ipynb
Austin Welch 0f35e370ed fix: preserve newline tokens in BPE encoder (#495) 
* fix: preserve newline tokens in BPE encoder

* further fixes

* more fixes

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-01-21 12:47:15 -06:00

47 KiB
Raw Blame History

View Raw
Reference in New Issue View Git Blame Copy Permalink