Files
LLMs-from-scratch/ch02
Suman Debnath 2cdcf68598 fixing the regular expression used in the SimpleTokenizer (#259)
* fixing the regular expression used in the SimpleTokenizer class and a typo in the 2.7 Creating token embedding introduction section

* rerun

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2024-07-04 12:27:27 -05:00
..

Chapter 2: Working with Text Data

Main Chapter Code

Bonus Materials

  • 02_bonus_bytepair-encoder contains optional code to benchmark different byte pair encoder implementations

  • 03_bonus_embedding-vs-matmul contains optional (bonus) code to explain that embedding layers and fully connected layers applied to one-hot encoded vectors are equivalent.