7 Commits

Author SHA1 Message Date
Sebastian Raschka
a11965fbd9 Remove persistent flag from cache buffers (#916) 2025-11-24 20:10:02 -06:00
Sebastian Raschka
2f53bf5fe5 Link the other KV cache sections (#708) 2025-06-24 16:52:29 -05:00
Martin Ma
6522be94be Fix bug in masking when kv cache is used. (#697)
* Fix bug in masking when kv cache is used.

* add tests

* dd tests

* upd

* add kv cache test to gh workflow

* explicit mask slicing

* upd

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
2025-06-23 13:12:56 -05:00
Shamik
f5bc863752 Update README.md (#702)
Typo in kv cache readme
2025-06-23 07:21:51 -05:00
Sebastian Raschka
ece59ba587 Optimize KV cache (#673)
* Optimize KV cache

* style

* interpretable generate

* interpretable generate

* update readme
2025-06-16 16:00:50 -05:00
Sebastian Raschka
ba0370abd1 Optimized KV cache (#672)
* Optimized KV cache

* typo fix
2025-06-15 14:26:16 -05:00
Sebastian Raschka
2af686d70b Add KV cache (#671) 2025-06-15 09:58:08 -05:00