books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

Add defensive context trimming for multiturn (#815)

Browse Source 
* Add defensive context trimming for multiturn

* add all mods
This commit is contained in:
Sebastian Raschka
2025-09-09 20:19:00 -05:00
committed by GitHub
parent 215abdbcdd
commit c7a4362ca4
5 changed files with 80 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

1
pkg/llms_from_scratch/kv_cache/generate.py
View File

@@ -3,6 +3,7 @@
# - https://www.manning.com/books/build-a-large-language-model-from-scratch
# Code: https://github.com/rasbt/LLMs-from-scratch
from ..generate import trim_input_tensor # noqa: F401
from .utils import KVCache
import torch