talentJay-ux d7f178d28b Sliding window KV Cache bug fix (#925) ...

1. Fix bug because of KV cache and GPT's ptr pointer doesn't get reset when window_size > context_length
2. Fix bug because of KV cache and GPT's ptr pointer doesn't get reset
3. Fix KV Cache import issue for gpt_with_kv_cache_optimized

2025-12-15 18:47:01 -06:00

5.9 KiB

Raw Permalink Blame History

View Raw