books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

Update the compression rate comment in MLA (#883)

Browse Source 
* compression comment

* update
This commit is contained in:
Sebastian Raschka
2025-10-14 11:10:06 -05:00
committed by GitHub
parent b969b3ef7a
commit 7fe4874dda
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ch04/05_mla/README.md
View File

@@ -127,7 +127,7 @@ uv run gpt_with_kv_mla.py \
--n_heads 24 \
--n_layers 12 \
--emb_dim 768 \
--latent_dim 192 # 4x compression
--latent_dim 192 # (768×2)/192 = 8× compression
...