books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

"Typographical error (#104)

Browse Source
This commit is contained in:
Intelligence-Manifesto
2024-04-03 07:07:21 +08:00
committed by GitHub
parent 7b7d23a4e1
commit 96b1fde3f1
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/01_main-chapter-code/ch03.ipynb
View File

@@ -1172,7 +1172,7 @@
"id": "aef0a6b8-205a-45bf-9d26-8fd77a8a03c3",
"metadata": {},
"source": [
"n causal attention, the attention weights above the diagonal are masked, ensuring that for any given input, the LLM is unable to utilize future tokens while calculating the context vectors with the attention weight"
"- In causal attention, the attention weights above the diagonal are masked, ensuring that for any given input, the LLM is unable to utilize future tokens while calculating the context vectors with the attention weight"
]
},
{