books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

"Typographical error (#104)

Browse Source
This commit is contained in:
Intelligence-Manifesto
2024-04-03 07:07:21 +08:00
committed by GitHub
parent ec4fe5377d
commit 0b47dfc381
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/01_main-chapter-code/ch03.ipynb
View File

@@ -1172,7 +1172,7 @@
"id": "aef0a6b8-205a-45bf-9d26-8fd77a8a03c3",
"metadata": {},
"source": [
"n causal attention, the attention weights above the diagonal are masked, ensuring that for any given input, the LLM is unable to utilize future tokens while calculating the context vectors with the attention weight"
"- In causal attention, the attention weights above the diagonal are masked, ensuring that for any given input, the LLM is unable to utilize future tokens while calculating the context vectors with the attention weight"
]
},
{