books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

Merge pull request #71 from Intelligence-Manifesto/patch-6

Browse Source 
the above -> the following
This commit is contained in:
Sebastian Raschka
2024-03-15 16:07:22 -05:00
committed by GitHub
parent ee8efcbcf6 d4b4e3d0f0
commit 44b0febe68
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/01_main-chapter-code/ch03.ipynb
View File

@@ -1734,7 +1734,7 @@
"source": [
"- In this case, the matrix multiplication implementation in PyTorch will handle the 4-dimensional input tensor so that the matrix multiplication is carried out between the 2 last dimensions (num_tokens, head_dim) and then repeated for the individual heads. \n",
"\n",
"- For instance, the above becomes a more compact way to compute the matrix multiplication for each head separately:"
"- For instance, the following becomes a more compact way to compute the matrix multiplication for each head separately:"
]
},
{