books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

update pr

Browse Source
This commit is contained in:
rasbt
2024-05-26 15:38:35 -05:00
parent e2aeb80fdb
commit 050c8b7b73
2 changed files with 12 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ch03/02_bonus_efficient-multihead-attention/mha-implementations.ipynb
View File

@@ -341,7 +341,7 @@
" self.d_out = d_out\n",
"\n",
" self.qkv = nn.Linear(d_in, 3 * d_out, bias=qkv_bias)\n",
" self.proj = nn.Linear(d_in, d_out)\n",
" self.proj = nn.Linear(d_out, d_out)\n",
" self.dropout = dropout\n",
"\n",
" def forward(self, x):\n",