books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

make softmax explicit

Browse Source
This commit is contained in:
rasbt
2024-02-11 08:42:21 -06:00
parent 7d86023fc4
commit 352b83d225
1 changed files with 1 additions and 1 deletions
Download Patch File Download Diff File Expand all files Collapse all files

2
ch04/01_main-chapter-code/ch04.ipynb
View File

@@ -1235,7 +1235,7 @@
" # Apply softmax to get probabilities\n",
" probas = torch.softmax(logits, dim=-1) # (batch, vocab_size)\n",
"\n",
" # Get the idx of the vocab entry with the highest logits value\n",
" # Get the idx of the vocab entry with the highest probability value\n",
" idx_next = torch.argmax(probas, dim=-1, keepdim=True) # (batch, 1)\n",
"\n",
" # Append sampled index to the running sequence\n",