books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

refresh figures

Browse Source
This commit is contained in:
rasbt
2024-06-23 10:41:29 -05:00
parent 4c69df6070
commit 0734570b28
1 changed files with 4 additions and 4 deletions
Download Patch File Download Diff File Expand all files Collapse all files

8
ch07/01_main-chapter-code/ch07.ipynb
View File

@@ -491,7 +491,7 @@
"source": [
"- We tackle this dataset batching in several steps, as summarized in the figure below\n",
"\n",
"<img src=\"https://sebastianraschka.com/images/LLMs-from-scratch-images/ch07_compressed/detailed-batching.webp\" width=500px>"
"<img src=\"https://sebastianraschka.com/images/LLMs-from-scratch-images/ch07_compressed/detailed-batching.webp?1\" width=500px>"
]
},
{
@@ -679,7 +679,7 @@
"id": "c46832ab-39b7-45f8-b330-ac9adfa10d1b"
},
"source": [
"<img src=\"https://sebastianraschka.com/images/LLMs-from-scratch-images/ch07_compressed/batching-step-4.webp\" width=500px>"
"<img src=\"https://sebastianraschka.com/images/LLMs-from-scratch-images/ch07_compressed/batching-step-4.webp?1\" width=500px>"
]
},
{
@@ -780,7 +780,7 @@
"source": [
"- Next, we introduce an `ignore_index` value to replace all padding token IDs with a new value; the purpose of this `ignore_index` is that we can ignore padding values in the loss function (more on that later)\n",
"\n",
"<img src=\"https://sebastianraschka.com/images/LLMs-from-scratch-images/ch07_compressed/batching-step-5.webp\" width=500px>\n",
"<img src=\"https://sebastianraschka.com/images/LLMs-from-scratch-images/ch07_compressed/batching-step-5.webp?1\" width=500px>\n",
"\n",
"- Concretely, this means that we replace the token IDs corresponding to `50256` with `-100` as illustrated below"
]
@@ -2733,7 +2733,7 @@
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.11.4"
"version": "3.10.6"
}
},
"nbformat": 4,