books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

mha variants

Browse Source
This commit is contained in:
rasbt
2024-03-06 08:30:32 -06:00
parent d4754f1bdd
commit 87fcfd9245
10 changed files with 431 additions and 10 deletions
Download Patch File Download Diff File Expand all files Collapse all files

3
ch03/README.md
View File

@@ -1,3 +1,4 @@
# Chapter 3: Coding Attention Mechanisms
- [01_main-chapter-code](01_main-chapter-code) contains the main chapter code.
- [01_main-chapter-code](01_main-chapter-code) contains the main chapter code.
- [02_bonus_efficient-multihead-attention](02_bonus_efficient-multihead-attention) implements and compares different implementation variants of multihead-attention