mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Files

Rayed Bin Wahed 496079c61e Update mha-implementations.ipynb

Fix variable spelling in comments to keep consistent with code

2024-03-06 23:03:57 +08:00

also add simple wrapper

2024-03-06 08:38:53 -06:00

2024-03-06 23:03:57 +08:00

README.md

mha variants

2024-03-06 08:30:32 -06:00

Chapter 3: Coding Attention Mechanisms

01_main-chapter-code contains the main chapter code.
02_bonus_efficient-multihead-attention implements and compares different implementation variants of multihead-attention