mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Files

Rayed Bin Wahed 496079c61e Update mha-implementations.ipynb

Fix variable spelling in comments to keep consistent with code

2024-03-06 23:03:57 +08:00

ch03.py

also add simple wrapper

2024-03-06 08:38:53 -06:00

mha-implementations.ipynb

2024-03-06 23:03:57 +08:00

README.md

mha variants

2024-03-06 08:30:32 -06:00

More Efficient Multi-Head Attention Implementations

mha-implementations.ipynb contains and compares different implementations of multi-head attention