mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00

Files

Sebastian Raschka ad12c8da06 Einsum multi-head attention (#345 )

* Einsum multi-head attention

* update diff

2024-09-05 18:24:33 +02:00

2024-07-24 21:53:41 -05:00

2024-09-05 18:24:33 +02:00

Update README.md

2024-07-30 06:55:41 -05:00

README.md

2024-07-26 08:45:36 -05:00

Chapter 3: Coding Attention Mechanisms

Main Chapter Code

02_bonus_efficient-multihead-attention implements and compares different implementation variants of multihead-attention
03_understanding-buffers explains the idea behind PyTorch buffers, which are used to implement the causal attention mechanism in chapter 3