rasbt
1183fd7837
add dropout scaling note
|
1 tahun lalu | |
|---|---|---|
| .. | ||
| 01_main-chapter-code | 1 tahun lalu | |
| 02_bonus_efficient-multihead-attention | 1 tahun lalu | |
| 03_understanding-buffers | 1 tahun lalu | |
| README.md | 1 tahun lalu | |
README.md
Chapter 3: Coding Attention Mechanisms
Main Chapter Code
- 01_main-chapter-code contains the main chapter code.
Bonus Materials
- 02_bonus_efficient-multihead-attention implements and compares different implementation variants of multihead-attention
- 03_understanding-buffers explains the idea behind PyTorch buffers, which are used to implement the causal attention mechanism in chapter 3