FlashAttention
An exact attention algorithm that reorganizes computation around fast on-chip memory to reduce memory traffic and improve attention throughput.
Related Concepts
- Attention
- Operator Fusion
- Memory Bandwidth
- Context Window
An exact attention algorithm that reorganizes computation around fast on-chip memory to reduce memory traffic and improve attention throughput.