Attention
A neural-network mechanism that computes weighted interactions between representations so a model can focus on contextually relevant information.
Related Concepts
- Self-Attention
- Multi-Head Attention
- Transformer
- Embedding
A neural-network mechanism that computes weighted interactions between representations so a model can focus on contextually relevant information.