Definition
In sequence-to-sequence models, the decoder takes the context vector produced by the encoder and generates the target output step-by-step. It uses attention mechanisms to focus on relevant parts of the input sequence during generation. Decoders are fundamental in tasks like machine translation, text summarization, and image captioning, where structured output must be predicted based on complex input features.
Summary
A neural network component responsible for generating output sequences from encoded latent representations.
Key Concepts
- Sequence Generation
- Attention Mechanism
- Latent Space
- Autoregressive Prediction
Use Cases
- Machine translation (English to French)
- Text summarization
- Image captioning