Tag
encoder-decoder
- Aug 17, 2026 Encoder-Decoder Sequence Models and the Teacher Forcing Assumption How a pair of recurrent networks maps a sequence to a differently sized sequence, what the fixed-size conditioning vector costs, and why training with gold prefixes diverges from inference. deep learning
- Jul 6, 2026 Attention as Content-Based Alignment Over Encoder States How a decoder selects among stored states with a learned weight distribution, why that gives a short gradient path to any position, and what the attention weights cannot represent. deep learning