Tag
hidden-state
- Mar 16, 2025 What a Recurrent Cell Computes at Each Time Step The exact arithmetic of an RNN cell, the tensor shapes and cost per step, why the recurrence is unrolled for training, and how hidden states behave when the sequence continues across batches. deep learning
- Jun 13, 2022 Gates in LSTM and GRU Cells: What Each Gate Controls How multiplicative gates create an additive path through time, what the forget, input and output gates each multiply, and how a two-gate cell removes one of them. deep learning
- May 5, 2022 Fixed-Window Models and the Hidden State They Cannot Represent Why a predictor restricted to the last k inputs cannot count, track nesting, or carry information past its window, and what a learned hidden state changes about that limit. deep learning