Tag
recurrence
- Dec 16, 2025 Initiation Interval and the Recurrence That Caps Throughput Why a loop with a circular dependency cannot be pipelined faster than its critical cycle allows, and how resource limits and latency combine into a minimum initiation interval. computer architecture
- Aug 25, 2025 Backpropagation Through Time and the Product of Jacobians How gradients travel backwards through an unrolled recurrence, why the product of per-step Jacobians decays or explodes, and what truncation and clipping change about the estimate. deep learning
- Apr 7, 2025 Bidirectional and Stacked Recurrence: Cost and Causality How a reverse pass and additional layers widen what a recurrent network can see at one position, what each costs in latency and parameters, and when causality forbids the reverse pass. deep learning
- Mar 16, 2025 What a Recurrent Cell Computes at Each Time Step The exact arithmetic of an RNN cell, the tensor shapes and cost per step, why the recurrence is unrolled for training, and how hidden states behave when the sequence continues across batches. deep learning
- May 5, 2022 Fixed-Window Models and the Hidden State They Cannot Represent Why a predictor restricted to the last k inputs cannot count, track nesting, or carry information past its window, and what a learned hidden state changes about that limit. deep learning