Tag
masking
- Oct 12, 2026 Causal Masking, Additive Mask Terms, and Where the Mask Enters the Softmax Why a causal constraint is expressed as negative infinity added to the logits, how padding and causality combine in one layer, and which arithmetic the mask must precede. deep learning
- Apr 1, 2026 Mask Registers, Tail Handling, and the Cost of the Last Iteration How per-lane execution masks replace the scalar remainder loop, what inactive lanes still consume, and why vector length control and tail policy decide whether the last iteration is cheap. computer architecture
- Sep 26, 2023 Padding, Packing, and Masking for Variable-Length Sequence Batches What it costs to batch sequences of different lengths behind a rectangular tensor, how masks keep padding out of losses and attention, and how packed sequences avoid the wasted arithmetic. deep learning
- Jan 13, 2022 Dropout Masks, Train-Time Scaling, and Inference Behaviour What the Bernoulli mask does to the expectation of an activation, why one convention scales during training instead of at test time, and how the mask changes what reaches the layers below. deep learning