Tag
tiling
- Mar 20, 2026 Operator Fusion and the Conditions That Block It Why merging adjacent operators into one kernel removes memory traffic, how producers and consumers are classified, and which graph shapes make the merge illegal or unprofitable. inference systems
- Jan 18, 2025 Tiled Stencils and Shared Memory Halos How an overlapping tile plus a barrier turns repeated global reads into repeated shared-memory reads, how halo overhead scales with tile size, and what register blocking adds. gpu computing
- Jul 22, 2024 Tiling Through Shared Memory and Overlapping the Load The reuse arithmetic that decides a tile size, why a register tile on top of a shared tile cuts scratchpad traffic again, and how an asynchronous copy lets the next tile load while the current one is computed. gpu computing
- Dec 27, 2023 Tile Selection: Cost Models Against Measurement A fused kernel still needs a tile shape and a loop order, and the compiler must choose them either by estimating cost or by measuring candidates on the device. inference systems
- Nov 4, 2021 IO-Aware Attention: Tiling the Score Matrix Without Materializing It Why the intermediate attention tensors cost more than the arithmetic, how blockwise softmax stays exact, and what the online rescaling step has to preserve. deep learning