Tag
roofline
- May 8, 2026 Bandwidth-Bound and Latency-Bound Work How to tell which of the two memory limits a kernel is actually hitting, why the remedy differs completely, and how the arithmetic intensity decides. performance engineering
- Feb 4, 2026 Prefill and Decode: The Two Cost Curves Behind One Token Price Why the same model spends prefill time on arithmetic and decode time on memory bandwidth, and how that split decides what a token costs to serve. inference systems
- Aug 27, 2025 NUMA First-Touch and the Memory Bandwidth Ceiling per Node Why a multi-socket node delivers less than its nominal bandwidth to an unaware program, and how page placement, binding, and the roofline interact. scientific computing
- Mar 27, 2025 Data Movement as the Real Bottleneck in Offload Design How to account for the bytes an offload costs, which boundary dominates at each scale, and why the offload with the best local speedup is often the wrong one. computer architecture