Tag
benchmarking
- Mar 30, 2026 Measurement Overhead and the Code the Compiler Deletes How dead-code elimination, loop unrolling, and constant folding silently remove the work a benchmark claims to time, and which structural defences keep the timed region intact. performance engineering
- Nov 1, 2025 Averaging Ratios and the Geometric Mean in Composite Scores Why the arithmetic mean of normalised ratios depends on the reference machine, when the geometric mean is the right summary, and where the harmonic mean is forced by the arithmetic of rates. performance engineering
- Feb 22, 2025 Warmup Transients and Detecting Steady State in Timed Loops Why the first iterations of a timed loop measure a different program, which subsystems are still converging, and how to locate the transition into steady state rather than assuming it. performance engineering
- Nov 12, 2024 Clock Sources and the Resolution Floor of a Timing Call How monotonic clocks, TSC reads, and syscall-based time differ in cost and granularity, why a measured interval is a difference of two uncertain readings, and how the floor limits what a benchmark can resolve. performance engineering
- Oct 16, 2024 Confidence Intervals for the Difference Between Two Benchmark Runtimes Why two overlapping intervals can still hide a real difference, how the standard error of a difference is computed from paired or independent samples, and what a ratio estimate needs before it is trustworthy. performance engineering
- Apr 1, 2024 External Validity and the Limits of What a Benchmark Shows Which conditions a benchmark result actually holds under, how data scale and load level change the regime being measured, and why optimising against a fixed workload stops predicting its own future. performance engineering
- Jan 9, 2024 Distribution-Free Comparison When the Data Is Not Normal What rank tests actually test, how permutation and bootstrap procedures produce intervals on a benchmark difference without assuming a shape, and where each method loses power. performance engineering
- Nov 27, 2023 What a System Call Actually Costs Where the cycles go between the trap instruction and the return, which costs are fixed and which scale with the argument, and why mitigations changed the baseline. operating systems
- Feb 28, 2023 Variance Reduction by Pairing, Interleaving, and Blocking How separating between-session drift from within-session noise reduces the number of runs a comparison needs, why alternation cancels slow drift but not carryover state, and how to schedule the two versions. performance engineering