Tag
regression-detection
- Sep 15, 2026 Comparing Two Profiles to Find a Regression That Is Real A differential flame graph is a difference of two sample sets on a shared layout; the normalisation, the noise floor, and frame identity each decide whether a red bar means anything. performance engineering
- Aug 27, 2026 Power, the Minimum Detectable Effect, and the Cost of Repeated Looks How sample size is determined by the smallest effect worth detecting rather than by convenience, why peeking at a running experiment inflates false positives, and what sequential designs cost in exchange. performance engineering
- Oct 16, 2024 Confidence Intervals for the Difference Between Two Benchmark Runtimes Why two overlapping intervals can still hide a real difference, how the standard error of a difference is computed from paired or independent samples, and what a ratio estimate needs before it is trustworthy. performance engineering