Tag
utilization
- Sep 17, 2026 Latency Targets and the Capacity Floor They Imply Why queueing delay grows without bound as utilization approaches one, how a p99 objective translates into a utilization ceiling, and what that ceiling costs per month. cloud infrastructure
- Aug 22, 2026 Utilization and the Nonlinear Growth of Waiting Time Why queue delay rises faster than load, how the shape of the curve depends on service-time variability rather than on arrival statistics, and why a utilization target is a statement about tail risk. performance engineering
- May 21, 2026 Utilization Targets and the Knee of the Latency Curve Why latency stays flat until utilization approaches one and then rises sharply, how arrival variability moves the knee, and how to locate the operating point from measurements rather than doctrine. performance engineering
- Apr 29, 2026 Why Queueing Delay Rises Sharply Near Link Utilization How the shape of the M/M/1 waiting-time curve explains the knee in latency-versus-load graphs, and why utilisation targets are set where they are. networking
- Nov 10, 2025 Queue Time, Service Time, and What a Timeout Measures A client-side timeout covers every wait in the path, including queues the client never sees, and that decomposition explains why a server can look fast while its callers time out. backend systems
- Nov 6, 2025 Reserved Versus On-Demand Capacity: The Break-Even Utilization Comparing a discounted commitment against pay-per-use pricing when demand has a diurnal shape, including the utilization at which the commitment stops saving money. inference systems
- Oct 15, 2025 Headroom Arithmetic: Turning a Load Forecast into a Replica Count How arrival rate, service time, and utilization combine into a replica count, why the nonlinearity of queueing makes the last few percent of utilization decisive, and how safety margins compound. performance engineering
- Jul 26, 2024 Queueing Delay and the Cost of Service-Time Variance Why waiting time depends on variance rather than only on mean load, how the M/M/1 and M/G/1 results express that dependence, and what reducing variance buys. backend systems
- Jul 14, 2023 Amortized Cost per Token: Depreciation, Power, and Idle Capacity Building a total cost of ownership for a token service from hardware life, power draw, and utilization, and showing why idle capacity is the largest term. inference systems