Tag
capacity-planning
- Sep 17, 2026 Latency Targets and the Capacity Floor They Imply Why queueing delay grows without bound as utilization approaches one, how a p99 objective translates into a utilization ceiling, and what that ceiling costs per month. cloud infrastructure
- Sep 3, 2026 Sequencing Repayment Under a Fixed Capacity With more debt than capacity, the order of repayment determines the total benefit. Ranking by interest eliminated per week of work, subject to deadlines and prerequisites. software architecture
- Jul 25, 2026 Load Balancing Policy and Effective Capacity How assignment policy, connection reuse, and request-class knowledge change the throughput a pool can sustain, and why a policy tuned for latency can reduce total capacity. performance engineering
- Jun 17, 2026 Capacity Failure Modes Under Peak Load The specific mechanisms that turn a load peak into an outage: queue overload, resource leaks under retry, cold cache amplification, and the asymmetry between degradation and recovery. performance engineering
- Jun 5, 2026 Provisioning Lag and the Reaction Time of a Fleet How the delay between a load increase and usable capacity determines the headroom a plan needs, why boot time and image pull dominate the loop, and how the lag compounds with forecast error. performance engineering
- Jun 4, 2026 Hit Ratio Arithmetic and How to Size a Cache Tier How to convert a hit ratio into source load and latency, why the miss-rate curve flattens before the working set is covered, and which measurement choices make a cache look better than it is. backend systems
- Apr 2, 2026 Amdahl and Gustafson Bounds in Capacity Models Why a serial fraction caps the throughput a fixed workload can reach, how scaled workload changes the bound, and what the usable-scalability limit means for sizing a fleet. performance engineering
- Nov 7, 2025 Sizing Regional Capacity for the Loss of a Region Why N+1 regional capacity is larger than the arithmetic suggests, how queueing turns the last few percent of utilization into latency, and where failover load comes from. cloud infrastructure
- Nov 6, 2025 Reserved Versus On-Demand Capacity: The Break-Even Utilization Comparing a discounted commitment against pay-per-use pricing when demand has a diurnal shape, including the utilization at which the commitment stops saving money. inference systems
- Oct 15, 2025 Headroom Arithmetic: Turning a Load Forecast into a Replica Count How arrival rate, service time, and utilization combine into a replica count, why the nonlinearity of queueing makes the last few percent of utilization decisive, and how safety margins compound. performance engineering
- Oct 7, 2025 Flow Sampling Error When Deciding Whether a Link Is Full How sampled flow records estimate volume, why small conversations disappear entirely, and how to tell sampling noise from a real change in traffic mix. networking
- Jul 18, 2025 Forecasting Table and Index Growth from Row Width and Page Fill Turning tuple width, page overhead, fill factor, and index amplification into a byte forecast, and the four effects that make a linear extrapolation wrong. databases
- Apr 20, 2025 Autoscaling a Token Service with Cold Starts and Diurnal Load Why reactive scaling fails for inference replicas, how to derive the lead time a scale-out needs, and what a warm pool costs against the peaks it covers. inference systems
- Mar 4, 2025 Instance Shape Selection and the vCPU-to-Memory Ratio Why a workload that fits one instance family strands half of another, how joint utilization percentiles differ from per-dimension ones, and what burstable credits hide. cloud infrastructure
- Dec 30, 2024 Quota Arithmetic: Why a Shared Pool Cannot Promise Every Tenant Its Share Requests, limits, and overcommit interact through the scheduler and the cgroup hierarchy. How to compute whether a set of quotas fits a pool, and where the arithmetic stops being safe. virtualization
- Sep 7, 2024 Sizing a Replica Pool from Arrival Rate and Latency Target Queueing arithmetic that converts requests per second and a latency objective into a number of replicas, including the headroom that utilization hides. inference systems
- Sep 19, 2023 Modeling Throughput Growth and Service Demand Drift Why per-request cost rises across releases and with load, how to separate traffic growth from efficiency change in a capacity series, and what a drift budget means for a sizing horizon. performance engineering
- Apr 21, 2023 Autoscaling Policies and the Cost of Headroom How a scaling policy converts a load signal into an instance count, why the control loop lags the load, and what each unit of headroom costs per month. cloud infrastructure