Tag
little-law
- Jan 28, 2026 Concurrency Limits Derived from Little's Law How the relation between in-flight requests, arrival rate, and latency produces a concurrency limit, and why an adaptive limit tracks a dependency that changes speed. backend systems
- Dec 25, 2024 Throughput, Latency, and Why Concurrency Is Not Parallelism How the relation between completion rate, response time, and in-flight work constrains every scaling decision, and why overlapping waits and splitting computation buy throughput in different ways. performance engineering
- Sep 7, 2024 Sizing a Replica Pool from Arrival Rate and Latency Target Queueing arithmetic that converts requests per second and a latency objective into a number of replicas, including the headroom that utilization hides. inference systems
- Aug 16, 2024 Cycle Time, Work-in-Progress Limits, and Little's Law in Delivery Queues How the identity L = lambda W ties items in flight to delivery time, why operating near full capacity inflates waiting, and how to size a work-in-progress limit from a target cycle time. software engineering
- Jun 4, 2024 Little's Law: Concurrency, Arrival Rate, and Time in System Why the identity L = λW holds without any assumption about the arrival distribution, how the choice of system boundary changes all three terms at once, and where the accounting breaks when requests are dropped or retried. performance engineering
- Sep 28, 2023 Little's Law and the Size of a Request Pool Why the number of requests in flight equals arrival rate times service time, how that identity fixes a pool size, and why adding workers past that point buys no throughput. backend systems