Tag
latency-budget
- Dec 15, 2024 Deadline Propagation and the Shared Request Time Budget Why independent per-hop timeouts cannot bound end-to-end latency, and how an absolute deadline carried in request metadata turns the budget into arithmetic. backend systems
- Apr 18, 2024 Cross-Encoder Reranking and the Cost of Reading Every Pair Why a reranker sees query and passage together, what that buys over a dual encoder, and how candidate depth turns a quality gain into a latency bill. inference systems
- Jul 27, 2022 Scheduling Without a Scheduler: Superloops and Their Latency Budget How a main loop plus interrupt handlers bounds worst-case response time, where jitter creeps in, and the point at which the structure stops meeting its deadlines. embedded systems