Tag
cost-attribution
- May 17, 2025 Measuring What a Component Costs by Taking It Away Ablation measures a component by disabling it and observing the change in a metric, which answers a different question than profiling and is easy to apply incorrectly. performance engineering
- Jun 27, 2022 Why Token Billing Diverges from GPU-Seconds The gap between what a request costs in hardware time and what it costs at a per-token price, and the workload shapes that make the two accounting systems disagree. inference systems