Tag
bin-packing
- Feb 26, 2026 Replica Packing and Topology Constraints Tensor parallelism turns a model into a group of devices that must be co-located and upgraded together. That group, not the individual replica, is the unit a scheduler can place. inference systems
- Apr 8, 2025 Placement as Bin Packing: Multi-Dimensional Fit and the Fragmentation It Creates Why a scheduler with free cores and free memory can still refuse a pod, how multi-dimensional packing produces unusable holes, and which scoring functions trade density against headroom. cloud infrastructure
- Mar 4, 2025 Instance Shape Selection and the vCPU-to-Memory Ratio Why a workload that fits one instance family strands half of another, how joint utilization percentiles differ from per-dimension ones, and what burstable credits hide. cloud infrastructure
- Dec 26, 2024 Filtering and Scoring: How a Scheduler Picks One Node Out of Thousands The two-phase placement cycle, why feasibility is computed per node instead of per constraint, and how scoring turns a set of legal nodes into a single binding decision. virtualization