Tag
spill
- Apr 23, 2026 What a Shuffle Moves Between Map and Reduce Stages The mechanics of the map-side write, the network fetch, and the reduce-side merge: what actually crosses the wire, and why the stage boundary exists at all. data engineering
- Nov 28, 2025 External Merge Sort: Runs, Fan-in, and the Sort-Merge Join How a sort spills to disk, why replacement selection builds longer runs than naive chunking, and how the merge phase feeds a sort-merge join without a second pass. databases
- May 6, 2025 Map-Side Buffer Budgets and the Cost of Spilling Why the sort buffer is a fixed per-task budget, what the spill threshold implies for merge passes, and how much extra I/O a spill actually costs. data engineering
- Apr 5, 2023 Sort, Hash, and Materialize: Memory Limits and Spill to Disk How a hash join decides it must partition, what a sort does when the work memory runs out, and why an underestimated row count becomes a disk-bound plan. databases