Tag
data-skew
- Sep 8, 2025 Adaptive Partitioning and Runtime Repartitioning How a shuffle writer reports per-partition sizes at the stage barrier, and how coalescing and splitting use that report to correct a partition count chosen before the data was read. data engineering
- Aug 7, 2022 Hot Keys, Skew, and Load Imbalance in Hash Partitioning Why a partitioner that distributes keys evenly can still produce one task with sixty times the average work, and the static and sampled fixes that spread that load. data engineering