Tag
lineage
- Jun 11, 2025 Shuffle Fault Tolerance: Recomputing Lost Map Output Why map output is an unreplicated cache on local disk, what a lost segment costs downstream, and how lineage and shuffle services change the recovery path. data engineering
- Mar 25, 2024 Column-Level Lineage and the Cost of Tracking It Deriving which upstream column feeds which downstream column requires parsing every query; the alternative is coarse and the fine-grained version has an unbounded cost. data engineering