Tag
backfills
- Aug 14, 2026 Verifying a Backfill with Range Checksums Instead of Full Comparison How partitioning a dataset into key ranges and comparing per-range digests localises a skipped or double-written record, and why the digest must be order-independent. distributed systems
- Jan 9, 2026 Backfill Concurrency and Collisions with the Live Schedule Why reprocessing history competes with today's run for the same slots, how partition locks arbitrate, and where the contention actually appears. data engineering
- Mar 19, 2025 Resumable Backfills: Watermarks, Chunk Boundaries, and Gap-Free Progress How a long-running backfill records where it stopped, why the watermark must advance over a total order rather than a clock, and what idempotent chunks cost. distributed systems
- Dec 12, 2023 Admission Control for Background Work: Keeping Scans Off the Critical Path Why a fixed batch size cannot protect foreground latency, how a feedback controller turns saturation signals into a work rate, and where the loop becomes unstable. distributed systems