Tag
deduplication
- Aug 18, 2026 URL Normalization as a Set-Equality Problem Which transformations are safe when deciding two URLs identify the same resource, why scheme and host case rules differ from path rules, and how over-normalization merges distinct pages. information retrieval
- Jul 27, 2026 Shared Build Cache Design: Action Keys, Content Store, and Eviction Why a build cache is two stores with different lifetimes, how write-once content addressing enables deduplication, and which eviction and failure policies keep a cache outage harmless. devops
- Mar 13, 2026 Idempotency at the Effect Boundary, Not the Handler Entry Deduplicating a job at the point where it changes the world: unique constraints, request keys, delta-to-fact conversion, and the two-phase effect that survives a crash mid-call. backend systems
- Apr 22, 2025 Content Addressing: Why a Layer Is Named by Its Digest How digest-addressed storage makes image layers immutable, what deduplication falls out of it, and why garbage collection needs a reachability walk. virtualization
- Apr 4, 2025 Alert Fingerprints, Grouping, and Inhibition How an alerting system decides that two firing alerts are the same problem, how grouping batches notifications, and why unstable labels cause page storms. devops
- Mar 28, 2024 Detecting Crawler Traps by Budget per Host How infinite URL spaces, calendar generators, and session identifiers make a crawl diverge, and the per-host accounting that stops it without losing real pages. information retrieval
- Dec 5, 2022 Row Identity and Why Deduplication Needs a Key, Not a Comparison Deciding that two records describe the same entity requires a declared key; comparing whole rows fails on late-arriving corrections, and windowed dedup only moves the ambiguity. data engineering
- Sep 24, 2022 Incremental Backup Chains and Restore Depth How changed-block tracking works, why deduplicated storage makes deletion expensive, and why restore time grows with the number of links in the chain. devops
- Sep 5, 2022 Repeat Suppression and Template Fingerprints How collapsing identical messages into a count preserves signal, why a fingerprint must be computed over the template rather than the text, and where collapsing loses information. observability