Observability · Cluster
Alerting
Symptom-based paging and burn rates.
- 01 Error Budgets and the Burn Rate That Consumes Them How an error budget turns a service level objective into a spendable quantity, and how the burn rate compresses a window into a single number that can be compared against a threshold.
- 02 Symptom-Based Alerting and the Cause Signals It Replaces Why paging on the metric that explains a failure produces more pages than paging on the failure itself, and how to tell a symptom from a cause when writing a rule.
- 03 Routing Alerts by Required Response: Page, Ticket, and Log Line How the required human response determines an alert channel, why a channel that interrupts must carry an action, and how ownership and escalation decide where a notification lands.
- 04 Multiwindow Burn-Rate Alerts and the Short Window as a Reset Why one burn-rate rule cannot be both fast and quiet, how pairing a long window with a short one separates depth from duration, and what the AND condition changes about resolution.
- 05 Alert State, Hysteresis, and the Cost of Flapping How an alert moves between inactive, pending, firing, and resolved, why a condition that crosses its threshold repeatedly produces a notification storm, and what a hold duration or a second threshold does about it.
- 06 Fleet-Wide Alerting and the Per-Instance Rule Why the aggregation level of an alerting rule decides both what it can detect and how many notifications it produces, and how to choose between per-instance, per-shard, and fleet-wide evaluation.
- 07 Alerting on Absent and Stale Data Why a missing series makes an alert rule evaluate to nothing rather than to health, how staleness markers and absence functions expose the difference, and why a firing alert can silently turn into a false resolution.
- 08 Inhibition and Dependency Suppression Between Alerts How an inhibition rule mutes a set of derived alerts while an upstream alert is firing, why label equality is the whole matching mechanism, and what breaks when the suppression relation is wrong.
- 09 Seasonality and the Limits of Static Alert Thresholds How diurnal and weekly cycles defeat a fixed threshold, what a seasonal baseline measures against, and why differencing a series amplifies its noise in proportion to the step size.
- 10 Forecasting Exhaustion for Saturation Alerts How a linear projection over a recent window turns a saturation alert from a percentage threshold into a deadline, why the projection is only valid for a bounded horizon, and where it breaks.