An enterprise financial technology platform processes high-throughput asynchronous ledger events via a pipeline powered by Google Cloud Pub/Sub, Cloud Run microservices, and Cloud Spanner. The Site Reliability Engineering (SRE) team defines a Service Level Objective (SLO) requiring of event processing requests to succeed over a 30-day rolling window. The team needs to implement an alerting strategy that reliably detects severe outages exhausting the monthly error budget rapidly while suppressing false-positive alerts caused by brief, self-correcting transient spikes. Which alerting policy should the Cloud Architect recommend?
- AConfigure static threshold alerts in Cloud Monitoring that fire whenever the 5-minute average HTTP 5xx error rate exceeds .
- Implement multi-window, multi-burn-rate alerts based on error budget consumption, triggering critical notifications when of the 30-day budget is burned within a 1-hour window.Answer
- CDefine the Service Level Indicator (SLI) directly as the fixed target percentage of , and set up an alert that triggers immediately whenever instantaneous availability falls below .
- DConfigure alerts based on CPU and memory utilization thresholds of the processing compute infrastructure exceeding for more than 10 minutes.
Answer
Implement multi-window, multi-burn-rate alerts based on error budget consumption, triggering critical notifications when of the 30-day budget is burned within a 1-hour window.
According to Google SRE principles and GCP Cloud Monitoring standards, multi-window multi-burn-rate alerting is the recommended pattern for SLO management. A 1-hour window detecting budget consumption represents a burn rate. Using multiple windows (e.g., 1-hour short window and 6-hour long window) ensures alerts trigger only when significant budget is actively being spent, providing high precision and recall.
Step-by-Step Solution
Key Concept
Error Budget Burn-Rate Alerting