An e-commerce company operates a critical catalog search service deployed on Google Cloud Run backed by Cloud Bigtable. The Site Reliability Engineering (SRE) team established a Service Level Objective (SLO) of 99.9% success rate over a rolling 30-day window. To balance fast detection of catastrophic failures with low false-alarm noise during minor events, which alerting policy should the team implement in Cloud Monitoring?
- Implement multi-window, multi-burn-rate alerts that trigger based on consuming specific percentages of the 30-day error budget over short and long lookback windows.Cevap
- BConfigure a static threshold alert that fires immediately whenever the 5-minute request error percentage exceeds 0.1%.
- CSet up alert thresholds directly on Cloud Run instance CPU and memory utilization metrics exceeding 85% over a 10-minute average.
- DConfigure load balancer health check probes to run synchronous database queries against Cloud Bigtable on every health check request.
Cevap
The team should implement multi-window, multi-burn-rate alerts that evaluate error budget consumption rates over short and long lookback windows.
According to Google SRE principles, multi-window, multi-burn-rate alerts evaluate both the magnitude and duration of error budget consumption. Using multiple lookback windows (such as a 1-hour window for high burn-rate critical pages and a 6-hour or 3-day window for low burn-rate non-urgent notifications) ensures quick response to major outages without alerting on short, non-threatening spikes.
Adım Adım Çözüm
Anahtar Kavram
Multi-window multi-burn-rate alerting