A global media streaming platform operates a rights-management API running on Google Kubernetes Engine (GKE) behind an External HTTP(S) Load Balancer. The service has a defined Service Level Objective (SLO) of availability over a rolling 30-day window. SRE teams are currently suffering from alert fatigue caused by transient error spikes triggering immediate paging alerts, while simultaneously failing to catch slow, sustained error budget consumption that exhausts their 30-day budget prior to monthly reviews. Which alerting approach should a Cloud Architect recommend to ensure actionable notifications based on actual risk to the error budget?
- Implement multi-window, multi-burn-rate alerting policies in Cloud Monitoring that consume short (e.g., 5-minute/1-hour) and long (e.g., 6-hour/3-day) lookback windows to alert based on the rate of error budget depletion.Cevap
- BConfigure static threshold alerts in Cloud Monitoring that trigger an urgent paging notification whenever the 5-minute aggregate HTTP 5xx error rate exceeds .
- CSet up GKE Horizontal Pod Autoscaler (HPA) policies based exclusively on CPU utilization and memory consumption to automatically mitigate 5xx errors.
- DRedefine the Service Level Indicator (SLI) metric target to container CPU health and issue pings when container CPU consumption surpasses .
Cevap
Implement multi-window, multi-burn-rate alerting policies in Cloud Monitoring that evaluate both short and long lookback windows to alert based on the rate of error budget consumption.
Implementing multi-window, multi-burn-rate alerts in Cloud Monitoring is the SRE best practice for managing SLOs. By pairing a short lookback window (ensuring quick response to severe outages) with a long lookback window (ensuring errors are still ongoing and not transient noise), teams can trigger pages for rapid budget consumption and open support tickets for slow budget burn without experiencing alert fatigue.
Adım Adım Çözüm
Anahtar Kavram
Multi-Window Multi-Burn-Rate Alerting on Error Budgets
Tahmini Süre:2m 30s