An enterprise application hosted on Compute Engine instances behind an External Application Load Balancer experiences cascading service outages whenever downstream database queries undergo brief, transient latency spikes. Diagnostic logs indicate that load balancer health checks are configured to execute deep database queries directly, causing healthy web instances to be misidentified as unhealthy and removed from serving pools. Additionally, the operations team suffers from alert fatigue caused by fixed threshold alerts firing during minor latency spikes. Which architecture modification should you recommend to improve operational reliability and incident management?
- Reconfigure load balancer health checks to query a lightweight local HTTP endpoint that validates local process status, and establish Cloud Monitoring alerting policies based on SLO error budget burn rates.Cevap
- BConfigure load balancer health checks to execute deeper synthetic database transactions at higher frequencies, and assign Project Owner primitive IAM roles to monitoring service accounts to restart unresponding VMs automatically.
- CMaintain existing health check paths but lower the threshold duration for static latency alert policies to 10 seconds to trigger immediate incident escalation webhooks.
- DReplace the load balancer health check with VPC Service Controls perimeter audit logging metrics to trigger automated incident response functions upon data access delays.
Cevap
Reconfigure load balancer health checks to query a dedicated, lightweight local health endpoint on the web servers, and implement Cloud Monitoring alerting policies using SLO error budget burn rates.
The correct strategy decouples load balancer health probing from downstream database dependencies by using a lightweight local endpoint, preventing cascading server drops. Additionally, leveraging error budget burn-rate alerts in Cloud Monitoring alerts operations teams based on true impact to customer SLOs rather than short-lived performance noise.
Adım Adım Çözüm
Anahtar Kavram
Incident Management and Automated Alerting