An enterprise online gaming company is launching a global game update expected to triple active connection traffic within minutes. The telemetry ingestion pipeline runs on Google Kubernetes Engine (GKE) worker nodes and is primarily I/O-bound as it handles high-volume persistent WebSocket streams and message queues. During load testing, scaling nodes and pods based on CPU utilization failed to react quickly enough to queue backlog spikes, and sudden autoscaling attempts were rejected due to regional limits. Which TWO architectural and operational actions should a Cloud Architect recommend to ensure auto-scaling reliability and guarantee resource availability during peak launch events?
- Configure the Kubernetes Horizontal Pod Autoscaler (HPA) using custom Cloud Monitoring metrics based on message queue depth and incoming connection rate instead of CPU utilization.Cevap
- BConfigure the Horizontal Pod Autoscaler to target 85% average target CPU utilization across pods to absorb sudden network connection spikes.
- Submit regional Compute Engine resource quota increase requests well before launch and purchase Compute Engine capacity reservations for the required machine types.Cevap
- DRely on Google Cloud default quota auto-expansion mechanisms, which automatically increase regional core limits when cluster node pools trigger scale-up events.
- EReplace the GKE node pools with Cloud Run service revisions to automatically bypass all project-level regional CPU quotas and custom metric configurations.
Cevap
The Cloud Architect should configure the Kubernetes Horizontal Pod Autoscaler using custom Cloud Monitoring metrics (such as queue depth and connection rate) and proactively request regional Compute Engine quota increases along with capacity reservations.
For I/O-bound and queue-based workloads, scaling based on CPU utilization is insufficient because memory, network sockets, or message backlogs saturate before CPU usage spikes. Using custom Cloud Monitoring metrics like queue depth or active connection rate allows the HPA to scale workloads accurately. Additionally, cluster autoscaling requires sufficient underlying Compute Engine quotas and physical compute capacity. Proactively requesting regional quota increases and securing capacity reservations ensures that GKE can successfully provision underlying VM nodes when traffic bursts occur.
Adım Adım Çözüm
Anahtar Kavram
I/O-Bound Custom Metric Autoscaling and Proactive Capacity Planning