A connected-vehicle enterprise is designing a global telemetry platform to ingest real-time sensor metrics from millions of vehicles worldwide. The architecture must handle over write operations per second with single-digit millisecond write latency, store semi-structured time-series data with dynamic schemas, and allow data analysts to execute ad-hoc SQL queries directly through BigQuery without creating periodic ETL pipelines. Which storage and database architecture should you recommend?
- Deploy Cloud Bigtable with multi-cluster replication across targeted regions for low-latency time-series ingestion, and query the data directly from BigQuery using external table definitions.Answer
- BDeploy Cloud Spanner with a multi-region instance configuration, using strongly consistent relational tables to index high-velocity time-series sensor streams.
- CCollect telemetry logs locally on edge gateway servers and continuously dispatch Transfer Appliance hardware to upload data into Cloud Storage Coldline buckets for analytical querying.
- DDeploy Cloud SQL for PostgreSQL with horizontal read replicas, relying exclusively on IAM roles without VPC Service Controls to govern database access and prevent data export.
Answer
Deploy Cloud Bigtable with multi-cluster replication across targeted regions for low-latency time-series ingestion, and query the data directly from BigQuery using external table definitions.
Cloud Bigtable provides scalable NoSQL key-value storage optimized for massive throughput time-series ingestion with single-digit millisecond latency. Integrating BigQuery via external table definitions enables direct SQL analytics without maintaining complex streaming ETL pipelines.
Step-by-Step Solution
Key Concept
Selecting Cloud Bigtable for high-throughput time-series ingestion combined with BigQuery federated queries for zero-ETL analytics.