A company is designing a high-throughput event processing platform to ingest JSON telemetry logs from IoT devices. The platform must support two primary requirements:
1. Low-latency, single-digit millisecond writes to ingest telemetry logs, which must be stored for real-time dashboarding. The telemetry data must automatically expire after days to minimize storage costs.
2. An audit compliance mandate requires raw logs to be archived for years. These archives must be queryable via standard SQL on-demand, without provisioning permanent database compute resources.
Which two database and storage strategies will satisfy these requirements?
- Use Amazon DynamoDB to ingest and store the active telemetry logs, and enable Time to Live (TTL) to automatically delete items older than days.Cevap
- Use Amazon S3 to store the raw logs, configure an S3 Lifecycle policy to transition the logs to Amazon S3 Glacier Flexible Retrieval after days, and query the archived logs on-demand using Amazon Athena.Cevap
- CUse Amazon Aurora Global Database to ingest the telemetry logs, and configure Aurora Auto Scaling to dynamically provision reader instances in the primary Region to handle the write-heavy spike loads.
- DUse Amazon S3 to store the raw logs, encrypt them using the AWS-managed KMS key (aws/s3), and modify the KMS key policy to delegate read permissions to a cross-account audit role.
- EUse Amazon ElastiCache for Memcached to ingest the active telemetry logs, and configure multi-AZ replication to ensure data persistence and high availability for the -day window.
Cevap
Use Amazon DynamoDB to ingest and store active logs with Time to Live (TTL) enabled, and use Amazon S3 to archive raw logs with an S3 Lifecycle policy transitioning them to Amazon S3 Glacier Flexible Retrieval while querying them via Amazon Athena.
The correct strategy uses Amazon DynamoDB to handle the high-write, low-latency telemetry ingestion, utilizing Time to Live (TTL) to automatically expire data after days at no extra cost. For long-term archiving, Amazon S3 coupled with a Lifecycle policy to transition logs to S3 Glacier Flexible Retrieval offers the most cost-effective solution, while Amazon Athena allows serverless, on-demand SQL queries without the need for active database compute resources.
Adım Adım Çözüm
Anahtar Kavram
Selecting and integrating optimal database and storage services based on performance, cost-effective archiving, and query requirements.