A company wants to design a serverless data ingestion pipeline to collect real-time website clickstream data. The data must be transformed into a standardized format and stored in Amazon S3. The ingestion rate varies throughout the day, and the solution must scale automatically to handle traffic spikes with minimal operational overhead.
Which combination of AWS services should the company use to meet these requirements? (Select two.)
- Amazon Data Firehose to ingest the streaming data and load it into Amazon S3Answer
- An AWS Lambda function to perform data transformation within the delivery streamAnswer
- CAmazon Kinesis Data Streams with pre-provisioned shards to buffer and ingest the stream
- DAmazon SQS standard queue to receive and temporarily store the raw stream data
- EAn AWS Lambda function configured to run continuously in a loop to poll and process the incoming records
Answer
The combination of Amazon Data Firehose to ingest the streaming data and deliver it to Amazon S3, along with an AWS Lambda function to perform the inline data transformation.
The correct combination includes Amazon Data Firehose and AWS Lambda. Amazon Data Firehose provides a fully managed, automatically scaling streaming delivery service that writes directly to Amazon S3. By configuring Firehose to invoke an AWS Lambda function, you get a completely serverless, inline data transformation process with minimal operational overhead.
Step-by-Step Solution
Key Concept
Serverless data ingestion and inline transformation with minimal operational overhead using Amazon Data Firehose and AWS Lambda.
Estimated Time:2m 0s