Examkin

Question

Difficulty: EasyHigh-Performing Data Ingestion and Transformation Solutions

A company needs to collect streaming application logs, convert the data from JSON format to Apache Parquet format, and deliver the final files to Amazon S3. The company requires a serverless ingestion solution that minimizes operational and maintenance overhead. Which AWS service should the solutions architect recommend to meet these requirements?

  1. Amazon Data FirehoseAnswer
  2. B
    Amazon Kinesis Data Streams
  3. C
    Amazon SQS Standard Queue
  4. D
    AWS Glue ETL Jobs

Answer

Amazon Data Firehose
The correct answer is Amazon Data Firehose. It is a serverless, zero-administration service designed to ingest streaming data and deliver it to destinations like Amazon S3. It natively supports data transformation, allowing the automatic conversion of JSON records to Apache Parquet format using an AWS Glue schema before writing the files to the target S3 bucket, minimizing operational and management overhead.

Step-by-Step Solution

1
Analyze the requirements for data ingestion, format transformation, and destination storage.
The requirements demand a service that ingests streaming JSON log data, converts it to Apache Parquet, and writes it directly to Amazon S3.
This establishes the necessary feature set for the target service.
2
Evaluate the operational overhead constraints of the proposed architecture.
A serverless solution with minimal management is required, meaning services requiring manual shard scaling or custom consumer code must be avoided.
Operational simplicity is a key differentiator in the AWS Certified Solutions Architect exam.
3
Select the service that natively supports the pipeline with the least overhead.
Amazon Data Firehose natively supports serverless data ingestion, built-in format conversion using AWS Glue schema, and direct integration with Amazon S3.
This fulfills all requirements with minimal administrative effort.

Key Concept

Fully managed, serverless stream delivery and format conversion with Amazon Data Firehose
Estimated Time:45s
Rate this question

Topics

High-Performing Data Ingestion and Transformation Solutions

More questions from this topic