Examkin

Question

Difficulty: MediumHigh-Performing and Scalable Storage Solutions

A company is building a big data analytics solution that ingests large, multi-gigabyte datasets from various global research partners. The files are uploaded to an Amazon S3 bucket. The data transfer speed is currently slow and inconsistent due to high latency and network congestion over long geographic distances.

Which combination of solutions should a solutions architect implement to maximize the upload performance of these large files? (Choose two.)

  1. Use Amazon S3 Transfer Acceleration to leverage the AWS edge network for global uploads.Answer
  2. Use S3 Multipart Upload to upload the large files in parallel and parallelize the data transfer.Answer
  3. C
    Provision an Amazon EFS file system with Provisioned Throughput to act as an ingestion staging area.
  4. D
    Configure S3 Lifecycle policies to immediately transition incoming data to S3 Standard-Infrequent Access (S3 Standard-IA).
  5. E
    Attach Amazon EBS gp3 volumes with Multi-Attach enabled to the source servers to increase local throughput.

Answer

Use Amazon S3 Transfer Acceleration to leverage the AWS edge network for global uploads, and use S3 Multipart Upload to upload the large files in parallel and parallelize the data transfer.
To maximize upload performance of large files from global locations, the solution requires optimizing the network path and parallelizing the upload process. The option recommending Amazon S3 Transfer Acceleration addresses network latency by routing uploads through AWS Edge Locations over the AWS internal network instead of the public internet. The option recommending S3 Multipart Upload allows the source clients to split large files and upload the parts in parallel, which optimizes network throughput and resilience.

Step-by-Step Solution

1
Analyze the workload requirements and identify bottlenecks.
The requirements are: ingesting large multi-gigabyte files from geographically distributed global partners into Amazon S3 with slow, inconsistent internet speeds.
Understanding the core bottleneck (geographic distance and network latency for large file transfers) helps eliminate local storage configurations that do not address WAN performance.
2
Evaluate solutions designed to optimize wide area network (WAN) data transfer to Amazon S3.
Amazon S3 Transfer Acceleration is identified as the native AWS solution to route traffic through the nearest AWS edge location and over the optimized AWS global backbone network.
This directly reduces latency and routing hops across the internet for global users.
3
Evaluate S3 capabilities for handling large files to improve throughput and fault tolerance.
S3 Multipart Upload is identified as the native S3 feature designed to upload large files in parallel parts.
By splitting files into parts, network bandwidth is maximized via parallel uploads, and network failures are mitigated since only failed parts need to be re-uploaded.

Key Concept

High-performing S3 data ingestion involves combining network routing optimization (S3 Transfer Acceleration) and object upload parallelization (S3 Multipart Upload).
Rate this question

Topics

High-Performing and Scalable Storage Solutions

More questions from this topic