Soru

Zorluk: Çok zorHigh-Performing and Scalable Storage Solutions

A machine learning platform runs distributed training jobs on a cluster of Amazon ECS tasks running on AWS Fargate. During training, the tasks must concurrently read and write millions of small training images and weights (averaging 30 KB30\text{ KB} each) from a shared namespace. The workload requires consistent single-digit millisecond latency and must scale to support up to 250,000250,000 transactions per second (TPS). The data is transient and can be easily regenerated if an Availability Zone failure occurs. Which storage architecture will meet these performance requirements with the lowest operational complexity and latency?

  1. Configure Amazon S3 Express One Zone directory buckets to store the training data, and access it directly from the ECS tasks using the S3 API.Cevap
  2. B
    Provision an Amazon EBS io2 Block Express volume, enable Multi-Attach, and mount the volume across the ECS tasks running on AWS Fargate.
  3. C
    Create an Amazon EFS file system configured with Elastic throughput and General Purpose performance mode, and mount it to the ECS tasks.
  4. D
    Deploy an Amazon FSx for Lustre file system using a persistent SSD deployment type, and mount the file system to the ECS tasks.

Cevap

Configure Amazon S3 Express One Zone directory buckets to store the training data, and access it directly from the ECS tasks using the S3 API.
The correct option is to use Amazon S3 Express One Zone directory buckets. It is purpose-built to deliver consistent, single-digit millisecond latency for performance-critical applications and can scale to hundreds of thousands of transactions per second. Since the ECS tasks are running on AWS Fargate, using the standard S3 API avoids the operational complexity of mounting file systems and requires no OS-level client configuration.

Adım Adım Çözüm

1
Analyze workload characteristics and requirements.
The workload requires sharing millions of small files (30 KB30\text{ KB} each) with single-digit millisecond latency, scaling up to 250,000250,000 TPS, with transient data that can be regenerated on failure.
This establishes the latency, throughput, and durability requirements.
2
Evaluate the compute environment compatibility.
The application runs on AWS Fargate, which limits direct mounting of complex block or file systems (like FSx or EBS Multi-Attach) and restricts modifications to the underlying OS kernel.
This rules out solutions requiring kernel-level drivers or unsupported storage configurations on managed container runtimes.
3
Compare S3 Express One Zone, EFS, and EBS performance capabilities.
Amazon S3 Express One Zone delivers single-digit millisecond latency and scales to hundreds of thousands of TPS, making it ideal for high-performance object storage. Amazon EFS is not optimized for high-rate metadata operations on millions of tiny files, and EBS Multi-Attach is incompatible with Fargate.
S3 Express One Zone provides the highest performance for small objects at high concurrency without mount overhead.

Anahtar Kavram

Selecting high-performance and low-latency storage solutions for containerized workloads on AWS Fargate.
Bu soruyu puanla