A research institution is deploying a distributed high-performance computing (HPC) pipeline on AWS for genomic sequencing. The pipeline is deployed across a fleet of Amazon EC2 instances. The pipeline requires a shared storage solution that supports concurrent read and write access from hundreds of instances, delivers sub-millisecond latency, and scales throughput up to . Additionally, the solution must automatically load raw input datasets from a designated Amazon S3 bucket when files are first accessed, and export output results back to the S3 bucket upon pipeline completion.
Which combination of steps should the solutions architect take to meet these performance and integration requirements? (Choose two.)
- Create an Amazon FSx for Lustre file system with a data repository association linked to the Amazon S3 bucket.Answer
- Mount the FSx for Lustre file system on the EC2 instances using the Lustre client.Answer
- CProvision an Amazon EBS io2 volume with Multi-Attach enabled, format it with a clustered file system, and mount it to the instances.
- DCreate an Amazon Elastic File System (Amazon EFS) file system with Elastic throughput mode, and link it to the S3 bucket using an AWS Storage Gateway.
- EDeploy an Amazon FSx for OpenZFS file system, configure a data repository association with the S3 bucket, and mount it using NFSv4.
Answer
Create an Amazon FSx for Lustre file system with a data repository association linked to the Amazon S3 bucket, and mount the file system on the EC2 instances using the Lustre client.
The combination of creating an Amazon FSx for Lustre file system with a data repository association and mounting it using the Lustre client meets all criteria. FSx for Lustre is designed for HPC workloads, supporting parallel client access, throughput scaling to tens of gigabytes per second, and sub-millisecond latency. The data repository association automates the ingestion from and exportation to Amazon S3.
Step-by-Step Solution
Key Concept
Amazon FSx for Lustre provides high-performance parallel file systems that integrate directly with Amazon S3 using Data Repository Associations, enabling high-performance computing (HPC) applications to process large datasets at low latencies.
Estimated Time:2m 30s