Soru

Zorluk: Çok zorManaging Storage and Data Transfer Costs

An enterprise runs a large-scale data analytics platform on AWS. The central data lake is hosted in an Amazon S3 bucket in the `us-west-2` Region, containing 150 TB150\text{ TB} of data that changes or grows by approximately 10 TB10\text{ TB} each month. A processing cluster runs on Amazon EKS nodes located in private subnets across 33 Availability Zones in the `us-east-1` Region. The cluster executes batch analysis jobs every day, reading a total of 300 TB300\text{ TB} of data monthly from the `us-west-2` bucket. Currently, the EKS nodes access the S3 bucket via local NAT Gateways in each Availability Zone. The company needs to optimize the architecture to achieve the lowest possible total cost for S3 storage and data transfer without introducing a single point of failure or violating high availability standards. Which solution meets these requirements most cost-effectively?

  1. A
    Consolidate the VPC route tables in the `us-east-1` VPC to direct all outbound S3 traffic to a single NAT Gateway located in one public Availability Zone, and continue reading data directly from the `us-west-2` bucket.
  2. Configure S3 Cross-Region Replication (CRR) from the `us-west-2` bucket to a new S3 bucket in `us-east-1`. Create an S3 Gateway VPC Endpoint in the `us-east-1` VPC. Configure the EKS applications to read from the replicated local bucket in `us-east-1`.Cevap
  3. C
    Establish an AWS Transit Gateway in `us-east-1` and peer it with a Transit Gateway in `us-west-2`. Route the EKS S3 traffic through the Transit Gateway peering connection to access the `us-west-2` bucket using a Gateway VPC Endpoint deployed in `us-west-2`.
  4. D
    Order an AWS Snowball Edge Storage Optimized device to physically transport the initial 150 TB150\text{ TB} dataset from `us-west-2` to `us-east-1`, and schedule monthly Snowball shipments to transfer the 10 TB10\text{ TB} delta updates.

Cevap

Configure Amazon S3 Cross-Region Replication to copy the data from the source Region to the destination Region, and access it locally via an S3 Gateway VPC Endpoint.
Replicating the dataset to the local Region via Cross-Region Replication (CRR) requires paying a one-time data transfer cost for only the new or modified data (10 TB/month10\text{ TB/month}) and local S3 storage costs for the 150 TB150\text{ TB}. The EKS workloads can then read the 300 TB300\text{ TB} of data over a local S3 Gateway VPC Endpoint, which is highly available and carries no data processing or hourly charges. This reduces the total cost to around $3,635/month\$3,635/\text{month}, which is the most cost-effective and highly available solution.

Adım Adım Çözüm

1
Calculate the current cost of routing cross-Region traffic to S3 over NAT Gateways.
Monthly cost is approximately 19,968,consistingofcrossRegionS3datatransferout(19,968, consisting of cross-Region S3 data transfer out ( 300\text{ TB} \times 1024 \text{ GB/TB} \times \0.02/GB=$6,1440.02/\text{GB} = \$6,144) and NAT Gateway processing (300 TB×1024 GB/TB×$0.045/GB=$13,824300\text{ TB} \times 1024 \text{ GB/TB} \times \$0.045/\text{GB} = \$13,824).
Establishing a baseline cost helps evaluate the savings of alternative architectures.
2
Evaluate S3 Cross-Region Replication (CRR) data transfer and storage costs.
Replicating the monthly 10 TB10\text{ TB} delta costs 10×1024 GB×$0.02/GB=$204.8010 \times 1024 \text{ GB} \times \$0.02/\text{GB} = \$204.80. Storing the 150 TB150\text{ TB} dataset in S3 Standard in `us-east-1` costs approximately 50 TB×1024 GB/TB×$0.023/GB+100 TB×1024 GB/TB×$0.022/GB=$3,430.40/month50\text{ TB} \times 1024 \text{ GB/TB} \times \$0.023/\text{GB} + 100\text{ TB} \times 1024 \text{ GB/TB} \times \$0.022/\text{GB} = \$3,430.40/\text{month}.
Replication transfers data once, enabling all subsequent reads to happen locally.
3
Add an S3 Gateway VPC Endpoint in the EKS VPC.
Enables the EKS nodes to read the 300 TB300\text{ TB} of data locally from the replicated bucket in `us-east-1` for 0/GB0/\text{GB} data transfer and data processing fees.
VPC Gateway Endpoints provide free, highly available access to S3 within the same Region.
4
Sum the total cost of the replication-based solution and compare to the baseline.
Total cost is $3,635.20/month\$3,635.20/\text{month} (greater than 80%80\% savings compared to the baseline of $19,968/month\$19,968/\text{month}).
Confirms this approach is the most cost-effective while maintaining high availability.

Anahtar Kavram

Optimizing cross-Region storage costs by using S3 Cross-Region Replication (CRR) to localize read-heavy traffic and leveraging free Gateway VPC Endpoints within the same Region.
Bu soruyu puanla