A financial analytics firm is planning to migrate its core infrastructure to Google Cloud. The workload includes 1.2 PB of historical unstructured market data stored on an on-premises SAN and an active 8 TB MySQL database supporting real-time trading analytics. The firm has a dedicated 1 Gbps network connection to Google Cloud via Dedicated Interconnect, with a maximum allocated bandwidth of 700 Mbps for migration traffic. Enterprise compliance requires complete transfer of historical data within 21 days, and the business allows a maximum database cutover downtime window of 4 hours. Which architecture and data transfer strategy successfully meets these operational and business constraints?
- Order a GCP Transfer Appliance to transfer the 1.2 PB historical market data offline to Cloud Storage, and utilize Database Migration Service (DMS) for Cloud SQL for MySQL to perform initial data loading and continuous change data capture (CDC) over Dedicated Interconnect prior to final cutover.Answer
- BUtilize Storage Transfer Service over the 700 Mbps Dedicated Interconnect link to stream the 1.2 PB historical market data directly to Cloud Storage, while using Database Migration Service with continuous CDC for the 8 TB MySQL database.
- COrder a GCP Transfer Appliance for the 1.2 PB historical market data transfer, and migrate the 8 TB MySQL database to Cloud Spanner using a full database export and import during the 4-hour maintenance window.
- DEstablish an HA VPN tunnel over the public internet to transfer both the 1.2 PB market data and the 8 TB MySQL database replication streams concurrently to reduce infrastructure cost.
Answer
Order a GCP Transfer Appliance to perform an offline transfer of the 1.2 PB historical market data to Cloud Storage, and use Database Migration Service (DMS) with continuous Change Data Capture (CDC) over Dedicated Interconnect to migrate the 8 TB MySQL database to Cloud SQL for MySQL.
The correct strategy combines an offline Transfer Appliance for the 1.2 PB static historical dataset with Database Migration Service (DMS) over Dedicated Interconnect for the 8 TB MySQL database. The network calculation shows that transferring 1.2 PB over 700 Mbps would take over 150 days, making an offline appliance necessary to meet the 21-day timeline. Furthermore, continuous CDC via DMS keeps the destination database updated in real-time, allowing the final cutover to take place well within the 4-hour downtime window.
Step-by-Step Solution
Key Concept
Designing hybrid data migration strategies balancing network bandwidth limitations, offline appliances, and database replication services.