A retail business requires a daily ingestion pipeline to transfer of operational log files from on-premises servers to Azure. The pipeline runs once every 24 hours. The storage solution must persist the logs in a hierarchical structure and guarantee data durability even during a regional datacenter disaster. Additionally, the data science team needs to perform infrequent, exploratory analysis directly on these files. Which two architectural choices should you make to meet these requirements? (Select two.)
- Azure Data Factory to manage and run the daily transfer pipelineAnswer
- Azure Data Lake Storage Gen2 using Geo-Redundant Storage (GRS)Answer
- CAzure Data Lake Storage Gen2 using Locally Redundant Storage (LRS)
- DAn Azure Synapse Dedicated SQL Pool to run ad-hoc queries on the raw files
Answer
Azure Data Factory and Azure Data Lake Storage Gen2 using Geo-Redundant Storage (GRS)
To orchestrate the daily transfer pipeline, Azure Data Factory is the correct choice. To survive a regional outage, the storage must be configured with Geo-Redundant Storage (GRS) since it replicates the data to a secondary region.
Step-by-Step Solution
Key Concept
Designing batch data integration pipelines and choosing disaster-resilient analytical storage replication.