A telecommunications provider is designing an analytical data platform to process and query call detail record (CDR) log files. The platform must meet the following requirements:
- Ingest of CDR files daily at a peak velocity of files per minute.
- Store the raw logs cost-effectively in Azure Data Lake Storage Gen2 (ADLS Gen2).
- Enable analysts to run ad-hoc, exploratory SQL queries directly on the raw files with a query latency of under .
- Orchestrate a weekly batch transformation job that aggregates the CDR data, which typically takes to run.
Which of the following Azure components should you include in the design to meet these requirements? (Select TWO.)
- Azure Synapse serverless SQL pools to query the raw log files in Azure Data Lake Storage Gen2Answer
- BAzure Synapse dedicated SQL pools to query the raw log files in Azure Data Lake Storage Gen2
- Azure Data Factory pipelines to orchestrate the weekly batch transformationAnswer
- DAzure Functions on a Consumption plan to run the weekly batch transformation
Answer
Azure Synapse serverless SQL pools to query the raw log files in Azure Data Lake Storage Gen2, and Azure Data Factory pipelines to orchestrate the weekly batch transformation
Azure Synapse serverless SQL pools are correct for ad-hoc exploratory queries because they allow querying unstructured or semi-structured data directly in Azure Data Lake Storage Gen2 using standard T-SQL without provisioning persistent resources. Azure Data Factory pipelines are correct for the weekly batch orchestration because they are built to manage complex data integration workflows with no runtime limits.
Step-by-Step Solution
Key Concept
Selecting appropriate Azure analytical and integration services based on query patterns, operational overhead, and execution limits