Question

Difficulty: MediumData Integration and Analytical Storage

A retail corporation is designing an analytical data platform on Azure to analyze sales transactions. The solution must meet the following requirements:
- Ingest 100 GB100\text{ GB} of CSV and Parquet files daily into Azure Data Lake Storage Gen2 (ADLS Gen2), with a total historical volume of 50 TB50\text{ TB}.
- Enable data analysts to perform ad-hoc exploratory queries directly on the data lake files without provisioning or managing pre-allocated compute resources.
- Protect the data against both localized zone failures and regional disasters.
- Provide external auditors with read-only access to a specific folder in the data lake for 3030 days, with the ability to immediately revoke access if necessary.

Which two options should you include in the recommendation to meet these requirements?

  1. Configure the ADLS Gen2 storage account to use Read-Access Geo-Zone-Redundant Storage (RA-GZRS), and use Azure Synapse Analytics serverless SQL pools for the ad-hoc exploratory queries.Answer
  2. Create a stored access policy on the target folder container, and generate a Shared Access Signature (SAS) token linked to this policy to provide access to the external auditors.Answer
  3. C
    Configure the ADLS Gen2 storage account to use Locally Redundant Storage (LRS) to minimize replication costs and reduce the latency of query execution.
  4. D
    Provision an Azure Synapse Analytics dedicated SQL pool to host and query the raw CSV and Parquet data directly from the storage account.

Answer

Configure the Azure Data Lake Storage Gen2 account to use Read-Access Geo-Zone-Redundant Storage (RA-GZRS), use Azure Synapse Analytics serverless SQL pools for ad-hoc exploratory queries, and use a stored access policy linked to a Shared Access Signature (SAS) to grant the external auditors access.
The requirement for high availability and disaster recovery across zone and regional outages is satisfied by using Read-Access Geo-Zone-Redundant Storage (RA-GZRS), which replicates data across multiple zones in the primary region and to a secondary region. The requirement for ad-hoc queries without pre-allocated compute is met by Azure Synapse Analytics serverless SQL pools, which query data directly in the data lake without provisioning compute resources. The requirement for revokable access is met by generating a Shared Access Signature (SAS) linked to a stored access policy, allowing direct revocation of access by modifying or deleting the policy.

Step-by-Step Solution

1
Analyze the storage redundancy and disaster recovery requirement.
Identify that Locally Redundant Storage (LRS) is insufficient for regional disaster resilience and zone failures. Read-Access Geo-Zone-Redundant Storage (RA-GZRS) is required.
RA-GZRS replicates data across availability zones in the primary region and geo-replicates it to a secondary region.
2
Analyze the compute model for ad-hoc queries.
Select Azure Synapse Analytics serverless SQL pools instead of dedicated SQL pools.
Serverless SQL pools allow querying files directly in Azure Data Lake Storage Gen2 without provisioning persistent compute resources, whereas dedicated SQL pools require provisioned compute clusters.
3
Determine the secure temporary access mechanism.
Recommend using a Shared Access Signature (SAS) linked to a stored access policy.
A stored access policy allows the immediate revocation of the SAS by altering or deleting the policy, which is not possible with an ad-hoc SAS unless the storage account keys are rotated.

Key Concept

Designing highly available, cost-effective analytical storage solutions on Azure utilizing Synapse serverless SQL pools and securing access using stored access policies.
Rate this question