Question

Difficulty: Very hardBias, Confounding, and Validity

A multicenter, randomized controlled trial evaluates a novel biologic agent compared to a standard immunosuppressant for the induction of remission in severe Crohn's disease. The primary outcome is clinical remission at 1212 weeks. The crude risk ratio (RR) for remission with the novel biologic versus standard therapy is 1.451.45 (95% CI, 1.20−1.751.20 - 1.75).

During a secondary analysis, the investigators stratify the results by the patients' baseline smoking status, which is a known independent risk factor for poor outcomes in Crohn's disease.
- In the stratum of non-smokers, the RR for remission is 1.851.85 (95% CI, 1.40−2.451.40 - 2.45).
- In the stratum of active smokers, the RR for remission is 0.950.95 (95% CI, 0.75−1.200.75 - 1.20).

Which of the following is the most appropriate statistical approach for interpreting and reporting these findings?

  1. A
    Apply an Analysis of Variance (ANOVA) to assess whether smoking duration significantly alters the mean categorical response rate.
  2. Detail the individual risk ratios for smokers and non-smokers separately to highlight the interaction between the intervention and smoking habits.Answer
  3. C
    Use a Mantel-Haenszel estimator to derive a combined risk ratio that controls for baseline smoking habits.
  4. D
    Utilize the disparate risk ratios to calculate new positive and negative predictive values, as the prevalence of smoking alters the sensitivity of the biologic agent.
  5. E
    Retain the unadjusted risk ratio of 1.451.45 for the primary publication, as randomization successfully mitigates subgroup differences.

Answer

The most appropriate approach is to report the individual risk ratios for each smoking stratum separately, because the data demonstrates effect modification.
This scenario perfectly illustrates effect modification (statistical interaction). Effect modification occurs when the magnitude of an intervention's effect differs significantly depending on the level of a third variable (here, smoking status). Because the stratum-specific risk ratios (1.851.85 and 0.950.95) are substantially different from each other, the effect of the biologic agent depends heavily on whether the patient smokes. Unlike confounding, which is a form of bias that investigators attempt to control or eliminate, effect modification is a true biological reality that provides vital clinical context. Therefore, the standard and most appropriate statistical approach is to report the stratum-specific estimates separately to clearly communicate the differential efficacy to clinicians.

Step-by-Step Solution

1
Analyze the unadjusted (crude) risk ratio.
The overall crude RR is 1.451.45, indicating a general benefit of the novel biologic agent.
Establishing the baseline overall effect is necessary before evaluating subgroup differences.
2
Compare the stratum-specific risk ratios to each other and to the crude risk ratio.
The RR for non-smokers is 1.851.85, while the RR for smokers is 0.950.95. These values are substantially different from each other.
Stratification is the primary method to differentiate between confounding and effect modification.
3
Identify the underlying epidemiological phenomenon.
Because the stratum-specific estimates differ significantly from each other, this demonstrates effect modification (statistical interaction), not confounding.
If smoking were merely a confounder, the stratum-specific RRs would be similar to each other, but different from the crude RR.
4
Determine the correct statistical reporting method for the identified phenomenon.
The correct approach is to report the stratum-specific risk ratios independently.
Effect modification is a clinically meaningful interaction that guides targeted patient care. Pooling the results (e.g., via Mantel-Haenszel) would incorrectly obscure this interaction.

Key Concept

Effect Modification vs. Confounding
Rate this question