Match each of the following flawed arguments (Left) with the abstract logical description of its specific sampling or survey error (Right).
- To gauge citywide support for a new nighttime noise ordinance, the city council surveyed residents who attended a 2:00 PM Wednesday town hall meeting. Finding that 85% supported the measure, the council concluded that a vast majority of the city's population favors the ordinance.It generalizes about a population based on a sample that systematically excludes individuals who are unlikely to be available at the time the sample is drawn.
- A productivity app developer sought to prove their tool increases daily output. They sent an in-app questionnaire asking, 'How much has our app helped you achieve your goals this week?' and concluded from the overwhelmingly positive responses that the app objectively boosts productivity.It relies on survey responses elicited by phrasing that presupposes the truth of the conclusion being drawn.
- An historian analyzed the structural integrity of 18th-century wooden ships by examining the five vessels from that era currently preserved in maritime museums. Because all five exhibit exceptional craftsmanship, the historian concluded that 18th-century shipbuilders universally maintained extremely high structural standards.It bases a judgment about an entire class of objects on a subset that possesses a specific characteristic merely by virtue of having endured to the present.
- A restaurant chain implemented a new QR-code feedback system on their receipts. After a month, 90% of the submitted reviews were heavily critical of the service speed. Management concluded that nearly all of their customers are dissatisfied with the speed of service.It takes for granted that a group of individuals who self-select to participate in an evaluation are representative of the broader population of consumers.
Answer
The town hall survey matches the temporal exclusion flaw; the app survey matches the presuppositional phrasing flaw; the historian matches the survival subset flaw; and the restaurant matches the self-selection flaw.
Each argument commits a distinct sampling or survey flaw. The town hall argument surveys people at a highly restrictive time, excluding a massive demographic. The app developer uses a leading question that forces a positive premise. The historian looks only at surviving artifacts, which inherently misrepresents the average quality of all artifacts originally produced. Finally, the restaurant relies on a voluntary feedback mechanism, which disproportionately attracts dissatisfied customers.
Step-by-Step Solution
Key Concept
Sampling and Survey Flaws