Science

WEIRD samples: psychology's most unrepresentative subjects

The bulk of what we 'know' about human behavior comes from a population that represents about 12% of humanity. The 2010 paper that named the problem changed how the field thinks about generalizing.

James Okonkwo
Contributing Editor, Tessera. PhD, Behavioral Economics, LSE
4 min read

In 2010, Joseph Henrich, Steven Heine, and Ara Norenzayan published a paper in Behavioral and Brain Sciences with a clean title: "The weirdest people in the world?" Their argument: psychology had spent most of the twentieth century studying a single, demographically narrow population, then generalizing the findings as if they applied to human nature. The population they had studied: Western, Educated, Industrialized, Rich, and Democratic — WEIRD.

The paper documented that across two decades of major psychology journals, 96% of subjects came from countries representing about 12% of the world's population. American undergraduates alone accounted for the majority (Henrich, Heine, & Norenzayan, 2010).

This is not a methodological footnote. It changes how nearly every finding in pop psychology should be read.

1. What WEIRD samples actually look like

The typical psychology study subject in 2010 was a 20-year-old American university student, predominantly white, middle-class, taking an Intro to Psychology course in which research participation was required. Subjects in industrialized economies generally are wealthier, more individualistic, more analytic, more interaction-with-strangers experienced, and more rule-following than the global average.

These traits are not neutral. They shape responses in nearly every domain psychology measures.

2. The specific findings that don't generalize

The Henrich et al. paper documented several findings that the wider literature had treated as universal but that turn out to be partly WEIRD-specific:

Visual illusions. The Müller-Lyer illusion (one line looks longer than another) is much stronger in subjects from carpentered environments (rectangular rooms with right angles) than in subjects from rounded-dwelling cultures. Americans show large effects. San hunter-gatherers show almost none (Segall et al., 1966).

Fairness norms in economic games. Ultimatum game offers and rejection behavior vary substantially across cultures. Behavior in Western samples is not the global default (Henrich et al., 2005).

Moral reasoning. What Kohlberg called "post-conventional moral reasoning" — the high-level abstract justice orientation — is heavily concentrated in WEIRD populations. Other cultures organize moral judgment differently, not less developmentally.

Self-construal. The "I am unique" emphasis is far stronger in WEIRD samples than in collectivist samples. Most psychological theories of self assume the former.

3. The honest scope of impact

It's not that WEIRD findings are wrong. It's that they often describe a specific cultural-cognitive ecology rather than universal human nature. Some findings generalize well (basic visual perception, working memory limits, sleep architecture). Others don't.

The default assumption in popular psychology writing — "the brain works like this" — should be replaced with "the brain in this kind of person, raised in this kind of environment, works like this." The qualification often matters.

4. Where the field has gone

Since 2010, several large psychology programs have explicitly diversified samples. The journal Psychological Science now requires reporting on whether samples are WEIRD. Cross-cultural psychology has expanded substantially. Initiatives like the Psychological Science Accelerator coordinate replications across continents.

Progress is uneven. American undergraduates are still overrepresented. But the framing — "we know human nature works this way because we asked some Stanford freshmen" — has at least become embarrassing in a way it wasn't in 1995.

5. The reader's takeaway

For a non-specialist reader of pop psychology: when you encounter a claim that begins "humans tend to," ask which humans. If the study was done in 2008 at a major American university, the answer is likely "young American university students with broadly modern Western socialization." That's a real population worth studying. It is not, by itself, human nature.

References
  1. Henrich, J., Boyd, R., Bowles, S., Camerer, C., Fehr, E., & Gintis, H. (2005). "Economic man" in cross-cultural perspective. Behavioral and Brain Sciences, 28(6), 795-815.
  2. Henrich, J., Heine, S. J., & Norenzayan, A. (2010). The weirdest people in the world? Behavioral and Brain Sciences, 33(2-3), 61-83.
  3. Segall, M. H., Campbell, D. T., & Herskovits, M. J. (1966). The Influence of Culture on Visual Perception. Bobbs-Merrill.