Mind

Synesthesia: when senses cross, and what it reveals about everyone's perception

About 4% of people experience consistent cross-modal sensations — seeing letters as colors, hearing music as shapes. The research has implications well beyond the synesthetes themselves.

Dr. Aiko Tanaka
Reader, Cambridge Centre for the Brain and Behaviour
4 min read

When Daniel Tammet recites pi to 22,514 digits, he doesn't experience the numbers as a sequence of digits to be memorized. He experiences them as a landscape of shapes and colors. Each digit has its own visual character; their succession produces a kind of visual story. He remembers the numbers because he remembers the picture.

Tammet is a synesthete — one of the roughly 4% of people whose senses are cross-wired in consistent ways (Simner et al., 2006). Synesthesia has been studied for over a century, and the modern research has implications beyond the synesthetes themselves.

1. The varieties

Synesthesia comes in many forms. The most common are:

Grapheme-color. Letters and numbers consistently have specific colors. Most synesthetes who see "A" as red see it as red across decades, with high consistency.

Sound-color (chromesthesia). Musical notes, voices, or general sounds trigger color experiences. Common in musicians.

Spatial-sequence. Sequences (months, numbers, days of the week) are spatially organized in the mind's eye.

Lexical-gustatory. Specific words trigger specific tastes. The rarest of the well-documented forms.

Other variants exist (touch-emotion, pain-color, personality-color). Some synesthetes have multiple types; most have one.

2. The neural basis

fMRI studies show that synesthetic experience activates real sensory cortex. A grapheme-color synesthete seeing the letter A doesn't imagine red; they show activation in color-sensitive visual cortex (V4) that non-synesthetes don't show for the same stimulus (Hubbard & Ramachandran, 2005).

The leading explanation: synesthesia involves abnormally retained cross-modal connections from infancy. Infant brains show extensive cross-sensory connectivity that gets pruned during development. Synesthetes appear to retain some of those connections into adulthood.

This is consistent with the genetic evidence — synesthesia runs in families. Specific gene variants linked to neural pruning have been associated with synesthetic phenotypes (Asher et al., 2009).

3. The induced version

In the 2010s, researchers showed that some forms of synesthesia could be induced in non-synesthetes through training. Bor and colleagues' 2014 study trained adults to associate letters with colors over several weeks. After training, participants showed behavioral signs of synesthesia-like cross-activation, though without the full subjective experience (Bor, Rothen, & Schwartzman, 2014).

This is striking. The neural infrastructure for synesthesia appears to be available in everyone, just normally suppressed. Whether this means everyone has latent synesthesia or whether trained associations are categorically different from native synesthesia is unresolved.

4. The implication for ordinary perception

Most non-synesthetes have subtle cross-modal associations that match synesthete patterns. Across cultures, people consistently associate:

  • High-pitched sounds with bright colors and high spatial positions
  • Low-pitched sounds with dark colors and low spatial positions
  • "Bouba" (round shape) with sound /b-o-b-a/; "kiki" (spiky shape) with /k-i-k-i/ — the famous Köhler effect

These shared associations suggest synesthesia isn't a bizarre exception but an extreme version of cross-modal connections present in all human perception. The synesthete's brain just expresses them more vividly.

5. The implication for learning

For an adult learner — particularly of a language with unfamiliar script — the cross-modal connections that everyone has can be deliberately recruited. Mnemonic systems that link letters to images, words to gestures, vocabulary to physical actions exploit these connections. They are not just memory tricks; they are recruiting infrastructure that the brain has anyway.

Adult learners with strong synesthetic tendencies often report unusual ease in acquiring scripts and vocabulary, particularly when the cross-modal associations align. The rest of us can partially induce the same advantage through training.

The synesthete brain isn't different in kind from the typical brain. It's the same brain with the cross-modal connections turned up. That's an interesting place to be.

References
  1. Asher, J. E., Lamb, J. A., Brocklebank, D., et al. (2009). A whole-genome scan and fine-mapping linkage study of auditory-visual synesthesia. American Journal of Human Genetics, 84(2), 279-285.
  2. Bor, D., Rothen, N., & Schwartzman, D. J. (2014). Adults can be trained to acquire synesthetic experiences. Scientific Reports, 4, 7089.
  3. Hubbard, E. M., & Ramachandran, V. S. (2005). Neurocognitive mechanisms of synesthesia. Neuron, 48(3), 509-520.
  4. Simner, J., Mulvenna, C., Sagiv, N., et al. (2006). Synaesthesia: The prevalence of atypical cross-modal experiences. Perception, 35(8), 1024-1033.