Some people genuinely see colors when they hear music, watch shapes ripple when a door slams, or experience a wash of blue every time they hear a C-sharp. The phenomenon is called synesthesia, and it is not metaphor or imagination. Brain imaging confirms that sensory regions activate in ways that do not occur in typical brains, producing perceptual experiences that are involuntary, stable over time, and as vivid as any ordinary sight or sound. Roughly four percent of the general population has some form of it, and the variety of types is broader than most people realize.
What Seeing a Sound Actually Feels Like
Synesthesia is not one experience but a family of them. Over 80 documented varieties exist, though a handful are far more common than the rest. Grapheme-color synesthesia, where letters or numbers trigger specific colors, is the most studied. But the variety most relevant to the title question is auditory-visual synesthesia, where hearing a sound produces a color, a shape, or both. People with this form report that musical notes might trace colored arcs through their visual field, or that a dog’s bark might flash a brief amber blotch near the center of their gaze.
Not all synesthetes experience these extras in the same way. Researchers distinguish between “projectors,” who see the synesthetic color out in external space as if it were physically there, and “associators,” who experience it more like a strong mental image, vivid but internal. This is not just a matter of self-report. Cognitive tests that measure interference between the synesthetic color and a real displayed color show systematically different patterns for the two groups, confirming the distinction is rooted in how the brain processes the experience.1PubMed. Not all synaesthetes are created equal: projector versus associator synaesthetes Projectors appear to have faster, more immediate activation of visual areas that handle color and shape, which fits with their report that the experience feels external and automatic.2PubMed Central. Projectors, associators, visual imagery, and the time course of visual processing in grapheme-color synesthesia
The relationship between sounds and the colors they trigger is not random. Research on music-color synesthesia shows that synesthetes display remarkably consistent associations over time. When retested weeks or months later, they match the same notes to the same colors with far more precision than non-synesthetes could achieve even when trying hard to memorize their previous answers. Their palette also has distinctive qualities, like using more browns and fewer greens than non-synesthetes would typically choose.3Psychology of Music. Synaesthesia is linked to differences in music preference and musical sophistication and a distinctive pattern of sound-color associations The mapping is also lawful in other ways: auditory pitch, frequency range, and how complex a sound is all systematically influence the brightness, density, and number of colors a synesthete perceives.4Musicae Scientiae. Sound characteristics which affect attributes of the synaesthetic visual experience
What Is Happening in the Brain
There are two leading ideas about why synesthesia happens at a neural level, and they are not entirely contradictory. The first is cross-activation: sensory brain regions that normally operate independently are physically connected in synesthetes by extra wiring. The second is disinhibited feedback: the wiring is largely normal, but signals that would usually be suppressed by higher-level brain areas leak through, letting auditory information spill into visual processing regions.
Evidence supports both, depending on the type of synesthesia and the imaging method used. A study using magnetoencephalography, which tracks brain activity in millisecond resolution, found that in grapheme-color synesthetes, the color-processing region V4 activated just five milliseconds after the letter-recognition area, suggesting the two were firing almost simultaneously rather than one triggering the other through a slow feedback loop.5PubMed. Magnetoencephalography reveals early activation of V4 in grapheme-color synesthesia That kind of timing points toward direct cross-activation.
But in auditory-visual synesthesia, the picture looks somewhat different. An fMRI study of people who see colors when they hear music found that the main area lighting up more in synesthetes than controls was the left inferior parietal cortex, a region responsible for pulling together information from multiple senses. The classic color-processing area V4 did not show a significant difference between synesthetes and non-synesthetes in that study.6Neuropsychologia. The neural correlates of coloured music: A functional MRI investigation of auditory–visual synaesthesia A separate functional connectivity study of auditory-visual synesthetes similarly found no extra direct connection between auditory cortex and visual areas. Instead, the key difference was stronger connectivity running through the inferior parietal cortex, acting as a relay. The authors interpreted this as support for disinhibited feedback rather than direct cross-activation.7PubMed. Disinhibited feedback as a cause of synesthesia: evidence from a functional connectivity study on auditory-visual synesthetes
Regardless of which route the signals take, the underlying hardware differs. Synesthetes who see colors in response to music have greater white-matter integrity in the inferior fronto-occipital fasciculus, a major fiber bundle connecting visual and auditory association areas to the frontal lobe. The difference is strongest on the right side of the brain and in fibers running beneath the fusiform gyrus, a region involved in recognizing visual forms like letters and faces.8PubMed Central. Pathways to Seeing Music: Enhanced Structural Connectivity in Colored-Music Synesthesia A whole-brain analysis confirmed that synesthetes show large and widespread differences in brain structure and connectivity, consistent with the longstanding idea that synesthetic brains are, on the whole, more interconnected and less modular than typical brains.9PubMed Central. Synesthesia is linked to large and extensive differences in brain structure and function as determined by whole-brain biomarkers derived from the HCP (Human Connectome Project) cortical parcellation approach
Why Some Brains Develop Synesthesia
Synesthesia runs in families. Among first-degree relatives of synesthetes, prevalence is above 40 percent, which is an enormous enrichment compared to the general population rate.10American Journal of Human Genetics. A Whole-Genome Scan and Fine-Mapping Linkage Study of Auditory-Visual Synesthesia Reveals Evidence of Linkage to Chromosomes 2q24, 5q33, 6p12, and 12p12 Early studies suggested a simple dominant inheritance pattern, possibly linked to the X chromosome, which would explain why early surveys found more women than men with the trait. Larger studies have since complicated that picture. The same genome-wide linkage study identified candidate regions on four different chromosomes, confirmed cases of male-to-male transmission (which rules out simple X-linkage), and concluded that auditory-visual synesthesia is likely influenced by multiple genes with different inheritance patterns across families.
Whole-exome sequencing of three multigenerational families with sound-color synesthesia identified 37 candidate genes, with no overlapping variants between the families. Six of those genes are involved in axonogenesis, the process by which nerve cells grow the long fibers that connect one brain region to another, and they are especially active during early childhood, the period when synesthetic associations typically form.11PubMed Central. Rare variants in axonogenesis genes connect three families with sound-color synesthesia Genetic research on synesthesia consistently points to a picture that is heterogeneous and polygenic, meaning many different gene combinations can produce the trait, and it is unlikely to be caused by a single mutation.12PubMed Central. Survival of the synesthesia gene: why do people hear colors and taste words?
The leading developmental theory ties these genetic findings together. All infants appear to be born with an overabundance of neural connections between sensory regions. During normal development, synaptic density peaks early in life and then declines as the brain prunes away unused connections. In synesthetes, this pruning may be incomplete, leaving pathways that most people lose by toddlerhood. This “neonatal synesthesia” hypothesis has compelling indirect evidence. Newborns can show visual-cortex responses to auditory stimulation, and very young infants display cross-sensory preferences (such as linking certain shapes to certain colors) that fade by around eight months of age. A striking test of this idea asked adult synesthetes to discriminate non-native speech sounds and unfamiliar faces, tasks that infants can do well but older children and adults typically cannot because perceptual narrowing during development eliminates those abilities. Synesthetes outperformed controls across all of these tasks, consistent with their brains having retained some of the broad perceptual connectivity that most people lose in infancy.13PubMed Central. Reduced perceptual narrowing in synesthesia
Everyone Has a Little Cross-Modal Wiring
You do not need to be a synesthete to have some version of cross-sensory mixing. If someone asks you to match a high-pitched tone with either a small bright dot or a large dark blob, you will almost certainly pick the small bright dot. This tendency is called crossmodal correspondence, and it is remarkably consistent across cultures and age groups. People reliably link high pitch with brightness, smallness, sharpness, and high spatial position.14PubMed. Crossmodal correspondences: a tutorial review Higher-pitched sounds are also judged as harder and more angular, while lower-pitched sounds feel rounder and softer.15PubMed. Cross-sensory correspondences and cross talk between dimensions of connotative meaning: visual angularity is hard, high-pitched, and bright
These correspondences are not the same as synesthesia. In non-synesthetes, they are statistical tendencies that show up in reaction times and matching tasks, not conscious perceptual experiences. Nobody without synesthesia actually sees a flash of white when they hear a piccolo. But the two phenomena may sit on a spectrum. The same brain regions involved in multisensory integration, especially the parietal cortex, underlie both crossmodal correspondences in typical people and the more dramatic cross-sensory experiences in synesthetes. Even the specific mappings overlap: people in general, not just synesthetes, associate soft instrument timbres with rounded blue or green shapes and harsh timbres with angular red or yellow ones.16PubMed Central. Audiovisual correspondence between musical timbre and visual shapes This effect measurably helps people perform better when sounds and visuals are “congruent” (paired in the way people naturally expect) versus “incongruent.”17PubMed Central. Crossmodal correspondence of elevation/pitch and size/pitch is driven by real-world features
In other words, your brain already links senses together in subtle ways. Synesthesia may represent what happens when that natural tendency is amplified by extra connectivity and reduced pruning.
Drug-Induced Synesthesia Is Not the Same Thing
Psychedelic drugs like LSD and psilocybin are famous for producing experiences that sound a lot like synesthesia: seeing colors pulse with the music, feeling textures when hearing certain sounds. These experiences are real, but they differ from genuine synesthesia in almost every important way. Drug-induced synesthetic experiences are broader, more intense, and less specific. They do not reliably pair particular sounds with particular colors, they are not consistent from one trip to the next, and they do not occur automatically in response to a specific trigger the way genuine synesthesia does.18PubMed Central. Neurophenomenology of induced and natural synaesthesia
The underlying mechanism also appears fundamentally different. Genuine synesthesia is associated with structural brain differences: extra white-matter connections, areas of increased cortical thickness, unusual patterns of connectivity. Drug-induced experiences, by contrast, seem to arise from temporary functional changes in brain chemistry, specifically changes in serotonin signaling that temporarily lower the barriers between sensory processing streams. Once the drug wears off, the experiences stop. A detailed phenomenological comparison concluded that genuine and acquired synesthesias point to morphological (structural) brain substrates, while drug-induced experiences are based on transient functional shifts.19PubMed. Genuine and drug-induced synesthesia: a comparison
Memory Advantages and Cognitive Quirks
Synesthesia is sometimes discussed as a superpower, and there is a kernel of truth to that framing when it comes to memory. A meta-analysis pooling results from multiple studies found that synesthetes have meaningfully better long-term memory than non-synesthetes, with what researchers describe as a medium-sized advantage. Their working memory is also better, though the effect is smaller. The enhancement is pervasive, meaning it extends to all kinds of stimuli and test formats, not just to materials related to the synesthetic experience. Synesthesia is, in fact, the only known neurodevelopmental trait associated with a broad enhancement of long-term memory.20PubMed. A meta-analysis of memory ability in synaesthesia
That said, the advantage is not unlimited. Synesthesia appears to boost sensory memory most when the person is already paying attention and perceptually aware of what they are seeing. When attention is low or the stimulus is unclear, the benefit largely vanishes.21PubMed. Synesthesia improves sensory memory, when perceptual awareness is high The extra sensory information a synesthete gets from a letter or a sound likely gives their brain more features to encode, creating a richer memory trace. But that encoding still requires engagement with the material. Synesthetes do not passively absorb everything they encounter with perfect recall.
The Overlap with Autism
Synesthesia is more common among autistic people than in the general population. A controlled study found that about 19 percent of autistic adults met criteria for synesthesia, compared to roughly 7 percent of controls, making the rate in autism nearly three times higher.22PubMed Central. Is synaesthesia more common in autism? This is not just a statistical curiosity. When researchers look at sensory sensitivity profiles, synesthetes show a pattern of atypical sensitivity that qualitatively resembles what is found in autism, with both increased hypersensitivity and increased hyposensitivity across multiple senses. The pattern in synesthetes falls between that of autistic individuals and controls, as if synesthesia and autism share an underlying trait of unusual sensory processing but express it to different degrees.23Scientific Reports. Atypical sensory sensitivity as a shared feature between synaesthesia and autism
Case studies of individuals with both conditions suggest that the combination can sometimes facilitate exceptional abilities. One documented case involved a person with co-occurring synesthesia, autism, and prodigious talent, alongside strong structural brain connectivity.24PubMed Central. A case of co-occuring synesthesia, autism, prodigious talent and strong structural brain connectivity This is still an area with relatively sparse research, but it reinforces the idea that both conditions may involve variations in how extensively the brain connects and integrates information during development.
When Synesthesia Appears After Injury
Most synesthetes are born with the trait or develop it in early childhood. But in rare cases, synesthesia can be acquired later in life, usually after damage to a sensory system. One well-documented scenario is auditory-visual synesthesia appearing after vision loss. A patient who lost sight in one eye due to an ischemic optic neuropathy began seeing phosphenes, flashes of light, in response to specific sounds about two months after the injury. Brain imaging showed bilateral activation of both primary and secondary visual cortex during these episodes, suggesting that the loss of normal visual input may have opened up pathways for auditory signals to activate visual areas, a kind of rewiring on the fly.25PubMed. Seeing the sound after visual loss: functional MRI in acquired auditory-visual synesthesia
This hints at something interesting about the brain’s architecture. The connections that synesthesia exploits may exist in latent form in everyone, normally held in check by competing sensory signals and active inhibition. When that inhibition is disrupted, whether by genetics, incomplete pruning, or damage, cross-sensory experiences can emerge. The idea fits well with acquired cases and also with drug-induced states, though the durability and specificity of the experience varies enormously depending on the cause.
Sensory Substitution and Practical Uses
Understanding synesthesia has practical implications beyond academic interest. One striking application is sensory substitution for blind individuals. A device called “The vOICe” converts visual images into auditory signals, encoding features like brightness and position as different pitches and volumes. Two blind users of this device reported developing detailed visual experiences within months of sustained use, with the phenomenology continuing to evolve over years of practice.26PubMed. Visual experiences in the blind induced by an auditory sensory substitution device The users were not born synesthetes. Their brains learned to generate visual-like percepts from auditory input, mimicking the cross-sensory translation that occurs naturally in synesthesia.
These findings suggest that the boundary between senses is more flexible than our everyday experience implies. The brain is not a set of sealed chambers, one for each sense. It is a network that can route information between regions when the conditions are right, whether those conditions are genetic, developmental, or the result of deliberate training. For most people, those routes stay quiet. For synesthetes, they are permanently open. And for everyone, they may be more accessible than we assume.
Pitch, Hue, and the Rainbow Inside a Scale
Among synesthetes who see colors in response to musical pitch, the mapping between note and hue is not arbitrary. Research on people with pitch-class-color synesthesia found that the relationship between the musical scale and the color wheel is surprisingly orderly. As pitch class ascends from do through si, the associated hue rotates from approximately red through the visible spectrum toward violet, roughly mapping the circle of pitch classes onto the circle of hues.27Scientific Reports. Musical pitch classes have rainbow hues in pitch class-color synesthesia This is not a rule that every synesthete follows identically, but as a population-level pattern it is strikingly neat, and it suggests the associations are constrained by some underlying organizational principle rather than being learned arbitrarily in childhood.
The specifics of this mapping are part of what makes synesthesia scientifically interesting beyond its novelty. It tells researchers something about how the brain organizes perceptual dimensions. Pitch and hue are both cyclic (pitch repeats every octave, color wraps around the color wheel), and the brain appears to honor that structural similarity when building cross-sensory bridges. Whether that reflects shared neural coding of circular dimensions or some deeper evolutionary legacy remains an open question, but it is one reason synesthesia continues to attract attention from neuroscientists who study perception more broadly.