Language shapes how visual knowledge is stored in the brain

Publicly released:
International
Image by Robina Weermeijer via UnSplash
Image by Robina Weermeijer via UnSplash

Language isn’t just for communication—it fundamentally shapes how sensory experiences are stored in our brains. Seeing a yellow banana, and knowing that the word "banana" refers to something yellow, activate the same part of the brain responsible for processing visual information.  However, there’s evidence that language-processing brain regions are also involved. Using fMRI, researchers found that stroke patients with stronger connections between language and visual processing regions of the brain were better at matching objects to their typical colour.  The results suggest sophisticated connections between vision and language in the human brain.

Media release

From: PLOS

Language isn’t just for communication — it also shapes how sensory experiences are stored in the brain

A study in stroke patients shows the brain’s vision-language connection shapes object knowledge.

Our ability to store information about familiar objects depends on the connection between visual and language processing regions in the brain, according to a study published May 20th in the open-access journal PLOS Biology by Bo Liu from Beijing Normal University, China, and colleagues.

Seeing an object and knowing visual information about it, like its usual color, activate the same parts of the brain. Seeing a yellow banana, for example, and knowing that the object represented by the word “banana” is usually yellow, both excite the ventral occipitotemporal cortex (VOTC). However, there’s evidence that parts of the brain involved in language, like the dorsal anterior temporal lobe (ATL), are also involved in this process — dementia patients with ATL damage, for example, struggle with object color knowledge, despite having relatively normal visual processing areas. To understand whether communication between the brain’s language and sensory association systems is necessary for representing information about objects, the authors tested whether stroke-induced damage to the neural pathways connecting these two systems impacted patients’ ability to match objects to their typical color. They compared color-identification behavior in 33 stroke patients to 35 demographically-matched controls, using fMRI to record brain activity and diffusion imaging to map the white matter connections between language regions and the VOTC.

The researchers found that stronger connections between language and visual processing regions correlated with stronger object color representations in the VOTC, and supported better performance on object color knowledge tasks. These effects couldn’t be explained by variations in patients’ stroke lesions, related cognitive processes (like simply recognizing a patch of color), or problems with earlier stages of visual processing. The authors suggest that these results highlight the sophisticated connection between vision and language in the human brain.

The authors add, “Our findings reveal that the brain’s ability to store and retrieve object perceptual knowledge—like the color of a banana—relies on critical connections between visual and language systems. Damage to these connections disrupts both brain activity and behavior, showing that language isn’t just for communication—it fundamentally shapes how sensory experiences are neurally structured into knowledge.”

Multimedia

A schematic view of the main findings, adapted from a  brain figure in the study
A schematic view of the main findings, adapted from a brain figure in the study

Attachments

Note: Not all attachments are visible to the general public. Research URLs will go live after the embargo ends.

Research PLOS, Web page Public link will go live after the embargo lifts
Journal/
conference:
PLOS Biology
Research:Paper
Organisation/s: Beijing Normal University, Peking University, First Hospital of Shanxi Medical University
Funder: This work was supported by the STI2030-Major Project (https://en.most.gov.cn/, 2021ZD0204100 (2021ZD0204104) to Y.B.), the National Natural Science Foundation of China (https://www.nsfc.gov.cn/english/site_1/index.html, 31925020 and 82021004 to Y.B., 32171052 to X.S.W., 32071050 to X.Y.W.), and the Fundamental Research Funds for the Central Universities (http://en.moe.gov.cn/, to Y.B.). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Media Contact/s
Contact details are only visible to registered journalists.