Interactive brain map

A 3D view of a person's cerebral cortex. Alexander Huth

Each day, as we talk to friends, family, and coworkers, and consume podcasts, movies, and other media, we are ceaselessly bombarded by the spoken word. Yet somehow, our brains are able to piece out the meaning of these words, allowing us to seamlessly, in most cases, go about our days, understanding, remembering, and responding when necessary.

But what’s going on in our brains that allows us to understand this endless stream? A group of scientists set out to map how the brain represents the meaning of spoken language, word by word. Their results, , not only represent a first-of-its-kind directory or ‘semantic atlas’ to display how the meaning of language is grouped in the brain, but also shows that we use a broad range of regions in the brain, challenging the belief that language is limited to a few brain areas and involving only the left hemisphere.

Word meaning, also known as semantics, focuses on the relationship between words and phrases and what they mean, their connotation. Words like purchase, sale, item, store, card, and package, for example, all have something in common — you go to a store to purchase an item using your debit card. To understand semantics in the brain, previous studies used single words or phrases to see what’s going on.

But Jack Gallant, a neuroscientist at UC Berkeley, and his colleagues, including lead author Alex Huth, wanted to know how our brains map out a more natural, narrative story. They asked seven participants to listen to a few hours of The Moth Radio Hour, a storytelling program. They hooked each participant up to an fMRI machine — which measures changes in blood flow and volume caused by the activity of neurons in the brain — so they could see exactly what areas of the brain lit up and when.

brain interactive mapAfterwards, they used transcripts of the narratives along with the fMRI scans to understand first what words corresponded to the lit up areas of the brain and second, to create a model that predicts brain activity based on the words the person heard.

An interactive model of how we understand language

By putting together information from all seven participants, with the help of a statistical model, the researchers created a brain atlas, a 3D model of the brain that shows what brain areas lit up at the same time among all the participants. They also created an interactive version of the atlas. The interactive can be found here.

People were scanned using functional magnetic resonance imaging (fMRI) while they listened to hours of stories from The Moth Radio Hour.

Participants listened to hours of spoken language while scientists scanned their brains using an fMRI scanner. Using a computer algorithm, they created an atlas of the brain's response to different word categories. Alexander Huth

What does the model tell us about language?

The researchers found that word meaning is distributed across the cerebral cortex, in 100 different areas that span both hemispheres. Looking at all the participants’ scans as a whole, they found that certain regions of the brain are associated with certain word meanings. For example, hearing language about people tends to activate one area of the brain, about places in another, and about numbers in a third-demonstrating a basic organizing principle for how the brain handles different components of language.

While the results were quite similar across individuals, this doesn’t mean that the researchers have created a definitive atlas for language. First, the study only looked at seven participants, all from the same area of the world and all speakers of English. It also only used just one source of input: a series of spoken, engaging narrative stories. The researchers are eager to learn how things like experience, native language, and culture will alter the map.

Further, Gallant says, they think the map could also change if the setting changed or if a person was in a different mental state: if a person read the story instead of hearing it, or instead of hearing an engaging story, the context was tedious cramming for an exam.

Gallant says these would likely change the map as well, and he plans to learn how in future research.

You might also like

Computational Analysis Methods and Issues in Human
Computational Analysis Methods and Issues in Human ...
TEDxVienna - Moritz Helmstaedter - Brain Mapping
TEDxVienna - Moritz Helmstaedter - Brain Mapping

Copyright © . All Rights Reserved