Game helps neuroscientists understand second language learners

Researchers found that a game could help scientists understand how second language learners learn a new language, and could even help them learn it faster.

Photo
Incidental learning happens when the learner doesn't pay attention to the thing that they're trying to learn.
Source: Carnegie Mellon University

An alien ship appears on the left side of the screen. The player hears it coming and has a laser ready. With a quick tap of the space bar, the alien is toast. The player is safe for just a moment before hearing another alien approaching, this time from the right.

The sounds the alien ships make as they enter the screen are not arbitrary—each corner of the screen represents a different Mandarin tone group. For example, when a ship comes from the left side of the screen, the player may hear voice speak a syllable with a neutral, level tone. When a ship enters from the bottom, the same syllable is heard, but with a rising tone.

The player starts to learn where ships are coming from based on what they hear, earning a higher score and, incidentally, a better way to perceive tonal differences.

The space invaders in this online game are helping the player with a lesson in Mandarin Chinese. Part of a research study supported by the National Institutes of Health and led by auditory neuroscientist Lori Holt and psycholinguist Seth Wiener, the game could help scientists understand how second language learners learn a new language, and could even help them learn it faster. "Incidental learning happens when the learner doesn't pay attention to the thing that they're trying to learn," explained Tim Murphy, a graduate student in Holt's Department of Psychology lab and a Neuroscience Institute Presidential Fellow. "When people are consciously trying to learn these sounds and think about them, for whatever reason, it's very difficult. The game helps them learn these foreign language sounds in a way that allows them to generalize to understand sounds that they haven't heard before."

Murphy said that results indicate that students who play the game were better able to categorize Mandarin tones relative to students who only learned in a traditional classroom. What's more, they are starting to see data that suggests that game players not only can differentiate between these sounds better, but can produce the sounds better when they practice speaking Mandarin.

Holt, Weiner and Murphy have been working on the study for two years with Carnegie Mellon students in Mandarin classes. In March, the university community learned they would finish the semester remotely as a result of the COVID-19 crisis.

Murphy did not want to lose valuable research time, so he devised a way to continue the research online. "A crucial part of the project happens at the end of the semester," Murphy said. "Students who have been playing the game all semester come into our lab on three consecutive days, and we are able to see what they learned."

Without that time in the lab, a semester's worth of research would be lost. Murphy was able to move the in-person experiments online, and was with the students via Zoom as they answered questions about their progress and performed tasks in their browser. "There was a lot that could have gone wrong," Murphy said. "The tough part was asking participants to make audio recordings using their laptops. But we invested so much into these students and want to see the study through."

Technology came through. With a lot of hard work in the weeks leading up to the end of the semester Murphy was able to transfer his research tasks online and successfully collect data from his classroom learners.

Subscribe to our newsletter

Related articles

Mindfulness video game changes areas of the brain

Mindfulness video game changes areas of the brain

Researchers designed a video game to improve mindfulness in middle schoolers and found that when young people played the game, they showed changes in areas of their brains that underlie attention.

Gamification: Intervention app may improve mental health

Gamification: Intervention app may improve mental health

A new randomized control trial has found that turning mobile mental health intervention into a smartphone game can potentially improve well-being.

BCI training reduces phantom limb pain

BCI training reduces phantom limb pain

Scientists used brain-computer-interface to train the brains of patients to reduce phantom-hand pain.

Neural networks: artificial brains need sleep too

Neural networks: artificial brains need sleep too

States that resemble sleep-like cycles in simulated neural networks quell the instability that comes with uninterrupted self-learning in artificial analogs of brains.

VR study: our visual world of color is incorrect

VR study: our visual world of color is incorrect

A study finds that people are aware of surprisingly limited color in their peripheral vision; much of our sense of a colorful visual world is likely constructed by our brain.

Smart algorithm analyses whole brain vasculature

Smart algorithm analyses whole brain vasculature

Scientists have developed a technique for visualising the structures of all the brain's blood vessels including any pathological changes.

VR for early detection of MS balance problems

VR for early detection of MS balance problems

The UNC School of Medicine lab of Jason Franz, PhD, created virtual reality experiments to show how a potentially portable and inexpensive test could reduce falls and related injuries in people with multiple sclerosis.

A precision chip recreates blood-brain barrier

A precision chip recreates blood-brain barrier

Researchers at Georgia Tech have now developed a chip that accurately replicates its function using the human cells that form this important part of our anatomy.

VR supports the treatment of children with brain injury

VR supports the treatment of children with brain injury

Research confirms the efficiency of using computer-based programmes and virtual reality for improving children's attention and social skills.

Popular articles