A smartphone app that could help diagnose autism uses a game to encourage kids...
A smartphone app that could help diagnose autism uses a game to encourage kids to act out concepts such as being an artist or the feeling of being surprised. The app takes video of the kids at play to analyze and detect indicators of autism.
Source: Courtesy Wall Lab

This smartphone app simultaneously treats and tracks autism

Diagnosing autism can take half a day or more of clinical observation, and that’s the quick part – often, families wait years just to get to that point. Now, in hopes of speeding things up, Stanford researchers are developing a smartphone app that could drastically reduce the time it takes to get a diagnosis.

The heart of the app, called GuessWhat, is a game that encourages kids to act out concepts such as playing baseball or the feeling of being happy. But just as important, says creator Dennis Wall, an associate professor of pediatrics and of biomedical data science, is the fact that the app takes video of kids at play – video that preliminary work suggests can be analyzed to figure out if kids have autism.

Wall, James Landay, a professor of computer science, and colleagues are expanding GuessWhat’s capabilities as not just a diagnostic tool but perhaps a therapeutic one as well. “Children are missing an opportunity” to get help with autism, Wall said, and if the project is successful, it will “address a critical need in the diagnosis of autism.”

The original idea for GuessWhat, Wall said, came to him while playing a smartphone-based version of charades. In that game, players hold a phone on their foreheads, screen facing out, so that others can see a cue – a picture of an astronaut, for example – and try to guess that cue from what their friends act out.

Wall realized that by getting kids to act out a variety of different concepts – astronauts and the like, but also emotions or social situations – he might be able to capture video of children and use machine learning algorithms on that video to determine the probability any one child had autism. That, Wall said, could be useful both for diagnosis and for tracking developmental progress. And for parents, it could be done relatively quickly and without having to wait years for a visit to a specialized clinic. “I thought if we could do something like this for autism, if could be really powerful,” Wall said.

Charades as therapy

After parents or other adults open the app and sign in, they hold the phone up to their foreheads, screen facing out so a kid can see it. The screen then displays an image – pictures of emojis or people in various jobs or social situations – for the child to act out. The adult then tries to guess what the image represents.

The difference from usual charades is the video. While a child plays, the smartphone’s camera captures video, which serves two purposes. In the initial stages, Wall, Landay and colleagues already know which kids have autism and which don’t, and the point is to analyze the video using machine learning methods to figure out which facial expressions, movements or other behaviors distinguish those with autism. From that, the app would learn to detect indicators of autism, which a child’s doctor could then use to screen kids without having to see them in a specialized clinic. Preliminary experiments, Wall said, suggest the strategy could work – and that the time is right to expand the team’s efforts.

Now, Wall said, “our goal is to build it up, and that’s where the seed grant comes in.” With that funding, the team is gearing up for field tests with a wider group of families, who will participate in co-designing the next version of the app. The team will also continue to gather data that could help the app better distinguish between kids with and without autism.

The seed grant will also go toward developing GuessWhat into a therapeutic as well as diagnostic app, creating what Wall calls an action-to-data feedback loop. “That could enable us to track progress using GuessWhat game play as a metric while treating the children” to be more able to function well in social situations, Wall said. “Once they’re more social, many will switch tracks from a delayed development track consistent with autism to a more typical development track.”

In the coming months, Wall and colleagues will work with clinicians to incorporate elements of two standard autism therapies, known as discrete trial learning and pivotal response training, into GuessWhat. Some features of those therapies, such as flashcards that teach kids to discriminate between emotions and games that emphasize imitation and social interaction, could be relatively easy to implement in a smartphone app, Wall said. Ultimately, the hope is to get ready for clinical trials to test GuessWhat’s therapeutic value sometime in the next few years.

But the most important goal may be simply to keep track of a lot of data – for example, which diagnostic decisions are made and why. “Medicine in general has failed to do a good job of record management,” Wall said. “So, when something happens in a doctor’s office – identifying a breathing abnormality with a stethoscope, a visual screen of a developmental delay, a screen of the eyes – much of what drives that doctor to arrive at a decision is lost.” By actually storing lots of data on kids playing games, researchers have a better place to start when trying to understand what autism is and how to address it. “No one has ever captured this data before,” Wall said. “That creates an opportunity to do much, much more for developmental pediatric health going forward.”

Subscribe to our newsletter

Related articles

mhealth: the digital placebo effect of health apps

mhealth: the digital placebo effect of health apps

Sharing information about the expected effect of a health app before its use and providing positive feedback regarding its effectiveness after its use have the potential to strengthen the placebo effect.

Can an app change your personality?

Can an app change your personality?

Research has shown that daily use of a smartphone app can lead to desired personality changes within three months.

Gamification: Intervention app may improve mental health

Gamification: Intervention app may improve mental health

A new randomized control trial has found that turning mobile mental health intervention into a smartphone game can potentially improve well-being.

Digital games may beat mindfulness apps at relieving stress

Digital games may beat mindfulness apps at relieving stress

Digital games, typical of those on smartphones, may relieve stress more effectively than mindfulness apps, a new study shows.

About the usefulness of fertility apps

About the usefulness of fertility apps

Analysing fertility awareness apps, researchers have been able to track behavior patterns and accuracy in measuring menstrual health and ovulation.

Game app provides knowledge of person-centred care

Game app provides knowledge of person-centred care

The PCC Game app being launched offers a virtual journey for greater knowledge and with tricky questions along the way.

App can help diagnose Huntington’s disease

App can help diagnose Huntington’s disease

Researchers have created a mobile application, which helps recognise early symptoms of a rare Huntington's disease.

Sea Hero Quest can detect Alzheimer’s risk

Sea Hero Quest can detect Alzheimer’s risk

Researchers studied gaming data from the mobile game and found out that it can detect people at risk of Alzheimer’s.

Brain training app decoder improves users’ concentration

Brain training app decoder improves users’ concentration

A new 'brain training' game improves users' concentration. Scientists say this could provide a welcome antidote to the daily distractions that we face in a busy world.

Popular articles