This App Helps Diagnose Rare Genetic Disorders from a Picture

FDNA's Face2Gene technology analyzes patient biometric data using artificial intelligence, identifying correlations with disease-causing genetic variations.

(Credit: FDNA)


Medical geneticist Omar Abdul-Rahman had a hunch. He thought that the three-year-old boy with deep-set eyes, a rounded nose, and uplifted earlobes might have Mowat-Wilson syndrome, but he'd never seen a patient with the rare disorder before.

"If it weren't for the app I'm not sure I would have had the confidence to say 'yes you should spend $1000 on this test."

Rahman had already ordered genetic tests for three different conditions without any luck, and he didn't want to cost the family any more money—or hope—if he wasn't sure of the diagnosis. So he took a picture of the boy and uploaded the photo to Face2Gene, a diagnostic aid for rare genetic disorders. Sure enough, Mowat-Wilson came up as a potential match. The family agreed to one final genetic test, which was positive for the syndrome.

"If it weren't for the app I'm not sure I would have had the confidence to say 'yes you should spend $1000 on this test,'" says Rahman, who is now the director of Genetic Medicine at the University of Nebraska Medical Center, but saw the boy when he was in the Department of Pediatrics at the University of Mississippi Medical Center in 2012.

"Families who are dealing with undiagnosed diseases never know what's going to come around the corner, what other organ system might be a problem next week," Rahman says. With a diagnosis, "You don't have to wait for the other shoe to drop because now you know the extent of the condition."

A diagnosis is the first and most important step for patients to attain medical care. Disease prognosis, treatment plans, and emotional coping all stem from this critical phase. But diagnosis can also be the trickiest part of the process, particularly for rare disorders. According to one European survey, 40 percent of rare diseases are initially misdiagnosed.

Healthcare professionals and medical technology companies hope that facial recognition software will help prevent families from facing difficult disruptions due to misdiagnoses.

"Patients with rare diseases or genetic disorders go through a long period of diagnostic odyssey, and just putting a name to a syndrome or finding a diagnosis can be very helpful and relieve a lot of tension for the family," says Dekel Gelbman, CEO of FDNA.

Consequently, a misdiagnosis can be devastating for families. Money and time may have been wasted on fruitless treatments, while opportunities for potentially helpful therapies or clinical trials were missed. Parents led down the wrong path must change their expectations of their child's long-term prognosis and care. In addition, they may be misinformed regarding future decisions about family planning.

Healthcare professionals and medical technology companies hope that facial recognition software will help prevent families from facing these difficult disruptions by improving the accuracy and ease of diagnosing genetic disorders. Traditionally, doctors diagnose these types of conditions by identifying unique patterns of facial features, a practice called dysmorphology. Trained physicians can read a child's face like a map and detect any abnormal ridges or plateaus—wide-set eyes, broad forehead, flat nose, rotated ears—that, combined with other symptoms such as intellectual disability or abnormal height and weight, signify a specific genetic disorder.

These morphological changes can be subtle, though, and often only specialized medical geneticists are able to detect and interpret these facial clues. What's more, some genetic disorders are so rare that even a specialist may not have encountered it before, much less a general practitioner. Diagnosing rare conditions has improved thanks to genomic testing that can confirm (or refute) a doctor's suspicion. Yet with thousands of variants in each person's genome, identifying the culprit mutation or deletion can be extremely difficult if you don't know what you're looking for.

Facial recognition technology is trying to take some of the guesswork out of this process. Software such as the Face2Gene app use machine learning to compare a picture of a patient against images of thousands of disorders and come back with suggestions of possible diagnoses.

"This is a classic field for artificial intelligence because no human being can really have enough knowledge and enough experience to be able to do this for thousands of different disorders."

"When we met a geneticist for the first time we were pretty blown away with the fact that they actually use their own human pattern recognition" to diagnose patients, says Gelbman. "This is a classic field for AI [artificial intelligence], for machine learning because no human being can really have enough knowledge and enough experience to be able to do this for thousands of different disorders."

When a physician uploads a photo to the app, they are given a list of different diagnostic suggestions, each with a heat map to indicate how similar the facial features are to a classic representation of the syndrome. The physician can hone the suggestions by adding in other symptoms or family history. Gelbman emphasized that the app is a "search and reference tool" and should not "be used to diagnose or treat medical conditions." It is not approved by the FDA as a diagnostic.

"As a tool, we've all been waiting for this, something that can help everyone," says Julian Martinez-Agosto, an associate professor in human genetics and pediatrics at UCLA. He sees the greatest benefit of facial recognition technology in its ability to empower non-specialists to make a diagnosis. Many areas, including rural communities or resource-poor countries, do not have access to either medical geneticists trained in these types of diagnostics or genomic screens. Apps like Face2Gene can help guide a general practitioner or flag diseases they might not be familiar with.

One concern is that most textbook images of genetic disorders come from the West, so the "classic" face of a condition is often a child of European descent.

Maximilian Muenke, a senior investigator at the National Human Genome Research Institute (NHGRI), agrees that in many countries, facial recognition programs could be the only way for a doctor to make a diagnosis.

"There are only geneticists in countries like the U.S., Canada, Europe, Japan. In most countries, geneticists don't exist at all," Muenke says. "In Nigeria, the most populous country in all of Africa with 160 million people, there's not a single clinical geneticist. So in a country like that, facial recognition programs will be sought after and will be extremely useful to help make a diagnosis to the non-geneticists."

One concern about providing this type of technology to a global population is that most textbook images of genetic disorders come from the West, so the "classic" face of a condition is often a child of European descent. However, the defining facial features of some of these disorders manifest differently across ethnicities, leaving clinicians from other geographic regions at a disadvantage.

"Every syndrome is either more easy or more difficult to detect in people from different geographic backgrounds," explains Muenke. For example, "in some countries of Southeast Asia, the eyes are slanted upward, and that happens to be one of the findings that occurs mostly with children with Down Syndrome. So then it might be more difficult for some individuals to recognize Down Syndrome in children from Southeast Asia."

There is a risk that providing this type of diagnostic information online will lead to parents trying to classify their own children.

To combat this issue, Muenke helped develop the Atlas of Human Malformation Syndromes, a database that incorporates descriptions and pictures of patients from every continent. By providing examples of rare genetic disorders in children from outside of the United States and Europe, Muenke hopes to provide clinicians with a better understanding of what to look for in each condition, regardless of where they practice.

There is a risk that providing this type of diagnostic information online will lead to parents trying to classify their own children. Face2Gene is free to download in the app store, although users must be authenticated by the company as a healthcare professional before they can access the database. The NHGRI Atlas can be accessed by anyone through their website. However, Martinez and Muenke say parents already use Google and WebMD to look up their child's symptoms; facial recognition programs and databases are just an extension of that trend. In fact, Martinez says, "Empowering families is another way to facilitate access to care. Some families live in rural areas and have no access to geneticists. If they can use software to get a diagnosis and then contact someone at a large hospital, it can help facilitate the process."

Martinez also says the app could go further by providing greater transparency about how the program makes its assessments. Giving clinicians feedback about why a diagnosis fits certain facial features would offer a valuable teaching opportunity in addition to a diagnostic aid.

Both Martinez and Muenke think the technology is an innovation that could vastly benefit patients. "In the beginning, I was quite skeptical and I could not believe that a machine could replace a human," says Muenke. "However, I am a convert that it actually can help tremendously in making a diagnosis. I think there is a place for facial recognition programs, and I am a firm believer that this will spread over the next five years."

Dana Smith
Dana Smith is a freelance science writer specializing in brains and bodies. She has written for the Atlantic, the Guardian, NPR, Scientific American, Discover, and Fast Company, among others. In a previous life, she earned a PhD in Experimental Psychology from the University of Cambridge. You can find more of her writing at danagsmith.com.
Get our top stories twice a month
Follow us on

Robin Cavendish in his special wheelchair with his son Jonathan in the 1960s.

Cavendish family

In December 1958, on a vacation with his wife in Kenya, a 28-year-old British tea broker named Robin Cavendish became suddenly ill. Neither he nor his wife Diana knew it at the time, but Robin's illness would change the course of medical history forever.

Robin was rushed to a nearby hospital in Kenya where the medical staff delivered the crushing news: Robin had contracted polio, and the paralysis creeping up his body was almost certainly permanent. The doctors placed Robin on a ventilator through a tracheotomy in his neck, as the paralysis from his polio infection had rendered him unable to breathe on his own – and going off the average life expectancy at the time, they gave him only three months to live. Robin and Diana (who was pregnant at the time with their first child, Jonathan) flew back to England so he could be admitted to a hospital. They mentally prepared to wait out Robin's final days.

Keep Reading Keep Reading
Sarah Watts

Sarah Watts is a health and science writer based in Chicago. Follow her on Twitter at @swattswrites.

Kirstie Ennis, an Afghanistan veteran who survived a helicopter crash but lost a limb, pictured in May 2021 at Two Rivers Park in Colorado.

Photo Credit: Ennis' Instagram

In June 2012, Kirstie Ennis was six months into her second deployment to Afghanistan and recently promoted to sergeant. The helicopter gunner and seven others were three hours into a routine mission of combat resupplies and troop transport when their CH-53D helicopter went down hard.

Miraculously, all eight people onboard survived, but Ennis' injuries were many and severe. She had a torn rotator cuff, torn labrum, crushed cervical discs, facial fractures, deep lacerations and traumatic brain injury. Despite a severely fractured ankle, doctors managed to save her foot, for a while at least.

In November 2015, after three years of constant pain and too many surgeries to count, Ennis relented. She elected to undergo a lower leg amputation but only after she completed the 1,000-mile, 72-day Walking with the Wounded journey across the UK.

On Veteran's Day of that year, on the other side of the country, orthopedic surgeon Cato Laurencin announced a moonshot challenge he was setting out to achieve on behalf of wounded warriors like Ennis: the Hartford Engineering A Limb (HEAL) Project.

Keep Reading Keep Reading
Melba Newsome
Melba Newsome is an independent science and health journalist whose work has appeared in Health Affairs, Scientific American, Prevention, Politico, Everyday Health and North Carolina Health News. She received the June Roth Award for Medical Journalism for a feature on genetic testing in Oprah magazine. She currently serves as core topic leader on health equity for the Association of Healthcare Journalists.