World’s First “Augmented Reality” Contact Lens Aims to Revolutionize Much More Than Medicine
On the left, a picture of the Mojo lens smart contact; and a simulated image of a woman with low vision who is wearing the contact to highlight objects in her field of vision.
Imagine a world without screens. Instead of endlessly staring at your computer or craning your neck down to scroll through social media feeds and emails, information simply appears in front of your eyes when you need it and disappears when you don't.
"The vision is super clear...I was reading the poem with my eyes closed."
No more rude interruptions during dinner, no more bumping into people on the street while trying to follow GPS directions — just the information you want, when you need it, projected directly onto your visual field.
While this screenless future sounds like science fiction, it may soon be a reality thanks to the new Silicon Valley startup Mojo Vision, creator of the world's first smart contact lens. With a 14,000 pixel-per-inch display with eye-tracking, image stabilization, and a custom wireless radio, the Mojo smart lens bills itself the "smallest and densest dynamic display ever made." Unlike current augmented reality wearables such as Google Glass or ThirdEye, which project images onto a glass screen, the Mojo smart lens can project images directly onto the retina.
A current prototype displayed at the Consumer Electronics Show earlier this year in Las Vegas includes a tiny screen positioned right above the most sensitive area of the pupil. "[The Mojo lens] is a contact lens that essentially has wireless power and data transmission for a small micro LED projector that is placed over the center of the eye," explains David Hobbs, Director of Product Management at Mojo Vision. "[It] displays critical heads-up information when you need it and fades into the background when you're ready to continue on with your day."
Eventually, Mojo Visions' technology could replace our beloved smart devices but the first generation of the Mojo smart lens will be used to help the 2.2 billion people globally who suffer from vision impairment.
"If you think of the eye as a camera [for the visually impaired], the sensors are not working properly," explains Dr. Ashley Tuan, Vice President of Medical Devices at Mojo Vision and fellow of the American Academy of Optometry. "For this population, our lens can process the image so the contrast can be enhanced, we can make the image larger, magnify it so that low-vision people can see it or we can make it smaller so they can check their environment." In January of this year, the FDA granted Breakthrough Device Designation to Mojo, allowing them to have early and frequent discussions with the FDA about technical, safety and efficacy topics before clinical trials can be done and certification granted.
For now, Dr. Tuan is one of the few people who has actually worn the Mojo lens. "I put the contact lens on my eye. It was very comfortable like any contact lenses I've worn before," she describes. "The vision is super clear and then when I put on the accessories, suddenly I see Yoda in front of me and I see my vital signs. And then I have my colleague that prepared a beautiful poem that I loved when I was young [and] I was reading the poem with my eyes closed."
At the moment, there are several electronic glasses on the market like Acesight and Nueyes Pro that provide similar solutions for those suffering from visual impairment, but they are large, cumbersome, and highly visible. Mojo lens would be a discreet, more comfortable alternative that offers users more freedom of movement and independence.
"In the case of augmented-reality contact lenses, there could be an opportunity to improve the lives of people with low vision," says Dr. Thomas Steinemann, spokesperson for the American Academy of Ophthalmology and professor of ophthalmology at MetroHealth Medical Center in Cleveland. "There are existing tools for people currently living with low vision—such as digital apps, magnifiers, etc.— but something wearable could provide more flexibility and significantly more aid in day-to-day tasks."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless.
According to Dr. Tuan, the visually impaired often suffer from depression due to their lack of mobility and 70 percent of them are underemployed. "We hope that they can use this device to gain their mobility so they can get that social aspect back in their lives and then, eventually, employment," she explains. "That is our first and most important goal."
But helping those with low visual capabilities is only Mojo lens' first possible medical application; augmented reality is already being used in medicine and is poised to revolutionize the field in the coming decades. For example, Accuvein, a device that uses lasers to provide real-time images of veins, is widely used by nurses and doctors to help with the insertion of needles for IVs and blood tests.
According to the National Center for Biotechnology Information, augmentation of reality has been used in surgery for many years with surgeons using devices such as Google Glass to overlay critical information about their patients into their visual field. Using software like the Holographic Navigation Platform by Scopsis, surgeons can see a mixed-reality overlay that can "show you complicated tumor boundaries, assist with implant placements and guide you along anatomical pathways," its developers say.
However, according to Dr. Tuan, augmented reality headsets have drawbacks in the surgical setting. "The advantage of [Mojo lens] is you don't need to worry about sweating or that the headset or glasses will slide down to your nose," she explains "Also, our lens is designed so that it will understand your intent, so when you don't want the image overlay it will disappear, it will not block your visual field, and when you need it, it will come back at the right time."
As one of the first examples of "invisible computing," the potential applications of Mojo lens in the medical field are endless. Possibilities include live translation of sign language for deaf people; helping those with autism to read emotions; and improving doctors' bedside manner by allowing them to fully engage with patients without relying on a computer.
"[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
Furthermore, the lens could be used to monitor health issues. "We have image sensors in the lens right now that point to the world but we can have a camera pointing inside of your eye to your retina," says Dr. Tuan, "[By] monitoring those blood vessels we can [track] chronic disease progression: high blood pressure, diabetes, and Alzheimer's."
For the moment, the future medical applications of the Mojo lens are still theoretical, but the team is confident they can eventually become a reality after going through the proper regulatory review. The company is still in the process of design, prototype and testing of the lens, so they don't know exactly when it will be available for use, but they anticipate shipping the first available products in the next couple of years. Once it does go to market, it will be available by prescription only for those with visual impairments, but the team's goal is to bring it to broader consumer markets pending regulatory clearance.
"We see that right now there's a unique opportunity here for Mojo lens and invisible computing to help to shape what the next decade of technology development looks like," explains David Hobbs. "We can use [the Mojo lens] to better serve us as opposed to us serving technology better."
Patients, family voice hope and relief as FDA gives only its third-ever drug approval for ALS
On Sept. 29, the FDA approved Relyvrio, a new drug for ALS, even though a study of 137 ALS patients did not result in “substantial evidence” that Relyvrio was effective.
At age 52, Glen Rouse suffered from arm weakness and a lot of muscle twitches. “I first thought something was wrong when I could not throw a 50-pound bag of dog food over the tailgate of my truck—something I use to do effortlessly,” said the 54-year-old resident of Anderson, California, about three hours north of San Francisco.
In August, Rouse retired as a forester for a private timber company, a job he had held for 31 years. The impetus: amyotrophic lateral sclerosis, or ALS, a progressive neuromuscular disease that is commonly known as Lou Gehrig’s disease, named after the New York Yankees’ first baseman who succumbed to it less than a month shy of his 40th birthday in 1941. ALS eventually robs an individual of the ability to talk, walk, chew, swallow and breathe.
Rouse is now dependent on ventilation through a nasal mask and uses a powerchair to get around. “I can no longer walk or use my arms very well,” he said. “I can still move my wrists and fingers. I can also transfer from my chair to the toilet if I have two of my friends help me.”
It’s “shocking” that modern medicine has very little to offer to people with this devastating condition, Rouse said. But there is hope on the horizon. Yesterday, the U.S. Food and Drug Administration approved Relyvrio, a drug made up of two parts, sodium phenylbutyrate and taurursodiol, to treat patients with ALS.
“This approval provides another important treatment option for ALS, a life-threatening disease that currently has no cure,” said Billy Dunn, director of the Office of Neuroscience in the FDA’s Center for Drug Evaluation and Research, in a statement. “The FDA remains committed to facilitating the development of additional ALS treatments.”
Until this point, the FDA had approved only two other medications—Riluzole (rilutek) in 1995 and Radicava (edaravone) in 2017—to extend life in patients with ALS, which typically kills within two to five years after diagnosis. That’s why earlier this week, Rouse was optimistic about the FDA’s likely approval of a controversial new drug for ALS.
When Relyvrio is taken in addition to Riluzole, it appears to slow functional decline by an additional 25 percent and extend life by another 6 to 10 months, said Richard Bedlak, director of the Duke ALS Clinic. “It is not a cure, but it is definitely a step forward.”
“The whole ALS community is extremely excited about it,” he said the day before Relyvrio’s expected approval. “We are very hopeful. We’re on pins and needles.”
A study of 137 ALS patients did not result in “substantial evidence” that Relyvrio was effective, the agency’s Peripheral and Central Nervous System Drugs Advisory Committee concluded in March. However, after some persuasion from FDA officials, patients and their families, the committee met again and decided to recommend approving the drug.
In January 2019, following an ALS diagnosis in October the previous year, Jeff Sarnacki, of Chester, Maryland, was accepted into a trial for Relyvrio. “Because of the trial, we did experience hope and a greater sense of help than had we not had that opportunity,” said Juliet Taylor, his wife and caregiver. They both believed the drug “worked for him in giving him more time.”
In June 2019, Sarnacki chose an open-label extension, offered to patients by drug researchers after a study ends, and took the active drug until he died peacefully at home under hospice care in May 2020, five days after his 60th birthday. A retired agent with the federal Bureau of Alcohol, Tobacco, Firearms and Explosives who later worked as a security consultant, Sarnacki lived about 19 months after diagnosis, which is shorter than the typical prognosis.
His symptoms had begun with leg cramps and foot drop in late fall 2017. At the end of life, he could only move a few fingers on his left hand and could not speak or eat by mouth; a feeding tube became necessary, Taylor said. He also took Radicava and Riluzole, the two previously approved drugs, for his ALS. “We were both incredulous that, so many years after Lou Gehrig’s own diagnosis, there were so few treatments available,” she said.
The dearth of successful treatments for ALS is “certainly not for lack of trying,” said Karen Raley Steffens, a registered nurse and ALS support services coordinator at the Les Turner ALS Foundation in Skokie, Ill. “There are thousands of researchers and scientists all over the world working tirelessly to try to develop treatments for ALS.”
Unfortunately, she adds, research takes time and exorbitant amounts of funding, while bureaucratic challenges persist. The rare disease also manifests and progresses in many different ways, so many treatments are needed.
As of 2017, the Centers for Disease Control and Prevention estimated that more than 31,000 people in the U.S. live with ALS, and an average of 5,000 people are newly diagnosed every year.
Most cases of ALS are sporadic, meaning that doctors don’t know the cause. There is about a one-year interval between symptom onset and an ALS diagnosis for most patients, so many motor neurons are lost by the time individuals can enroll in a clinical trial, said Richard Bedlack, professor of neurology and director of the Duke ALS Clinic in Durham, North Carolina.
Bedlack found the new drug, Relyvrio, to be “very promising,” which is why he testified to the FDA in favor of approval. (He’s a consultant and disease state speaker for multiple companies including Amylyx, manufacturer of Relyvrio.)
The “drug has different mechanisms of action than the currently approved treatments,” said Bedlack, who is also chief of neurology at the Durham Veterans Affairs Medical Center. He adds that, when Relyvrio is taken in addition to Riluzole, it appears to slow functional decline by an additional 25 percent and extend life by another 6 to 10 months. “It is not a cure, but it is definitely a step forward.”
T. Scott Diesing, a neurohospitalist and director of general neurology at the University of Nebraska Medical Center in Omaha, said he hopes the drug is “as good as people anticipated it should be, because there are not too many options for these patients.”
So far, Rouse's voice is holding up, but he knows the day will come when ALS will steal that and much more from him.
ALS is 100 percent fatal, with some patients dying as soon as a year after diagnosis. A few have lasted as long as 15 years, but those are the exceptions, Diesing said.
“If this drug can provide even months of additional life, or would maintain quality of life, that’s a big deal,” he notes, adding that “the patients are saying, ‘I know it’s not proven conclusively, but what do we have to lose?’ So, they would like to try it while additional studies are ongoing.” The drug has already been approved in Canada.
As his disease progresses, Rouse hopes to get a speech-to-text voice-generating computer that he can control with his eyes. So far, his voice is holding up, but he knows the day will come when ALS will steal that and much more from him. He works at I AM ALS, a patient-led community, and six of his friends have already died of the disease.
“Every time I lose a friend to ALS, I grieve and am sad but I resolve myself to keep working harder for them, myself and others,” Rouse said. “People living with ALS find great purpose in life advocating and trying to make a difference.”
Friday Five Podcast: New drug may slow the rate of Alzheimer's disease
On September 27, pharmaceuticals Biogen and Eisai announced that their drug, lecanemab, can slow the rate of Alzheimer's disease, according to a clinical trial. Today's Friday Five episode covers this story and other health research over the month of September.
The Friday Five covers important stories in health and science research that you may have missed - usually over the previous week, but today's episode is a lookback on important studies over the month of September.
Most recently, on September 27, pharmaceuticals Biogen and Eisai announced that a clinical trial showed their drug, lecanemab, can slow the rate of Alzheimer's disease. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend and the new month.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
This Friday Five episode covers the following studies published and announced over the past month:
- A new drug is shown to slow the rate of Alzheimer's disease
- The need for speed if you want to reduce your risk of dementia
- How to refreeze the north and south poles
- Ancient wisdom about Neti pots could pay off for Covid
- Two women, one man and a baby
Matt Fuchs is the editor-in-chief of Leaps.org. He is also a contributing reporter to the Washington Post and has written for the New York Times, Time Magazine, WIRED and the Washington Post Magazine, among other outlets. Follow him on Twitter @fuchswriter.