Sometime in the near future, we won't need to type on a smartphone or computer to silently communicate our thoughts to others.
"We're moving as fast as possible to get the technology right, to get the ethics right, to get everything right."
In fact, the devices themselves will quietly understand our intentions and express them to other people. We won't even need to move our mouths.
That "sometime in the near future" is now.
At the recent TED Conference, MIT student and TED Fellow Arnav Kapur was onstage with a colleague doing the first live public demo of his new technology. He was showing how you can communicate with a computer using signals from your brain. The usually cool, erudite audience seemed a little uncomfortable.
"If you look at the history of computing, we've always treated computers as external devices that compute and act on our behalf," Kapur said. "What I want to do is I want to weave computing, AI and Internet as part of us."
His colleague started up a device called AlterEgo. Thin like a sticker, AlterEgo picks up signals in the mouth cavity. It recognizes the intended speech and processes it through the built-in AI. The device then gives feedback to the user directly through bone conduction: It vibrates your inner ear drum and gives you a response meshing with your normal hearing.
Onstage, the assistant quietly thought of a question: "What is the weather in Vancouver?" Seconds later, AlterEgo told him in his ear. "It's 50 degrees and rainy here in Vancouver," the assistant announced.
AlterEgo essentially gives you a built-in Siri.
"We don't have a deadline [to go to market], but we're moving as fast as possible to get the technology right, to get the ethics right, to get everything right," Kapur told me after the talk. "We're developing it both as a general purpose computer interface and [in specific instances] like on the clinical side or even in people's homes."
Nearly-telepathic communication actually makes sense now. About ten years ago, the Apple iPhone replaced the ubiquitous cell phone keyboard with a blank touchscreen. A few years later, Google Glass put computer screens into a simple lens. More recently, Amazon Alexa and Microsoft Cortana have dropped the screen and gone straight for voice control. Now those voices are getting closer to our minds and may even become indistinguishable in the future.
"We knew the voice market was growing, like with getting map locations, and audio is the next frontier of user interfaces," says Dr. Rupal Patel, Founder and CEO of VocalID. The startup literally gives voices to the voiceless, particularly people unable to speak because of illness or other circumstances.
"We start with [our database of] human voices, then train our deep learning technology to learn the pattern of speech… We mix voices together from our voice bank, so it's not just Damon's voice, but three or five voices. They are different enough to blend it into a voice that does not exist today – kind of like a face morph."
The VocalID customer then has a voice as unique as he or she is, mixed together like a Sauvignon blend. It is a surrogate voice for those of us who cannot speak, just as much as AlterEgo is a surrogate companion for our brains.
"I'm very skeptical keyboards or voice-based communication will be replaced any time soon."
Voice equality will become increasingly important as Siri, Alexa and voice-based interfaces become the dominant communication method.
It may feel odd to view your voice as a privilege, but as the world becomes more voice-activated, there will be a wider gap between the speakers and the voiceless. Picture going shopping without access to the Internet or trying to eat healthily when your neighborhood is a food desert. And suffering from vocal difficulties is more common than you might think. In fact, according to government statistics, around 7.5 million people in the U.S. have trouble using their voices.
While voice communication appears to be here to stay, at least for now, a more radical shift to mind-controlled communication is not necessarily inevitable. Tech futurist Wagner James Au, for one, is dubious.
"I'm very skeptical keyboards or voice-based communication will be replaced any time soon. Generation Z has grown up with smartphones and games like Fortnite, so I don't see them quickly switching to a new form factor. It's still unclear if even head-mounted AR/VR displays will see mass adoption, and mind-reading devices are a far greater physical imposition on the user."
How adopters use the newest brain impulse-reading, voice-altering technology is a much more complicated discussion. This spring, a video showed U.S. House Speaker Nancy Pelosi stammering and slurring her words at a press conference. The problem is that it didn't really happen: the video was manufactured and heavily altered from the original source material.
So-called deepfake videos use computer algorithms to capture the visual and vocal cues of an individual, and then the creator can manipulate it to say whatever it wants. Deepfakes have already created false narratives in the political and media systems – and these are only videos. Newer tech is making the barrier between tech and our brains, if not our entire identity, even thinner.
"Last year," says Patel of VocalID, "we did penetration testing with our voices on banks that use voice control – and our generation 4 system is even tricky for you and me to identify the difference (between real and fake). As a forward-thinking company, we want to prevent risk early on by watermarking voices, creating a detector of false voices, and so on." She adds, "The line will become more blurred over time."
Onstage at TED, Kapur reassured the audience about who would be in the driver's seat. "This is why we designed the system to deliberately record from the peripheral nervous system, which is why the control in all situations resides with the user."
And, like many creators, he quickly shifted back to the possibilities. "What could the implications of something like this be? Imagine perfectly memorizing things, where you perfectly record information that you silently speak, and then hear them later when you want to, internally searching for information, crunching numbers at speeds computers do, silently texting other people."
"The potential," he concluded, "could be far-reaching."
In late March, just as the COVID-19 pandemic was ramping up in the United States, David Fajgenbaum, a physician-scientist at the University of Pennsylvania, devised a 10-day challenge for his lab: they would sift through 1,000 recently published scientific papers documenting cases of the deadly virus from around the world, pluck out the names of any drugs used in an attempt to cure patients, and track the treatments and their outcomes in a database.
Before late 2019, no one had ever had to treat this exact disease before, which meant all treatments would be trial and error. Fajgenbaum, a pioneering researcher in the field of drug repurposing—which prioritizes finding novel uses for existing drugs, rather than arduously and expensively developing new ones for each new disease—knew that physicians around the world would be embarking on an experimental journey, the scale of which would be unprecedented. His intention was to briefly document the early days of this potentially illuminating free-for-all, as a sidebar to his primary field of research on a group of lymph node disorders called Castleman disease. But now, 11 months and 29,000 scientific papers later, he and his team of 22 are still going strong.
On a Personal Mission<p>In the science and medical world, Fajgenbaum lives a dual existence: he is both researcher and subject, physician and patient. In July 2010, when he was a healthy and physically fit 25-year-old finishing medical school, he began living through what would become a recurring, unprovoked, and overzealous immune response that repeatedly almost killed him.</p><p>His lymph nodes were inflamed; his liver, kidneys, and bone marrow were faltering; and he was dead tired all the time. At first his doctors mistook his mysterious illness for lymphoma, but his inflamed lymph nodes were merely a red herring. A month after his initial hospitalization, pathologists at Mayo Clinic finally diagnosed him with idiopathic multicentric Castleman disease—a particularly ruthless form of a class of lymph node disorders that doesn't just attack one part of the body, but many, and has no known cause. It's a rare diagnosis within an already rare set of disorders. Only about 1,500 Americans a year receive the same diagnosis. </p><p>Without many options for treatment, Fajgenbaum underwent recurring rounds of chemotherapy. Each time, the treatment would offer temporary respite from Castleman symptoms, but bring the full spate of chemotherapy side effects. And it wasn't a sustainable treatment for the long haul. Regularly dousing a person's cells in unmitigated toxicity was about as elegant a solution to Fajgenbaum's disease as bulldozing a house in response to a toaster fire. The fire might go out (though not necessarily), but the house would be destroyed.</p><p>A swirl of exasperation and doggedness finally propelled Fajgenbaum to take on a crucial question himself: Among all of the already FDA-approved drugs on the market, was there something out there, labeled for another use, that could beat back Castleman disease and that he could tolerate long-term? After months of research, he discovered the answer: sirolimus, a drug normally prescribed to patients receiving a kidney transplant, could be used to suppress his overactive immune system with few known side effects to boot.</p><p>Fajgenbaum became hellbent on devoting his practice and research to making similar breakthroughs for others. He founded the Castleman Disease Collaborative Network, to coordinate the research of others studying this bewildering disease, and directs a laboratory consumed with studying cytokine storms—out-of-control immune responses characterized by the body's release of cytokines, proteins that the immune system secretes and uses to communicate with and direct other cells. </p><p>In the spring of 2020, when cytokine storms emerged as a hallmark of the most severe and deadly cases of COVID-19, Fajgenbaum's ears perked up. Although SARS-CoV-2 itself was novel, Fajgenbaum already had almost a decade of experience battling the most severe biological forces it brought. Only this time, he thought, it might actually be easier to pinpoint a treatment—unlike Castleman disease, which has no known cause, at least here a virus was clearly the instigator. </p>
Thinking Beyond COVID<p>The week of March 13, when the World Health Organization declared COVID-19 a pandemic, Fajgenbaum found himself hoping that someone would make the same connection and apply the research to COVID. "Then like a minute later I was like, 'Why am I hoping that someone, somewhere, either follows our footsteps, or has a similar background to us? Maybe we just need to do it," he says. And the CORONA Project was born—first as a 10-day exercise, and later as the robust, interactive tool it now is. </p><p>All of the 400 treatments in the CORONA database are examples of repurposed drugs, or off-label uses: physicians are prescribing drugs to treat COVID that have been approved for a different disease. There are no bonafide COVID treatments, only inferences. The goal for people like Fajgenbaum and Stone is to identify potential treatments for further study and eventual official approval, so that physicians can treat the disease with a playbook in hand. When it works, drug repurposing opens up a way to move quickly: A range of treatments could be available to patients within just a few years of a totally new virus entering our reality compared with the 12 - 19 years new drug development takes.</p><p>"Companies for many decades have explored the use of their products for not just a single indication but often for many indications," says Stone. "'Supplemental approvals' are all essentially examples of drug repurposing, we just didn't call it that. The challenge, I think, is to explore those opportunities more comprehensively and systematically to really try to understand the full breadth of potential activity of any drug or molecule."</p>
The left column shows the path of a repurposed drug, and on the right is the path of a newly discovered and developed drug.
Cures Within Reach
A Confounding Virus<p>The FDA declined to comment on what drugs it was fast-tracking for trials, but Fajgenbaum says that based on the CORONA Project's data, which includes data from smaller trials that have already taken place, he feels there are three drugs that seem the most clearly and broadly promising for large-scale studies. Among them are <a href="https://www.thelancet.com/journals/lanres/article/PIIS2213-2600(20)30503-8/fulltext" target="_blank" rel="noopener noreferrer"><u>dexamethasone</u></a>, which is a steroid with anti-inflammatory effects, and <a href="https://www.fda.gov/news-events/press-announcements/coronavirus-covid-19-update-fda-authorizes-drug-combination-treatment-covid-19" target="_blank" rel="noopener noreferrer"><u>baricitinib</u></a>, a rheumatoid arthritis drug, both of which have enabled the sickest COVID-19 patients to bounce back by suppressing their immune systems. The third most clearly promising drug is <a href="https://www.nih.gov/news-events/news-releases/full-dose-blood-thinners-decreased-need-life-support-improved-outcome-hospitalized-covid-19-patients" target="_blank" rel="noopener noreferrer"><u>heparin</u></a>, a blood thinner, which a recent trial showed to be most helpful when administered at a full dose, more so than at a small, preventative dose. (On the flipside, Fajgenbaum says "it's a little sad" that in the database you can see hydroxychloroquine is still the most-prescribed drug being tried as a COVID treatment around the world, despite over the summer being <a href="https://www.nejm.org/doi/full/10.1056/NEJMoa2021801" target="_blank" rel="noopener noreferrer"><u>debunked</u></a> widely as an effective treatment, and continuously since then.)</p><p>One of the confounding attributes of SARS-CoV-2 is its ability to cause such a huge spectrum of outcomes. It's unlikely a silver bullet treatment will emerge under that reality, so the database also helps surface drugs that seem most promising for a specific population. <a href="https://jamanetwork.com/journals/jama/fullarticle/2773108" target="_blank" rel="noopener noreferrer"><u>Fluvoxamine</u></a>, a selective serotonin reuptake inhibitor used to treat obsessive compulsive disorder, showed promise in the recovery of outpatients—those who were sick, but not severely enough to be hospitalized. <a href="https://jamanetwork.com/journals/jamainternalmedicine/fullarticle/2772185" target="_blank" rel="noopener noreferrer"><u>Tocilizumab</u></a>, which was actually developed for Castleman disease, the disease Fajgenbaum is managing, was initially written off as a COVID treatment because it failed to benefit large portions of hospitalized patients, but now seems to be effective if used on intensive care unit patients within 24 hours of admission—these are some of the sickest patients with the highest risk of dying. </p><p>Other than fluvoxamine, most of the drugs labeled as promising do skew toward targeting hospitalized patients, more than outpatients. One reason, Fajgenbaum says, is that "if you're in a hospital it's very easy to give you a drug and to track you, and there are very objective measurements as to whether you die, you progress to a ventilator, etc." Tracking outpatients is far more difficult, especially when folks have been routinely asked to stay home, quarantine, and free up hospital resources if they're experiencing only mild symptoms. </p><p>But the other reason for the skew is because COVID is very unlike most other diseases in terms of the human immune response the virus triggers. For example, if oncology treatments show some benefit to people with the highest risk of dying, then they usually work extremely well if administered in the earlier stages of a cancer diagnosis. Across many diseases, this dialing backward is a standard approach to identifying promising treatments. With COVID, all of that reasoning has proven moot. </p><p>As we've seen over the last year, COVID cases often start as asymptomatic, and remain that way for days, indicating the body is mounting an incredibly weak immune response initially. Then, between days five and 14, as if trying to make up for lost time, the immune system overcompensates by launching a major inflammatory response, which in the sickest patient can lead to the type of cytokine storms that helped Fajgenbaum realize his years of Castleman research might be useful during this public health crisis. Because of this phased response, you can't apply the same treatment logic to all cases.</p><p>"In COVID, drugs that work late tend to not work if given early, and drugs that work early tend to not work if given late," says Fajgenbaum. "Generally this … is not a commonplace thing for a virus." </p>
Thursday, March 11th, 2021 at 12:30pm - 1:45pm EST
On the one-year anniversary of the global declaration of the pandemic, this virtual event will convene leading scientific and medical experts to discuss the most pressing questions around the COVID-19 vaccines. Planned topics include the effect of the new circulating variants on the vaccines, what we know so far about transmission dynamics post-vaccination, how individuals can behave post-vaccination, the myths of "good" and "bad" vaccines as more alternatives come on board, and more. A public Q&A will follow the expert discussion.
SPEAKERS:<img lazy-loadable="true" data-runner-src="https://leaps.org/media-library/eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpbWFnZSI6Imh0dHBzOi8vYXNzZXRzLnJibC5tcy8yNTY3Mzc4NS9vcmlnaW4uanBnIiwiZXhwaXJlc19hdCI6MTY0NjYwNjU4NX0.Tdrh5pze5P4XxgiJK3J4JFrsrijfabIzNJz-AATghDE/image.jpg?width=534&coordinates=365%2C3%2C299%2C559&height=462" id="87554" class="rm-shortcode" data-rm-shortcode-id="b6c7311be7aec25807f9af19b683bf1d" data-rm-shortcode-name="rebelmouse-image" data-width="534" data-height="462" />
Dr. Paul Offit speaking at Communicating Vaccine Science.commons.wikimedia.org<p><strong><a href="https://www.research.chop.edu/people/paul-a-offit" target="_blank" rel="noopener noreferrer">Dr. Paul Offit, M.D.</a>, is the director of the Vaccine Education Center and an attending physician in infectious diseases at the Children's Hospital of Philadelphia. He is a co-inventor of the rotavirus vaccine for infants, and he has lent his expertise to the advisory committees that review data on new vaccines for the CDC and FDA.</strong></p>
Dr. Monica Gandhi
UCSF Health<p><a href="https://profiles.ucsf.edu/monica.gandhi"></a><strong><a href="https://profiles.ucsf.edu/monica.gandhi" target="_blank">Dr. Monica Gandhi, M.D., MPH,</a> is Professor of Medicine and Associate Division Chief (Clinical Operations/ Education) of the Division of HIV, Infectious Diseases, and Global Medicine at UCSF/ San Francisco General Hospital.</strong></p>
Dr. Onyema Ogbuagu, MBBCh, FACP, FIDSA
Yale Medicine<p><strong><a href="https://medicine.yale.edu/profile/onyema_ogbuagu/" target="_blank" rel="noopener noreferrer">Dr. Onyema Ogbuagu, MBBCh</a>, is an infectious disease physician at Yale Medicine who treats COVID-19 patients and leads Yale's clinical studies around COVID-19. He ran Yale's trial of the Pfizer/BioNTech vaccine.</strong></p>
Dr. Eric Topol
Dr. Topol's Twitter<p><strong><a href="https://www.scripps.edu/faculty/topol/" target="_blank" rel="noopener noreferrer">Dr. Eric Topol, M.D.</a>, is a cardiologist, scientist, professor of molecular medicine, and the director and founder of Scripps Research Translational Institute. He has led clinical trials in over 40 countries with over 200,000 patients and pioneered the development of many routinely used medications.</strong></p>