In The Fake News Era, Are We Too Gullible? No, Says Cognitive Scientist
Cognitive scientist Hugo Mercier says the real challenge is not fighting fake news, but figuring out "how to make it easier for people who say correct things to convince people."
One of the oddest political hoaxes of recent times was Pizzagate, in which conspiracy theorists claimed that Hillary Clinton and her 2016 campaign chief ran a child sex ring from the basement of a Washington, DC, pizzeria.
To fight disinformation more effectively, he suggests, humans need to stop believing in one thing above all: our own gullibility.
Millions of believers spread the rumor on social media, abetted by Russian bots; one outraged netizen stormed the restaurant with an assault rifle and shot open what he took to be the dungeon door. (It actually led to a computer closet.) Pundits cited the imbroglio as evidence that Americans had lost the ability to tell fake news from the real thing, putting our democracy in peril.
Such fears, however, are nothing new. "For most of history, the concept of widespread credulity has been fundamental to our understanding of society," observes Hugo Mercier in Not Born Yesterday: The Science of Who We Trust and What We Believe (Princeton University Press, 2020). In the fourth century BCE, he points out, the historian Thucydides blamed Athens' defeat by Sparta on a demagogue who hoodwinked the public into supporting idiotic military strategies; Plato extended that argument to condemn democracy itself. Today, atheists and fundamentalists decry one another's gullibility, as do climate-change accepters and deniers. Leftists bemoan the masses' blind acceptance of the "dominant ideology," while conservatives accuse those who do revolt of being duped by cunning agitators.
What's changed, all sides agree, is the speed at which bamboozlement can propagate. In the digital age, it seems, a sucker is born every nanosecond.
The Case Against Credulity
Yet Mercier, a cognitive scientist at the Jean Nicod Institute in Paris, thinks we've got the problem backward. To fight disinformation more effectively, he suggests, humans need to stop believing in one thing above all: our own gullibility. "We don't credulously accept whatever we're told—even when those views are supported by the majority of the population, or by prestigious, charismatic individuals," he writes. "On the contrary, we are skilled at figuring out who to trust and what to believe, and, if anything, we're too hard rather than too easy to influence."
He bases those contentions on a growing body of research in neuropsychiatry, evolutionary psychology, and other fields. Humans, Mercier argues, are hardwired to balance openness with vigilance when assessing communicated information. To gauge a statement's accuracy, we instinctively test it from many angles, including: Does it jibe with what I already believe? Does the speaker share my interests? Has she demonstrated competence in this area? What's her reputation for trustworthiness? And, with more complex assertions: Does the argument make sense?
This process, Mercier says, enables us to learn much more from one another than do other animals, and to communicate in a far more complex way—key to our unparalleled adaptability. But it doesn't always save us from trusting liars or embracing demonstrably false beliefs. To better understand why, leapsmag spoke with the author.
How did you come to write Not Born Yesterday?
In 2010, I collaborated with the cognitive scientist Dan Sperber and some other colleagues on a paper called "Epistemic Vigilance," which laid out the argument that evolutionarily, it would make no sense for humans to be gullible. If you can be easily manipulated and influenced, you're going to be in major trouble. But as I talked to people, I kept encountering resistance. They'd tell me, "No, no, people are influenced by advertising, by political campaigns, by religious leaders." I started doing more research to see if I was wrong, and eventually I had enough to write a book.
With all the talk about "fake news" these days, the topic has gotten a lot more timely.
Yes. But on the whole, I'm skeptical that fake news matters very much. And all the energy we spend fighting it is energy not spent on other pursuits that may be better ways of improving our informational environment. The real challenge, I think, is not how to shut up people who say stupid things on the internet, but how to make it easier for people who say correct things to convince people.
"History shows that the audience's state of mind and material conditions matter more than the leader's powers of persuasion."
You start the book with an anecdote about your encounter with a con artist several years ago, who scammed you out of 20 euros. Why did you choose that anecdote?
Although I'm arguing that people aren't generally gullible, I'm not saying we're completely impervious to attempts at tricking us. It's just that we're much better than we think at resisting manipulation. And while there's a risk of trusting someone who doesn't deserve to be trusted, there's also a risk of not trusting someone who could have been trusted. You miss out on someone who could help you, or from whom you might have learned something—including figuring out who to trust.
You argue that in humans, vigilance and open-mindedness evolved hand-in-hand, leading to a set of cognitive mechanisms you call "open vigilance."
There's a common view that people start from a state of being gullible and easy to influence, and get better at rejecting information as they become smarter and more sophisticated. But that's not what really happens. It's much harder to get apes than humans to do anything they don't want to do, for example. And research suggests that over evolutionary time, the better our species became at telling what we should and shouldn't listen to, the more open to influence we became. Even small children have ways to evaluate what people tell them.
The most basic is what I call "plausibility checking": if you tell them you're 200 years old, they're going to find that highly suspicious. Kids pay attention to competence; if someone is an expert in the relevant field, they'll trust her more. They're likelier to trust someone who's nice to them. My colleagues and I have found that by age 2 ½, children can distinguish between very strong and very weak arguments. Obviously, these skills keep developing throughout your life.
But you've found that even the most forceful leaders—and their propaganda machines—have a hard time changing people's minds.
Throughout history, there's been this fear of demagogues leading whole countries into terrible decisions. In reality, these leaders are mostly good at feeling the crowd and figuring out what people want to hear. They're not really influencing [the masses]; they're surfing on pre-existing public opinion. We know from a recent study, for instance, that if you match cities in which Hitler gave campaign speeches in the late '20s through early '30s with similar cities in which he didn't give campaign speeches, there was no difference in vote share for the Nazis. Nazi propaganda managed to make Germans who were already anti-Semitic more likely to express their anti-Semitism or act on it. But Germans who were not already anti-Semitic were completely inured to the propaganda.
So why, in totalitarian regimes, do people seem so devoted to the ruler?
It's not a very complex psychology. In these regimes, the slightest show of discontent can be punished by death, or by you and your whole family being sent to a labor camp. That doesn't mean propaganda has no effect, but you can explain people's obedience without it.
What about cult leaders and religious extremists? Their followers seem willing to believe anything.
Prophets and preachers can inspire the kind of fervor that leads people to suicidal acts or doomed crusades. But history shows that the audience's state of mind and material conditions matter more than the leader's powers of persuasion. Only when people are ready for extreme actions can a charismatic figure provide the spark that lights the fire.
Once a religion becomes ubiquitous, the limits of its persuasive powers become clear. Every anthropologist knows that in societies that are nominally dominated by orthodox belief systems—whether Christian or Muslim or anything else—most people share a view of God, or the spirit, that's closer to what you find in societies that lack such religions. In the Middle Ages, for instance, you have records of priests complaining of how unruly the people are—how they spend the whole Mass chatting or gossiping, or go on pilgrimages mostly because of all the prostitutes and wine-drinking. They continue pagan practices. They resist attempts to make them pay tithes. It's very far from our image of how much people really bought the dominant religion.
"The mainstream media is extremely reliable. The scientific consensus is extremely reliable."
And what about all those wild rumors and conspiracy theories on social media? Don't those demonstrate widespread gullibility?
I think not, for two reasons. One is that most of these false beliefs tend to be held in a way that's not very deep. People may say Pizzagate is true, yet that belief doesn't really interact with the rest of their cognition or their behavior. If you really believe that children are being abused, then trying to free them is the moral and rational thing to do. But the only person who did that was the guy who took his assault weapon to the pizzeria. Most people just left one-star reviews of the restaurant.
The other reason is that most of these beliefs actually play some useful role for people. Before any ethnic massacre, for example, rumors circulate about atrocities having been committed by the targeted minority. But those beliefs aren't what's really driving the phenomenon. In the horrendous pogrom of Kishinev, Moldova, 100 years ago, you had these stories of blood libel—a child disappeared, typical stuff. And then what did the Christian inhabitants do? They raped the [Jewish] women, they pillaged the wine stores, they stole everything they could. They clearly wanted to get that stuff, and they made up something to justify it.
Where do skeptics like climate-change deniers and anti-vaxxers fit into the picture?
Most people in most countries accept that vaccination is good and that climate change is real and man-made. These ideas are deeply counter-intuitive, so the fact that scientists were able to get them across is quite fascinating. But the environment in which we live is vastly different from the one in which we evolved. There's a lot more information, which makes it harder to figure out who we can trust. The main effect is that we don't trust enough; we don't accept enough information. We also rely on shortcuts and heuristics—coarse cues of trustworthiness. There are people who abuse these cues. They may have a PhD or an MD, and they use those credentials to help them spread messages that are not true and not good. Mostly, they're affirming what people want to believe, but they may also be changing minds at the margins.
How can we improve people's ability to resist that kind of exploitation?
I wish I could tell you! That's literally my next project. Generally speaking, though, my advice is very vanilla. The mainstream media is extremely reliable. The scientific consensus is extremely reliable. If you trust those sources, you'll go wrong in a very few cases, but on the whole, they'll probably give you good results. Yet a lot of the problems that we attribute to people being stupid and irrational are not entirely their fault. If governments were less corrupt, if the pharmaceutical companies were irreproachable, these problems might not go away—but they would certainly be minimized.
Patients voice hope and relief as FDA gives third-ever drug approval for ALS
On Sept. 29, the FDA approved Relyvrio, a new drug for ALS, even though a study of 137 ALS patients did not result in “substantial evidence” that Relyvrio was effective.
At age 52, Glen Rouse suffered from arm weakness and a lot of muscle twitches. “I first thought something was wrong when I could not throw a 50-pound bag of dog food over the tailgate of my truck—something I use to do effortlessly,” said the 54-year-old resident of Anderson, California, about three hours north of San Francisco.
In August, Rouse retired as a forester for a private timber company, a job he had held for 31 years. The impetus: amyotrophic lateral sclerosis, or ALS, a progressive neuromuscular disease that is commonly known as Lou Gehrig’s disease, named after the New York Yankees’ first baseman who succumbed to it less than a month shy of his 38th birthday in 1941. ALS eventually robs an individual of the ability to talk, walk, chew, swallow and breathe.
Rouse is now dependent on ventilation through a nasal mask and uses a powerchair to get around. “I can no longer walk or use my arms very well,” he said. “I can still move my wrists and fingers. I can also transfer from my chair to the toilet if I have two of my friends help me.”
It’s “shocking” that modern medicine has very little to offer to people with this devastating condition, Rouse said. But there is hope on the horizon. Yesterday, the U.S. Food and Drug Administration approved Relyvrio, a drug made up of two parts, sodium phenylbutyrate and taurursodiol, to treat patients with ALS.
“This approval provides another important treatment option for ALS, a life-threatening disease that currently has no cure,” said Billy Dunn, director of the Office of Neuroscience in the FDA’s Center for Drug Evaluation and Research, in a statement. “The FDA remains committed to facilitating the development of additional ALS treatments.”
Until this point, the FDA had approved only two other medications—Riluzole (rilutek) in 1995 and Radicava (edaravone) in 2017—to extend life in patients with ALS, which typically kills within two to five years after diagnosis. That’s why earlier this week, Rouse was optimistic about the FDA’s likely approval of a controversial new drug for ALS.
When Relyvrio is taken in addition to Riluzole, it appears to slow functional decline by an additional 25 percent and extend life by another 6 to 10 months, said Richard Bedlak, director of the Duke ALS Clinic. “It is not a cure, but it is definitely a step forward.”
“The whole ALS community is extremely excited about it,” he said the day before Relyvrio’s expected approval. “We are very hopeful. We’re on pins and needles.”
A study of 137 ALS patients did not result in “substantial evidence” that Relyvrio was effective, the agency’s Peripheral and Central Nervous System Drugs Advisory Committee concluded in March. However, after some persuasion from FDA officials, patients and their families, the committee met again and decided to recommend approving the drug.
In January 2019, following an ALS diagnosis at age 58 in October the previous year, Jeff Sarnacki, of Chester, Maryland, was accepted into a trial for Relyvrio. “Because of the trial, we did experience hope and a greater sense of help than had we not had that opportunity,” said Juliet Taylor, his wife and caregiver. They both believed the drug “worked for him in giving him more time.”
In June 2019, Sarnacki chose an open-label extension, offered to patients by drug researchers after a study ends, and took the active drug until he died peacefully at home under hospice care in May 2020, five days after his 60th birthday. A retired agent with the federal Bureau of Alcohol, Tobacco, Firearms and Explosives who later worked as a security consultant, Sarnacki lived about 19 months after diagnosis, which is shorter than the typical prognosis.
His symptoms began with leg cramps in fall 2017 and foot drop in early 2018. A feeding tube was placed in 2019, as it became necessary early in his illness, Taylor said. He also took Radicava and Riluzole, the two previously approved drugs, for his ALS. “We were both incredulous that, so many years after Lou Gehrig’s own diagnosis, there were so few treatments available,” she said.
The dearth of successful treatments for ALS is “certainly not for lack of trying,” said Karen Raley Steffens, a registered nurse and ALS support services coordinator at the Les Turner ALS Foundation in Skokie, Ill. “There are thousands of researchers and scientists all over the world working tirelessly to try to develop treatments for ALS.”
Unfortunately, she added, research takes time and exorbitant amounts of funding, while bureaucratic challenges persist. The rare disease also manifests and progresses in many different ways, so many treatments are needed.
As of 2017, the Centers for Disease Control and Prevention estimated that more than 31,000 people in the U.S. live with ALS, and an average of 5,000 people are newly diagnosed every year. It is slightly more common in men than women. Most people are diagnosed between the ages of 55 and 75.
Most cases of ALS are sporadic, meaning that doctors don’t know the cause. There is about a one-year interval between symptom onset and an ALS diagnosis for most patients, so many motor neurons are lost by the time individuals can enroll in a clinical trial, said Richard Bedlack, professor of neurology and director of the Duke ALS Clinic in Durham, North Carolina.
Bedlack found the new drug, Relyvrio, to be “very promising,” which is why he testified to the FDA in favor of approval. (He’s a consultant and disease state speaker for multiple companies including Amylyx, manufacturer of Relyvrio.)
The “drug has different mechanisms of action than the currently approved treatments,” Bedlack said. He added that, when Relyvrio is taken in addition to Riluzole, it appears to slow functional decline by an additional 25 percent and extend life by another 6 to 10 months. “It is not a cure, but it is definitely a step forward.”
T. Scott Diesing, a neurohospitalist and director of general neurology at the University of Nebraska Medical Center in Omaha, said he hopes the drug is “as good as people anticipated it should be, because there are not too many options for these patients.”
"FDA went out on a limb in approving Relyvrio based on limited results from a small trial while a larger study remains in progress," said Florian P. Thomas, co-director of the ALS Center at Hackensack University Medical Center and the Meridian School of Medicine. "While it is definitely promising, clearly, the last word on this drug has not been spoken."
So far, Rouse's voice is holding up, but he knows the day will come when ALS will steal that and much more from him.
ALS is 100 percent fatal, with some patients dying as soon as a year after diagnosis. A few have lasted as long as 15 years, but those are the exceptions, Diesing said.
“If this drug can provide even months of additional life, or would maintain quality of life, that’s a big deal,” he noted, adding that “the patients are saying, ‘I know it’s not proven conclusively, but what do we have to lose?’ So, they would like to try it while additional studies are ongoing.” The drug has already been conditionally approved in Canada.
As his disease progresses, Rouse hopes to get a speech-to-text voice-generating computer that he can control with his eyes. So far, his voice is holding up, but he knows the day will come when ALS will steal that and much more from him. He works at I AM ALS, a patient-led community, and six of his friends have already died of the disease.
“Every time I lose a friend to ALS, I grieve and am sad but I resolve myself to keep working harder for them, myself and others,” Rouse said. “People living with ALS find great purpose in life advocating and trying to make a difference.”
Friday Five Podcast: New drug may slow the rate of Alzheimer's disease
On September 27, pharmaceuticals Biogen and Eisai announced that their drug, lecanemab, can slow the rate of Alzheimer's disease, according to a clinical trial. Today's Friday Five episode covers this story and other health research over the month of September.
The Friday Five covers important stories in health and science research that you may have missed - usually over the previous week, but today's episode is a lookback on important studies over the month of September.
Most recently, on September 27, pharmaceuticals Biogen and Eisai announced that a clinical trial showed their drug, lecanemab, can slow the rate of Alzheimer's disease. There are plenty of controversies and troubling ethical issues in science – and we get into many of them in our online magazine – but this news roundup focuses on scientific creativity and progress to give you a therapeutic dose of inspiration headed into the weekend and the new month.
Listen on Apple | Listen on Spotify | Listen on Stitcher | Listen on Amazon | Listen on Google
This Friday Five episode covers the following studies published and announced over the past month:
- A new drug is shown to slow the rate of Alzheimer's disease
- The need for speed if you want to reduce your risk of dementia
- How to refreeze the north and south poles
- Ancient wisdom about Neti pots could pay off for Covid
- Two women, one man and a baby
Matt Fuchs is the editor-in-chief of Leaps.org. He is also a contributing reporter to the Washington Post and has written for the New York Times, Time Magazine, WIRED and the Washington Post Magazine, among other outlets. Follow him on Twitter @fuchswriter.