Show an ad over header. AMP

I am the FIRST

The search for misinformation's measure

Data: NewsWhip; Chart: Andrew Witherspoon/Axios

Facebook and other big online platforms insist they're removing more and more misinformation. But they can't say whether they're actually stemming the tide of lies, and neither can we, because the deluge turns out to be impossible to define or measure.

Why it matters: The tech companies mostly won't share data that would let researchers better track the scale, spread and impact of misinformation. So the riddle remains unsolved, and the platforms can't be held accountable.


Where it stands: Quantifying the volume of misinformation online requires three things: a clear definition of the stuff you're measuring; a way to divide it into countable units; and the ability to see into vast pools of online data to find and enumerate it.

The catch: Different people disagree over which pieces of information are actually misinformation.

  • The other catch: Big platforms are reluctant to share data, because releasing it could help competitors and might violate users' privacy rights.

We're not entirely in the dark, and have some simple but useful tools. Among them:

  • Google Trends measures the total volume of searches for a given term and can capture the tipping point when false narratives break out into the mainstream.
  • NewsWhip gauges the attention particular topics are receiving by measuring the social media interactions — Facebook and Twitter likes and shares, for example — that news stories and other links about them garner. (It's how we built our chart above.)

Yes, but: Such methods provide just a small part of the picture — and nothing about whether the people clicking on misinformation are actually buying it.

  • "Measurement of reach alone never tells you the story of where it is that [misinformation is] having influence," said Camille François, the chief information officer of social media analysis firm Graphika, which has proposed its own scale for measuring misinformation-incident severity.

Between the lines: So-called "super spreaders" of misinformation — such as President Trump and his family, who hoist large volumes of often obscure misinformation to large followings — play a big role here. But they're far from the only factor.

The big picture: Experts Axios talked with point to several big problems with existing methods of quantifying misinformation.

1. The numbers that are available are incomplete and potentially misleading.

  • Twitter and Facebook have offered snapshots of how much material they've taken down around certain topics, but not the total volume of material they're reviewing.
  • Observers aren't sold on relying on the platforms' own assessments. "They make mistakes in both directions," said Ian Vandewalker, who focuses on influence and disinformation campaigns as senior counsel for the Democracy Program at the Brennan Center for Justice.
  • "They're using algorithms, so they miss a lot of things, and they also have a lot of false positives."

2. The public internet is only one stream in the broader misinformation deluge.

  • False claims and conspiracy theories are increasingly being spread in private Facebook groups, private chat servers on platforms like Discord, private texts and messaging groups. They also surface in partisan media outlets, elected officials' public statements and everyday real-world conversation.
  • "It is in all types of spaces," said Amy Mitchell, director of journalism research at Pew Research Center. "This is not just a social media phenomenon."

3. "Misinformation" can be a subjective category.

  • Something like "5G towers spread COVID-19" is an easily adjudicated false claim. But most misinformation appears in shades of gray, coming as a misleading gloss on events or statistics with some basis in reality.
  • Claims that downplay the threat posed by the coronavirus, for instance, often leave out the fact that it can be more deadly to people with pre-existing conditions — and that many people who have survived the virus are suffering long-term health complications.
  • And the language of misinformation is often innuendo and obfuscation — vague allusions to conspiracies and malfeasances rather than bald-faced lies.

What's next: To measure misinformation, we may need to think less about counting grains of sand and focus more on following currents. That would mean a greater effort on classifying and tracking the communities discussing topics linked to misinformation.

  • Yonder, an artificial intelligence startup that monitors mis- and disinformation, is one of a number of companies and research groups doing just that.
  • Understanding who's driving discussion of a topic can serve as a shortcut for individuals to judge its merits without relying on platform enforcement or transparency.
  • "We need to empower the users who consume this information with more information about the agenda behind the groups that are promoting it," Yonder CEO Jonathon Morgan told Axios.

What China's population woes mean for the rest of the world

China released its censusreport on Tuesday, showing that the number of births in the country last year dropped 18% from 2019. And China isn't alone — populations have been stagnating globally for decades, including in the U.S.

Why it matters: China has long relied on its large population — the biggest in the world — as a core engine for economic growth. The way that it, and officials across the globe, deal with changing demographics will lead to shifts in the economy and geopolitics.

Keep reading... Show less

Inside Liz Cheney's plans to continue fighting for soul of GOP after leadership ouster

As she faces a voteto be thrown out of House Republican leadership, Rep. Liz Cheney has told associates she doesn’t plan on going anywhere — and plans to run for re-election.

What to watch: In the meantime,as she sees it, she will aggressively pursue a fight for the soul of the Republican Party, after an expected vote to strip her of her post as GOP conference chair, the party's No. 3 House post.

Keep reading... Show less

Biden plans to send envoy as Israel and Hamas escalate toward war

Tel Aviv — With Israel and Hamas now engaged in their most destructive fight in seven years, the Biden administration is considering plans to dispatch a State Department official to join the de-escalation efforts, five Israeli officials and Western diplomats tell me.

Driving the news: The fighting intensified overnight, with Hamas and other militants firing a second barrage of over 100 rockets toward Tel Aviv and other nearby cities, and Israel continuing its air campaign in the Gaza Strip by destroying high-rise buildings, Hamas facilities and rocket units.

Keep reading... Show less

Swing-voter focus group says ousting Liz Cheney is a mistake

As House Republicans meet to oust Rep. Liz Cheney from her leadership post for criticizing Donald Trump, swing voters in Axios' latest Engagious/Schlesinger focus groups hold a near-unanimous view that Minority Leader Kevin McCarthy and his caucus are making a mistake.

The big picture: Nine of 14 voters said they could vote for a Republican for U.S. House or Senate races next year. All but one ruled out backing any candidate who clings to the former president's lie that the 2020 election was stolen from him.

Keep reading... Show less

Employees grapple with re-entry anxiety as jobs call them back

Pandemic-related anxieties are entering a new phaseas more employers start to call vaccinated workers back into their offices.

Why it matters: Some employees simply don't want to go back to the office; some are desperate to. Some are struggling to rearrange their routines yet again; some don't have that flexibility. And everyone — employers and employees alike — is figuring out on the fly how to make it work.

Keep reading... Show less

In photos: Long lines and fuel shortages amid Colonial Pipeline shutdown

Reports of fuel shortages across the U.S. emerged on Tuesday as the national average for gasoline prices soared to its highest level since 2014 amid a key fuel pipeline shut down, per Bloomberg.

What's happening: Operator Colonial Pipeline aims to have service restored by the week's end following last Friday's ransomware attack that shut down some 5,500 miles of pipeline from Texas to New Jersey. Florida Gov. Ron DeSantis (R) declared a state of emergency after panic-buying created a fuel shortage.

Keep reading... Show less

Over 100 Republicans threaten to form 3rd party unless GOP breaks from Trump

More than 100 Republicans will sign a letter Thursday threatening to create a third party if the GOP doesn't "break" with former President Trump, Reuters first reported.

Why it matters: Per Axios' Mike Allen and Jim VandeHei, Trump's grip on the GOP has gotten stronger since the Jan. 6 Capitol riot. The Republican Party's "allegiance to Trump" as he continues to make false claims about his 2020 election loss has "dismayed" the group, according to Reuters.

Keep reading... Show less

Democratic Rep. Stephanie Murphy to announce Senate challenge to Marco Rubio

Democratic Rep. Stephanie Murphy is planning to announce a campaign for the U.S. Senate in Florida against Republican Sen. Marco Rubio in early June, people familiar with the matter tell Axios.

Why it matters: Murphy is a proven fundraiser. Jumping in now would give her an early start to build her case for the Democratic nomination and potentially force Rubio and allied GOP groups to spend heavily to retain a seat in a state that’s trending Republican.

Keep reading... Show less

Insights

mail-copy

Get Goodhumans in your inbox

Most Read

More Stories