Show an ad over header. AMP

I am the FIRST

Why domestic terrorists are so hard to police online

Domestic terrorism has proven to be more difficult for Big Tech companies to police online than foreign terrorism.

The big picture: That's largely because the politics are harder. There's more unity around the need to go after foreign extremists than domestic ones — and less danger of overreaching and provoking a backlash.


Flashback: When tech firms came together in 2017 to tackle foreign terrorism, the bipartisan view that ISIS was a serious national security threat allowed them to take blunt actions, often relying on automation, to weed out gruesome terrorist content without fear of political retribution if they inadvertently over-censored content.

Today, tackling domestic extremism is a politically-charged debate. It's not always clear where the line is between a fringe group with protected free speech rights and a group that's actively plotting attacks like the one on the Capitol.

  • "The reason companies are less likely touse sweeping automation is because the inventible overreach would mean they would be politically punished in a way that wasn't true for ISIS," says Alex Stamos, director of the Stanford Internet Observatory and former Facebook Chief Security Officer. "ISIS had no domestic constituency."
  • "It would create a massive backlash and censorship that we haven't seen on the Internet before," says Mark Little, CEO and co-founder of disinformation tracking firm Kinzen.

Be smart: One of the key differences between ISIS and today's domestic extremists is that being part of ISIS, a group that designates its members, is effectively illegal, says Stamos. Being a follower of a fringe-right group like QAnon or Proud Boys isn't inherently illegal — they've done nothing wrong until they become a part of a violent or forceful conspiracy.

Driving the news: Social media firms are scrambling to crack down on domestic terrorist threats ahead of the inauguration and beyond, but experts say their efforts are only temporary solutions.

  • "There have been countless fact-checking and other efforts designed to rid social media of misinformation," argues Ethan Zuckerman of the University of Massachusetts-Amherst. "They’re not going to work until the party and the major ideological amplifiers start explicitly renouncing these points of view."

Instead of trying to narrowly target pieces of problematic content, as was the case with foreign terrorism, tech platforms are now trying to target and remove broad movements by relying on experts to study their behavior.

  • This requires much more human intelligence, tracking the movements of fringe groups at the ground level, as opposed to relying mostly on automation.

"In the past, egregious content could be detected using the same types of tools used to target spam or copyright infringement," says Little, formerly a Twitter executive. But today, fringe actors will find a ways to continue adapting their language and techniques to avoid detection online, making this strategy less effective.

  • For example, participants within the fringe anarchist Boogaloo movement will change the terms they use to refer to themselves online to avoid detection, per Little.
  • The QAnon conspiracy continuously reinvents itself to keep people hooked, says Little's colleague Shane Creevey, head of editorial for Kinzen.
  • One example he notes is when the movement attached itself to the #SavetheChildren hashtag, making it harder to take action on the movement without inadvertently cracking down on good speech.

The big picture: Even when big tech companies do take action on these types of movements — Twitter and Facebook have both effectively banned QAnon — the lack of industry-wide coordination around the issue means fringe movements can easily migrate to smaller platforms, and often darker corners of the web.

  • One solution would be for tech companies to create a coalition to address domestic extremism specifically, similar to the one they aimed originally at foreign terrorists in 2017 with the creation of Global Internet Forum to Counter Terrorism (GIFCT).
  • GIFCT relies on large platforms to share information, including graphic images, memes, videos, etc. about terrorist threats with smaller digital players to effectively keep terrorist content off of the internet. The smaller companies are able to use AI to match bad imagery to content as it is uploaded and block it before it gets any views.
  • No such coalition exists in the same fashion today for white supremacy, although the big platforms are in regular touch with each other and law enforcement on this issue.

What to watch: Sources say *the Trump administration's threat of unilateral action against Big Tech companies* spooked them out of taking bolder stances on fringe right extremism.

  • But Stamos says the Biden administration is less likely to abuse its power in the same way. "I expect them to use their investigative power on real policy issues, not because they dislike moderation decisions."

The bottom line: When it comes to domestic terrorism, "You can't solve this with an algorithm," says Little.

Flashback: Domestic online meddling threatens 2020 election

4 ffp

Why the startup world needs to ditch "unicorns" for "dragons"

When Aileen Lee originally coined the term "unicorn" in late 2013, she was describing the 39 "U.S.-based software companies started since 2003 and valued at over $1 billion by public or private market investors."

Flashback: It got redefined in early 2015 by yours truly and Erin Griffith, in a cover story for Fortune, as any privately-held startup valued at $1 billion or more. At the time, we counted 80 of them.

Keep reading... Show less

Scoop: Facebook's new moves to lower News Feed's political volume

Facebook plans to announce that it will de-emphasize political posts and current events content in the News Feed based on negative user feedback, Axios has learned. It also plans to expand tests to limit the amount of political content that people see in their News Feeds to more countries outside of the U.S.

Why it matters: The changes could reduce traffic to some news publishers, particularly companies that post a lot of political content.

Keep reading... Show less

Scoop: Amazon quietly getting into live audio business

Amazon is investing heavily in a new live audio feature that's similar to other live audio offerings like Clubhouse, Twitter Spaces and Spotify's new live audio platform, sources tell Axios.

Why it matters: As with Amazon's efforts in podcasting and music subscriptions, the company sees live audio as a way to bolster the types of content it can offer through its voice assistant, Alexa, and its smart speaker products.

Keep reading... Show less

Hurricane Ida exposes America's precarious energy infrastructure

The powerful hurricane that plunged New Orleans into darkness for what could be weeks is the latest sign that U.S. power systems are not ready for a warmer, more volatile world.

The big picture: “Our current infrastructure is not adequate when it comes to these kinds of weather extremes,” Joshua Rhodes, a University of Texas energy expert, tells Axios.

Keep reading... Show less

"We must go further": 70% of adults in European Union are fully vaccinated

About 70% of adults in the European Union are fully vaccinated against COVID-19, Ursula von der Leyen, the president of the European Commission, said Tuesday.

Why it matters: The milestone makes the E.U. one of the world's leaders in inoculations, after an initially lagging vaccine campaign, the New York Times notes.

Keep reading... Show less

What Elizabeth Holmes jurors will be asked ahead of fraud trial

Jury selection begins today in USA v. Elizabeth Holmes, with the actual jury trial to get underway on Sept. 8.

Why it matters: Theranos was the biggest fraud in Silicon Valley history, putting both hundreds of millions of dollars and thousands of patients' health at risk.

Keep reading... Show less

Insights

mail-copy

Get Goodhumans in your inbox

Most Read

More Stories