Show an ad over header. AMP

I am the FIRST

In a world of extreme risks, the world needs a chief risk officer

A future that will see escalating danger from extreme risks demands a longer-term approach to handling these threats.

The big picture: The world was caught off guard by COVID-19, and millions of people have paid the price. But the pandemic provides an opportunity to rethink theapproach to the growing threat from low-probability but high-consequence risks — including the ones we may be inadvertently causing ourselves.


Driving the news: Earlier this week, a nonprofit in the U.K. called the Centre for Long-Term Resilience put out a report that should be required reading for leaders around the world.

  • Spearheaded by Toby Ord — an existential risk scholar at the University of Oxford — "Future Proof" makes the case that "we are currently living with an unsustainably high level of extreme risk."
  • "With the continued acceleration of technology, and without serious efforts to boost our resilience to these risks, there is strong reason to believe the risks will only continue to grow," as the authors write.

Between the lines: "Future Proof" focuses on two chief areas of concern: artificial intelligence and biosecurity.

  • While the longer-term threat of artificial intelligence reaching a level of superintelligence beyond humans is an existential risk by itself, the ransomware and other cyberattacks plaguing the world could be supercharged by the use of AI tools, while the development of lethal autonomous weapons threatens to make war far more chaotic and destructive.
  • Natural pandemics are bad enough, but we're headed toward a world in which thousands of people will have access to technologies that can enhance existing viruses or synthesize entirely new ones. That's far more dangerous.

It's far from clear how the world can control these human-made extreme risks.

  • Nuclear weapons are easy by comparison — bombs are difficult to make and even harder for a nation to use without guaranteeing its own destruction, which is largely why, 75 years after Hiroshima, fewer than 10 countries have developed a nuclear arsenal.
  • But both biotech and AI are dual-use technologies, meaning they can be wielded for both beneficial and malign purposes. That makes them far more difficult to control than nuclear weapons, especially since some of the most extreme risks — like, say, a dangerous virus leaking out of a lab — could be accidental, not purposeful.
  • Even though the risks from biotech and AI are growing, there is little in the way of international agreements to manage them. The UN office charged with implementing the treaty banning bioweapons is staffed by all of three people, while efforts to establish global norms around AI research — much of which, unlike the nuclear sphere, is carried out by private firms — have been mostly unsuccessful.

What to watch: The "Future Proof" report recommends a range of actions, from focusing on the development of technologies like metagenomic sequencing that can rapidly identify new pathogens to having nations set aside a percentage of GDP for extreme risk preparation, just as NATO members are required to spend on defense.

  • A global treaty on risks to the future of humanity, modeled on earlier efforts around nuclear weapons and climate change, could at least raise the international profile of extreme risks.
  • Most importantly, the report calls for the creation of "chief risk officers" — officials empowered to examine government policy with an eye toward what could go very wrong.

The bottom line: We are entering a frightening time for humanity. Ord estimates the chance that we will experience an existential catastrophe over the next 100 years is 1 in 6, the equivalent of playing Russian roulette with our future.

  • But if our actions have put the bullet in that gun, it's also in our power to take it out.

Why the startup world needs to ditch "unicorns" for "dragons"

When Aileen Lee originally coined the term "unicorn" in late 2013, she was describing the 39 "U.S.-based software companies started since 2003 and valued at over $1 billion by public or private market investors."

Flashback: It got redefined in early 2015 by yours truly and Erin Griffith, in a cover story for Fortune, as any privately-held startup valued at $1 billion or more. At the time, we counted 80 of them.

Keep reading... Show less

Scoop: Facebook's new moves to lower News Feed's political volume

Facebook plans to announce that it will de-emphasize political posts and current events content in the News Feed based on negative user feedback, Axios has learned. It also plans to expand tests to limit the amount of political content that people see in their News Feeds to more countries outside of the U.S.

Why it matters: The changes could reduce traffic to some news publishers, particularly companies that post a lot of political content.

Keep reading... Show less

Scoop: Amazon quietly getting into live audio business

Amazon is investing heavily in a new live audio feature that's similar to other live audio offerings like Clubhouse, Twitter Spaces and Spotify's new live audio platform, sources tell Axios.

Why it matters: As with Amazon's efforts in podcasting and music subscriptions, the company sees live audio as a way to bolster the types of content it can offer through its voice assistant, Alexa, and its smart speaker products.

Keep reading... Show less

Hurricane Ida exposes America's precarious energy infrastructure

The powerful hurricane that plunged New Orleans into darkness for what could be weeks is the latest sign that U.S. power systems are not ready for a warmer, more volatile world.

The big picture: “Our current infrastructure is not adequate when it comes to these kinds of weather extremes,” Joshua Rhodes, a University of Texas energy expert, tells Axios.

Keep reading... Show less

"We must go further": 70% of adults in European Union are fully vaccinated

About 70% of adults in the European Union are fully vaccinated against COVID-19, Ursula von der Leyen, the president of the European Commission, said Tuesday.

Why it matters: The milestone makes the E.U. one of the world's leaders in inoculations, after an initially lagging vaccine campaign, the New York Times notes.

Keep reading... Show less

What Elizabeth Holmes jurors will be asked ahead of fraud trial

Jury selection begins today in USA v. Elizabeth Holmes, with the actual jury trial to get underway on Sept. 8.

Why it matters: Theranos was the biggest fraud in Silicon Valley history, putting both hundreds of millions of dollars and thousands of patients' health at risk.

Keep reading... Show less

Insights

mail-copy

Get Goodhumans in your inbox

Most Read

More Stories