Show an ad over header. AMP

With Google's firing of AI bias expert, tech research becomes hazardous ground

Tech giants have brought on teams of ethicists and diversity advocates to counter criticism of their products' impact on society — but they're not always happy with their experts' findings.

Driving the news: Google's abrupt firing of prominent researcher Timnit Gebru last week sent waves through the industry, raising questions about the company's commitment to free research and tolerance of dissent.


The big picture: Research units within large tech companies have made many fundamental technical breakthroughs in the past. But as technology has played an ever bigger role in society, and more company-backed research has focused on tech's social impact, researchers' findings don't always line up with corporate objectives.

Details:

  • Gebru, a leader in the field of AI ethics, wrote Google management with a list of concerns after the company insisted its name be taken off a paper she and others had submitted for an industry conference.
  • The paper explores problems with large-scale language processing — Google's foundational business.
  • Gebru said she'd leave Google if the company didn't address her concerns, and Google told her it took that as an immediate resignation.
  • Separately, Gebru had also written an email that circulated widely within Google criticizing the company's record on diversity.
  • Several thousand people, from both inside Google and elsewhere, have signed an open letter calling on Google to explain its actions and commit to greater transparency.

Between the lines: Gebru has been a strong advocate for reducing bias in AI, and a paper she co-authored exposed how gender and racial basis is built into many facial-recognition systems.

  • Sources inside and outside of Google say her work in both ethics and diversity had ruffled feathers in some corners of the company even as she maintained the support of both her manager and the broader team focused on AI ethics.
  • Meredith Whittaker, who helped organize last year's Google employee walkout, said that Google's move sends a chilling message. "When they felt she was pushing too hard on the issues she was hired to advocate for, they fired her," Whittaker said.

State of play: Within Google's research unit, the move has raised concerns about the company's commitment to academic freedom and suggested to some that women and people of color are targeted for retribution when they speak out.

  • It also comes as Google finds itself under scrutiny from government, critics and its own workers for everything from allegations of monopolistic practices to its treatment of contractors to the business it does with military and government agencies.
  • Known for many years for its freewheeling and outspoken culture, Google has more recently dialed back its toleration of internal debate and dissent.

The other side: in a public note that also included his Thursday email to his staff, Google AI head Jeff Dean noted that Google's research and publication practices are designed to reflect that it employs a wide range of researchers, some of whom disagree with one another.

  • He says the company has "a strong track record of publishing work that challenges the status quo." Google declined to comment beyond Dean's statement.

Why it matters: Research from companies like Google forms a considerable portion of the broader body of work on key topics like AI. Gebru's case raises questions about the extent to which corporate research is shaped by corporate interests.

Our thought bubble: The conflict is in part a case of mismatched expectations.

  • Companies should hardly be surprised if the diversity advocates and ethicists they hire point out problematic systems and behaviors inside their walls.
  • At the same time, those researchers realistically can't expect the same level of academic freedom they would find working at an academic institution or nonprofit.

The bottom line: Cynthia Yeung, an industry veteran who spent five years at Google, put it bluntly: "Maybe the trade-off should be more clearly spelled out so researchers can make informed decisions before they accept a job offer: You get paid academic salaries in exchange for intellectual freedom, and you get paid Silicon Valley salaries in exchange for allowing your name/likeness to be used for brand/PR purposes and your research to be censored arbitrarily."

U.S. grants temporary protected status to thousands of Venezuelans

Venezuelans living in the United States will be eligible to receive temporary protected status for 18 months, the Department of Homeland Security announced Monday.

Why it matters: Tens of thousands of Venezuelans have fled to the U.S. amid economic, political and social turmoil back home. Former President Trump, on his last full day in office, granted some protections to Venezuelans through the U.S. Deferred Enforced Departure program, but advocates and lawmakers said the move didn't go far enough.

Keep reading... Show less

Zuckerberg floated possibility of remote work in January 2020. Sandberg thought he was "nuts"

Chief operating officer Sheryl Sandberg thought Mark Zuckerberg was "nuts" when he raised the possibility in January 2020 that 50,000 Facebook employees might have to work from home. By March 6, they were.

Why it matters: In an interview Monday with Axios Re:Cap, Sandberg explained how Facebook moved quickly to respond to the pandemic with grants for small businesses and work-from-home stipends for its employees, and how the company has been watching the unfolding crisis for women in the workforce.

Keep reading... Show less

Supreme Court declines to hear case on qualified immunity for police officers

The Supreme Court on Monday declined to hear an appeal for a lawsuit brought against Cleveland police officers that challenges the scope of qualified immunity, the legal doctrine which has been used to shield officers from lawsuits alleging excessive force, Reuters reports.

Why it matters: The doctrine has been the subject of scrutiny from civil rights advocates. Eliminating qualified immunity was one of the key demands of demonstrators during nationwide protests in 2020 following the killing of George Floyd.

Keep reading... Show less

CDC: Fully vaccinated people can gather indoors without masks

People who have been fully vaccinated against COVID-19 can take fewer precautions in certain situations, including socializing indoors without masks when in the company of low-risk or other vaccinated individuals, according to guidance from the Centers for Disease Control and Prevention released Monday.

Why it matters: The report cites early evidence that suggests vaccinated people are less likely to have asymptomatic infection, and are potentially less likely to transmit the virus to other people. At the time of its publication, the CDC said the guidance would apply to about 10% of Americans.

Keep reading... Show less

Ripple CEO calls for clearer crypto regulations following SEC lawsuit

Ripple CEO Brad Garlinghouse tells "Axios on HBO" that if his company loses a lawsuit brought by the SEC, it would put the U.S. cryptocurrency industry at a competitive disadvantage.

Why it matters: Garlinghouse's comments may seem self-serving, but his call for clearer crypto rules is consistent with longstanding entreaties from other industry players.

Keep reading... Show less

Republican Sen. Roy Blunt will not seek re-election in 2022

Sen. Roy Blunt (R-Mo.) will not run for re-election in 2022, he announced on Twitter Monday.

Why it matters: The 71-year-old senator is the No. 4-ranking Republican in the Senate, and the fifth GOP senator to announce he will not run for re-election in 2022 as the party faces questions about its post-Trump future.

Keep reading... Show less

COVID Tracking Project officially ends daily updates, citing improved government transparency

The COVID Tracking Project, a volunteer group of data analysts, researchers, and journalists brought together by The Atlantic, published its final daily update on Monday — the one-year anniversary of its founding.

Why it matters: The project quickly became a vital resource for news media, academic researchers, and everyday Americans to track COVID-19 cases, hospitalizations, and deaths in the absence of reliable and public data from the federal government.

Keep reading... Show less

As Congress eyes massive infrastructure bill, energy and climate move closer to center stage

The imminent enactment of Democrats' $1.9 trillion COVID-19 relief package creates space for lawmakers and the White House to craft infrastructure plans with big climate and energy-related provisions.

Why it matters: President Biden, during the campaign, vowed to make low-carbon energy, climate-resilient infrastructure and transportation projects a big focus of an economic recovery package. And the Texas power crisis could give fresh momentum to investments in grid modernization.

Keep reading... Show less

Insights

mail-copy

Get Goodhumans in your inbox

Most Read

More Stories