Show an ad over header. AMP

I am the FIRST

Exclusive: Inside Snapchat's push to make cameras more inclusive

Snapchat has launched an initiative to redesign its core camera technology to make it better able to capture a wide range of skin tones, the company tells Axios.

Why it matters: Around 5 billion pictures are taken using Snapchat's camera each day. Those images form the starting point for how many people see themselves, their friends and their world.


Historically, the chemical processes behind film development used light skin as its chemical baseline — basically optimizing for whiteness, a legacy that continues today, says Snapchat engineer Bertrand Saint-Preux.

  • "The camera is, in fact, racist," Saint-Preux said.

Between the lines: Film cameras eventually got better at exposing for darker tones, but not as part of a concerted effort to make things more equitable for people. Rather, it was complaints from chocolate makers and photographers shooting other dark subjects that pushed the industry to do better.

  • The early days of digital photography were similarly fraught. Some HP webcams, as well as Microsoft's Kinect, promised the ability to detect faces, but had trouble doing so with people of darker skin tones.
  • Technology, though, has made strides in recent years that should aid the effort, including high dynamic range and the ability to fuse multiple captures to create a single image.

For Snapchat, the "inclusive camera" effort is broader than just capturing dark skin as well as light skin. It means identifying and removing biased assumptions (e.g. that smaller, thinner noses are better) when automatically adjusting people's appearance.

  • The company still wants people to have flexibility, but wants to make a high-quality true image the starting point and then put the controls in the hands of the individual.
  • The companywide effort started with a presentation made to top executives by Saint-Preux last summer in the wake of the George Floyd protests.

How it works: Snapchat is working with several noted directors of photography from the film industry to learn techniques they use to best capture actors with darker skin tones. Among the projects that are in development or testing:

  • Developing techniques to adjust images after they have been captured, such as correcting brightness and exposure to create a more balanced image.
  • Improving the selfie camera’s ability to capture low light by making adjustments to the front flash. So, for example, if someone was taking a selfie in a dark room, the display would use the right type of lightwaves to properly illuminate their skin tone.
  • Another key area involves machine learning systems and how those systems are optimized. If you tell a computer to optimize for the best average result in photos — which is what many algorithms do — it will make most people appear better and not worry if some people at the margins have a poor result.
  • On the flip side, if you focus on getting the quality of everyone's image above a certain threshold, you will produce a more equitable result.

Yes, but: Snapchat readily acknowledges its track record is far from perfect. This is the same company that released a digital blackface Bob Marley feature for 4/20 several years ago, and just last year had to apologize for a Juneteenth filter that asked subjects to "smile" while they break free from chains.

  • "We are very mindful of our past mistakes and are applying what we've learned to all of our efforts to build more inclusive design processes, systems and products," Snapchat told me.

What's next: Snapchat is working on a variety of efforts that will take longer to bring to market. One part is expanding the inclusive camera effort to other groups, such as ensuring that those with glasses or other assistive aids can fully use the company's filters.

  • Snap is also looking for how it might enable outside developers and partners to take advantage of the tools it is creating internally.

Israel to continue Gaza operation, officials rule out cease-fire for now

The Israeli security cabinet on Sunday decided to continue the Gaza operation, according to military plans. Israeli officials said a cease-fire is not on the table right now.

Why it matters: There was a growing feeling within the military and senior defense establishment ahead of the cabinet meeting that Israel should start moving toward ending the operation.

Keep reading... Show less

Liz Cheney says she regrets voting for Trump in 2020

Rep. Liz Cheney (R-Wyo.), who was ousted Wednesday as the third-highest ranking House Republican, told ABC's "This Week" that she regrets voting for former President Trump in 2020, although she could never have supported Biden.

Why it matters: Cheney, voted out of House Republican leadership over her repeated condemnation of Trump and his unfounded claims of election fraud, plans to challenge the former president for ideological dominance of the GOP.

Keep reading... Show less

Blinken speaks with Associated Press CEO after Israeli airstrike destroys Gaza office

Secretary of State Antony Blinken spoke with Associated Press CEO Gary Pruitt on Saturday after an Israeli airstrike destroyed the outlet's local media office in the Gaza Strip, which also housed the Al Jazeera office.

Why it matters: "The world will know less about what is happening in Gaza because of what transpired today" Pruitt said in a statement — as fighting between Israel and Hamas continues to bring more casualties.

Keep reading... Show less

Fashion

Consumers and retailers alike are still trying to figure out what Americans will want to wear as they head back out into the world after a year at home, in sweatpants.

Why it matters: The choices people make about their post-pandemic wardrobes will help define what, exactly, our “new normal” is. They'll indicate how both work and socializing have changed, and will tell the story of how people expressed themselves in the aftermath of a year of massive transformation.

Keep reading... Show less

UN Security Council meeting on Israel-Gaza as Netanyahu vows to continue strikes

The United Nations Security Council was preparing to meet Sunday, as the aerial bombardment between Israel and Hamas between entered a seventh day.

The latest: Four Palestinians died in airstrikes early Sunday, as Israeli forces bombed the home of Gaza's Hamas chief, Yehya al-Sinwar, per Reuters.

Keep reading... Show less

In photos: Protesters rally across U.S. and the world over Israeli–Palestinian conflict

Thousands of people rallied across the U.S. and the world Saturday following days of violence in Gaza and Israel that's killed at least 145 Palestinians, including 41 children, and eight Israelis, per AP.

The big picture: Most demonstrations were in support of Palestinians. There were tense scenes between pro-Israeli government protesters and pro-Palestinian demonstrators in Winnipeg, Canada, and Leipzig, Germany, but no arrests were made, CBS News and DW.com report.

Keep reading... Show less

Biden in call with Netanyahu raises concerns about civilian casualties in Gaza

President Biden spoke to Israeli Prime Minister Benjamin Netanyahu Saturday and raised concerns about civilian casualties in Gaza and the bombing of the building that housed AP and other media offices, according to Israeli officials.

The big picture: At least 140 Palestinians, including dozens of children have been killed in Gaza since fighting between Israel and Hamas began Monday, according to Palestinian health officials. Nine people, including two children, have been killed by Hamas rockets in Israel.

Keep reading... Show less

The COVID lab-leak theory goes mainstream

A group of high-profile scientists published a letter calling for renewed investigation into the origins of COVID-19 — including the theory that it spilled out of a virology lab.

Why it matters: The possibility that SARS-CoV-2 was created in a Chinese lab and accidentally escaped — rather than emerging naturally from an animal — was initially dismissed as a conspiracy theory. But the letter shows a potential lab leak is increasingly being taken seriously.

Keep reading... Show less

Insights

mail-copy

Get Goodhumans in your inbox

Most Read

More Stories