Show an ad over header. AMP

Worried pollsters admit huge problem

Four years later, it’s still easy to hate on the polls. Even if they called the presidential race "right" this time, the national polls vastly underestimated support for President Trump once again, leading to a major industry soul searching about how to fix some fundamental problems.

Why it matters: Without data to provide a beacon for elections, there isn’t much else to go on.


  • With a sharply divided public consuming increasingly partisan-skewed information, America has depended on data and statistics to provide clarity and reasonable expectations going into elections. 
  • Trust in the numbers has largely been eroded, and now they're more subject to partisan attack and spinning.
  • They're even under attack from Trump, who baselessly claimed that "fake polls" showing Joe Biden with a big lead were "designed to keep our voters at home, create the illusion of momentum for Biden, and diminish Republicans' ability to raise funds."

Be smart: Pollsters privately acknowledge the huge problem, but publicly say they need the final vote tallies to begin the autopsy. Biden is currently winning by 3% of the popular vote, and an average of national polls gave him a 8.4% lead.

  • Conventional political wisdom that the Democrats would take over power in the Senate also was based on faulty polls that missed down ballot race projections, too.
  • “Let’s pump the brakes a bit” before we indict the whole industry, said Courtney Kennedy, director of survey research at Pew Research Center and an author of the industry’s 2016 autopsy report

Forget the “shy Trump voter” narrative. Before the election, pollsters were worried that perhaps some Trump voters surveyed were simply too embarrassed to tell people that they were voting for him.

  • The real problem is even worse. Virtually every poll did not survey enough Trump supporters, period — meaning there’s a huge sampling error the industry needs to reckon with.

“We’ve been struggling with this issue and we keep trying to fix it and it’s not totally working,” said one worried pollster who did not want to be named for fear of ruining his industry.

  • It’s called “non response,” meaning pollsters are not getting enough Trump voters to even participate in a survey and answer questions. 
  • This isn’t just a phone call survey problem. It's in online surveys and text surveys, too.
  • “The major problem, the fundamental issue in the polling industry is declining response rate,” said Jon Cohen, chief research officer at SurveyMonkey.  
  • Another twist on this is not capturing enough “non-college educated voters” who were missing from 2016 surveys. The 2020 election proved Trump expanded his voter turnout in new demographic groups, and still polls missed them.

Another continuing culprit: state polls. As we have written before, poorly conducted state surveys were to blame for misleading the public. Biden managed to flip Michigan, Wisconsin, Arizona and Pennsylvania, but polls still overestimated enthusiasm for Biden in those states and others that were considered on the bubble.

  • “Before Election Day, it seemed to me that, sure, some polls might not have enough Trump supporters but that was okay if a poll was statistically adjusted properly to make it representative,” said Kennedy.
  • “The question looming now is whether that’s true. It’s not clear that the polls checked all the boxes and had good statistical adjustments and whether they still worked.”

The bottom line: It may be months before we learn why the polls failed to meet the public’s expectations in 2020, but two clear problem areas have been problems for a long time.

Biden's presidency will have a bleak start

A dim, gloomy scene seems increasingly set for Joe Biden's debut as president.

The state of play: He'll address — virtually — a virus-weary nation, with record-high daily coronavirus deaths, a flu season near its peak, restaurants and small businesses shuttered by wintertime sickness and spread.

Keep reading... Show less

Apps are helping people of color stop deadly police encounters

Mobile phone apps are evolving in ways that can stop rather than simply document deadly police encounters with people of color — including notifying family and lawyers about potential violations in real time.

Why it matters: As states and cities face pressure to reform excessive force policies, apps that monitor police are becoming more interactive, gathering evidence against rogue officers as well as posting social media videos to shame the agencies.

Keep reading... Show less

TikTok gets more time (again)

The White House is again giving TikTok's Chinese parent company more time to satisfy its national security concerns, rather than initiating legal action, a source familiar with the situation tells Axios.

The state of play: China's ByteDance had until Friday to satisfy national security concerns raised by the Committee on Foreign Investment in the U.S. (CFIUS), which is chaired by Treasury secretary Steve Mnuchin. This was the company's third deadline, with CFIUS having provided two earlier extensions.

Keep reading... Show less

Federal judge orders Trump administration to restore DACA

A federal judge on Friday ordered the Trump administration to fully restore the Deferred Action for Childhood Arrivals program, giving undocumented immigrants who arrived in the U.S. as children a chance to petition for protection from deportation.

Why it matters: DACA was implemented under former President Obama, but President Trump has sought to undo the program since taking office. Friday’s ruling will require Department of Homeland Security officers to begin accepting applications starting Monday and guarantee that work permits are valid for two years.

Keep reading... Show less

Bay Area counties to enact stay-at-home order

Counties around the San Francisco Bay Area will adopt California’s new regional stay-at-home order amid surges in cases and ICU hospitalizations, health officials said Friday.

The big picture: California Gov. Gavin Newsom announced a three-week stay-at-home order on Thursday that would go into effect in regions with less than 15% ICU capacity. Despite the Bay Area’s current 25.3% ICU capacity, health officials from Alameda, Contra Costa, Marin, Santa Clara, San Francisco and the city of Berkeley are moving ahead with a shelter-in-place mandate in the hopes of reducing risk.

Keep reading... Show less

Podcast: Former FDA chief Rob Califf on the COVID-19 vaccine approval process

The U.S. Food and Drug Administration (FDA) is reviewing two emergency use authorization requests for COVID-19 vaccines, with an outside advisory committee scheduled to meet next Thursday to review data from Pfizer and its German partner BioNTech.

Axios Re:Cap digs in with former FDA commissioner Rob Calif about the EUA process, the science and who should make the final call.

The U.S. economic recovery needs rocket fuel

Data: BLS. Chart: Axios Visuals

Friday's deeply disappointing jobs report should light a fire under Congress, which has dithered despite signs the economy is struggling to kick back into gear.

Driving the news: President-elect Biden said Friday afternoon in Wilmington that he supports another round of $1,200 checks.

Keep reading... Show less

Insights

mail-copy

Get Goodhumans in your inbox

Most Read

More Stories