STREAMING NOW: Watch Now

Pollsters tried to learn from 2016 mistakes. Will the 2018 midterms be different?

The polling industry has a lot on the line heading into Tuesday's ...

Posted: Nov 6, 2018 10:10 AM
Updated: Nov 6, 2018 10:10 AM

The polling industry has a lot on the line heading into Tuesday's midterm election.

Critics blamed pollsters when voters were caught off guard by Donald Trump's election in 2016. Old cries of "don't believe the polls" became fevered shouts. And the president has encouraged distrust by calling certain polls "fake" and claiming they are used to "suppress" the vote.

2016 Presidential election

2018 Midterm elections

Business and industry sectors

Business, economy and trade

Donald Trump

Elections (by type)

Elections and campaigns

Government and public administration

Hillary Clinton

Journalism and news media

Media industry

Midterm elections

Political candidates

Political Figures - US

Politics

US Federal elections

US Presidential elections

Voters and voting

That's not true. But there is persistent and widespread suspicion about polling, according to, you guessed it, a McClatchy-Marist poll. And it exists on both sides, albeit in different forms.

"I think Democrats may have felt let down by the polls but don't think it was an intentional error. I think many Republicans believe the polling errors of 2016 were intentional," GOP pollster and co-founder of Echelon Insights Kristen Soltis Anderson told CNN.

So can the industry regain trust?

Since 2016 there's been a whole lot of self-reflection in the polling world. Pollsters have tweaked their techniques; pundits have become more cautious when talking about polls; and news outlets have conducted some fascinating experiments.

On Tuesday, all the efforts are being put to the test.

"Some pollsters would disagree with this, but the way that the public generally views whether or not polling is accurate is whether or not it gets the results of the election right," CNN analyst Harry Enten said on "Reliable Sources."

"I'm not necessarily sure that's fair," Enten said, "but I do think that there is more pressure on pollsters this year to get it right given the president's rhetoric and given what happened in 2016."

Many, though not all, 2016 polls underestimated support for Trump. This effect was particularly pronounced at the state level, where there were embarrassing "misses," showing Hillary Clinton with safe leads in states Trump actually carried.

Most national polls accurately showed Clinton winning the popular vote. But reporters and commentators made lots of mistakes in their interpretations of the polls. Readers and viewers did, too. Many people discounted the margin and other factors and made faulty assumptions that Trump would lose to Clinton.

There were other problems, too. Predictive features on websites gained lots of traffic before the election but caused lots of consternation afterward. HuffPost's model infamously showed Clinton with a 98 percent chance of winning. "We blew it," the site admitted afterward.

But just as importantly, HuffPost's Natalie Jackson tried to explain why.

Other news outlets have also tried to be more transparent and remind voters of what polls cannot convey.

In special elections since 2016, Democrats have repeatedly outperformed polls of their races.

The top example was the Virginia governors' race. "Ralph Northam was favored by three points. He ended up winning by nine," Enten said.

But past outcomes are not an indicator of future results.

"I think many pollsters and forecasters have tried to be much more intentional about explaining uncertainty and being humble about what data can and can't tell us," Anderson said. "Because I think there was a big sense that in 2016, there was more certainty conveyed than may have been justified by the available data."

So political pros and reporters are communicating poll results differently this time. Time magazine's Molly Ball, who has a no-predictions rule for herself, said that even people who do make predictions are adding more caveats: There's "less of the, 'Well, the needle shows this' and more of, 'Here's what it doesn't show, here's what we should always remember can happen about probabilities.'"

Early voting has been explosive in the midterms, indicating above-average enthusiasm among both Democrats and Republicans. Pollsters have to make assumptions about turnout when contacting "likely voters," and this is a difficult election to forecast.

The 2018 electorate is "a universe that doesn't exist yet," Democratic pollster Margie Omero said. "I mean, people don't know whether they're going to vote, some people."

They may tell a pollster that they're sure to vote, but never make it to the ballot box. Or they might change who they're voting for.

Conversely, certain subsets of voters may have a big impact on the final results without really showing up in the pre-election polling. If pollsters assume relatively low youth turnout, but lots of young people vote for the first time, that could cause big surprises in certain races.

The vast majority of people who are called by pollsters decline to participate, so the researchers have to make a huge number of phone calls, bend over backwards to reach a representative sample of people, and weight their results accordingly.

Some polls are higher quality than others. Most news outlets tend to favor live interviewers, as opposed to computerized systems, and a mix of landline and cell phone calls. But some outlets are wading into web-based polling. CNN's polling standards preclude reporting on web polls.

This fall The New York Times pulled back the curtain by conducting "live polling" and publishing the results in real time, call by call. Working with Siena College, the surveyors made 2,822,889 calls and completed 96 polls of House and Senate races.

"We wanted to demystify polling for people," said Nate Cohn of The Times' Upshot blog.

"From our point of view, it's almost a miracle how accurate polls usually are, given all the challenges," Cohn said in an interview with CNN.

He emphasized that polls are "very fuzzy things." And the real time polling showed this to the public. The researchers sought to interview about 500 people for each race that was examined.

In Iowa's fourth congressional district, for example, 14,636 calls resulted in 423 interviews.

The results showed the incumbent, far-right congressman Steve King, with 47% support, and his Democratic challenger J.D. Scholten with 42%.

The Times characterized this as a "slight edge" for King, with lots of room for error. "The margin of sampling error on the overall lead is 10 points, roughly twice as large as the margin for a single candidate's vote share," the Times explained on its website.

Cohn's final pre-election story noted that "even modest late shifts among undecided voters or a slightly unexpected turnout could significantly affect results."

That's the kind of language that lots of polling experts are incorporating into their stories and live shots, especially in the wake of the 2016 election.

"With polling, you never actually get to the truth," Cohn said. "You inch towards it, and you think you end up within plus or minus 5 points of it at the end."

As Enten put it, "polls are tools," not meant to be perfect. But that message needs to be reinforced through the news media.

Mississippi Coronavirus Cases

Data is updated nightly.

Cases: 156868

Reported Deaths: 3851
CountyCasesDeaths
DeSoto10409104
Hinds10279202
Harrison7313112
Jackson6566128
Rankin5887106
Lee529496
Madison5014107
Forrest389786
Jones369088
Lauderdale3594147
Lafayette338253
Washington3246108
Lamar297850
Oktibbeha252362
Lowndes247064
Bolivar244384
Panola232653
Neshoba2249121
Marshall222851
Leflore208591
Monroe206778
Pontotoc204231
Lincoln197366
Sunflower192655
Warren180258
Tate177751
Union171926
Copiah167940
Pike165359
Yazoo160140
Scott159430
Itawamba157635
Alcorn155628
Pearl River155368
Coahoma152743
Simpson152653
Prentiss151331
Adams144752
Grenada143345
Leake139744
Holmes133461
Covington128639
Tippah128430
George128325
Winston125526
Hancock124341
Wayne121323
Marion119446
Attala119334
Tishomingo112443
Chickasaw109432
Newton108229
Tallahatchie98127
Clay94727
Clarke93653
Jasper85223
Stone80615
Calhoun78713
Walthall77629
Montgomery76926
Carroll74115
Lawrence73814
Smith73216
Yalobusha73128
Noxubee72717
Perry68326
Tunica62619
Greene61522
Jefferson Davis59017
Claiborne58916
Amite56615
Humphreys54719
Benton50018
Quitman5007
Webster46714
Kemper45018
Wilkinson40522
Jefferson37112
Choctaw3617
Franklin3555
Sharkey32417
Issaquena1204
Unassigned00

Alabama Coronavirus Cases

Cases: 252900

Reported Deaths: 3638
CountyCasesDeaths
Jefferson33526501
Mobile20103365
Madison13723151
Tuscaloosa13366154
Montgomery12552236
Shelby1079677
Baldwin9051137
Lee787266
Morgan696451
Calhoun6598121
Etowah656167
Marshall647357
Houston541038
DeKalb498137
Cullman462443
St. Clair441956
Limestone440445
Lauderdale426754
Elmore421164
Walker3735111
Talladega370157
Jackson340423
Colbert332042
Blount306140
Autauga281842
Franklin257434
Coffee250015
Dale239054
Dallas231532
Chilton228939
Russell22663
Covington225034
Escambia202331
Tallapoosa187291
Chambers182750
Pike161514
Clarke161019
Marion144736
Winston137523
Lawrence133436
Pickens126518
Geneva12508
Marengo123424
Bibb120418
Barbour118911
Butler118642
Randolph105522
Cherokee105124
Hale98131
Fayette94616
Washington93219
Clay92824
Henry8896
Monroe83011
Lowndes80929
Cleburne78814
Macon75522
Crenshaw72230
Bullock70119
Lamar7018
Conecuh70014
Perry6916
Wilcox64818
Sumter58622
Greene43518
Choctaw43114
Coosa3664
Out of AL00
Unassigned00
Tupelo
Clear
35° wxIcon
Hi: 58° Lo: 33°
Feels Like: 31°
Columbus
Clear
37° wxIcon
Hi: 57° Lo: 31°
Feels Like: 32°
Oxford
Clear
41° wxIcon
Hi: 55° Lo: 33°
Feels Like: 38°
Starkville
Clear
32° wxIcon
Hi: 56° Lo: 30°
Feels Like: 32°
WTVA Radar
WTVA Temperatures
WTVA Severe Weather