Phone Silence Bias

In early May I wrote The Silence of the Phones observing the lack of polling calls after cutting off the land line. I wondered if polling was skewed by not including the increasing population of cell phone only Americans. Since that time I’ve received repeated assurances that pollsters make sure their polls are correct by matching their respondent demographics to the target poll group.

In three major election surveys comparing results with and without cell phone users in polls the Pew Research Center has observed “a consistent difference of two-to-three points in the margin.” The article states

Traditional landline surveys are typically weighted to compensate for age and other demographic differences, but the process depends on the assumption that the people reached over landlines are similar politically to their cell-only counterparts. These surveys suggest that this assumption is increasingly questionable, particularly among younger people.

My question now: when do “small, and not statistically significant, differences” of two to three percentage points become recognized as real and significant? If you get the same two point spread over and over does it not illustrate a two point bias in your method?

The Pew study strongly suggests that Obama has been doing two to three points stronger than our pollsters report. The professionals need to revisit their weighting techniques.

Leave a Reply

  

  

  

You must properly answer this question to post your comment.

You can use these HTML tags

<a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>