• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
QuestionPro

QuestionPro

questionpro logo
  • Products
    survey software iconSurvey softwareEasy to use and accessible for everyone. Design, send and analyze online surveys.research edition iconResearch SuiteA suite of enterprise-grade research tools for market research professionals.CX iconCustomer ExperienceExperiences change the world. Deliver the best with our CX management software.WF iconEmployee ExperienceCreate the best employee experience and act on real-time data from end to end.
  • Solutions
    IndustriesGamingAutomotiveSports and eventsEducationGovernment
    Travel & HospitalityFinancial ServicesHealthcareCannabisTechnology
    Use CaseAskWhyCommunitiesAudienceContactless surveysMobile
    LivePollsMember ExperienceGDPRPositive People Science360 Feedback Surveys
  • Resources
    BlogeBooksSurvey TemplatesCase StudiesTrainingHelp center
  • Features
  • Pricing
Language
  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))
Call Us
+1 800 531 0228 +1 (647) 956-1242 +52 999 402 4079 +49 301 663 5782 +44 20 3650 3166 +81-3-6869-1954 +61 2 8074 5080 +971 529 852 540
Log In Log In
SIGN UP FREE

Home LivePolls Polls

With so Much Polling Discrepancy, Who has the Right Polling Methodology?

As the Presidential race draws to a close, there are numerous polls from diverse sources available to the public. However, there is a lot of polling discrepancy between many of the polls. Is Hillary up by 3 points in Florida or is Trump up by 2 points? Whose poll is right and whose is wrong? Like many questions in politics, it dependents.

Select your respondents

All political polls are based upon some assumptions about who is actually going to vote. This is called a model of the electorate. Having a correct or incorrect model will determine how accurately a poll will predict the outcome. Social scientists who argue for a pure random sample can really miss-predict an election, if they do not take into consideration data collection methodologies. One example is the recent U.S.C. Dornsife/Los Angeles Times Daybreak poll, which has been getting a lot of slack by pollsters, due to its outlying poll results. Some make the argument on how the data was weighted; others blame a 19 year-old Trump supporter for skewing the poll results. While those are both legitimate points and probably contributed to the skewed poll result, sample and data collection probably played an even more significant role in this issue.

Dr. Jim Kitchens, a research practitioner with over 30 years in political polling suggests that “ Weighting works as well as setting quotas, within a reasonable limit. If the sampling source (list, panel, etc.) is good, you should be close to your quotas and it may require some weighting.” In other words, weighting alone is not the issue, nor is that 19 year-old Trump supporter. By applying quotas in the sample, this would ensure that enough Republicans and Democrats were represented. Thus, minimizing the risk of working with a toxic sample.

The Romney campaign failed to call Ohio (the entire 2012 election for that matter) correctly because they were dependent upon telephone-based data collection. Even merging in cell phones, this methodology will skew a sample toward older voters, white voters, and Republicans. They assumed many of the younger voters and minority voters who supported President Obama in 2008 were not going to vote because they did not find them on the telephone. This was a mistaken assumption. However, if a pure random sample is taken from an Internet panel, it may skew the sample toward younger people. This, again, boils down to data collection and sample.

The key is to set quotas from two or three critical groups based upon past elections of a similar nature. The most critical factors for politics are party affiliation, race, age, and gender. According to Dr. Kitchens, “there are two ways to construct a model: (1) quotas during the data collection or (2) mathematical weighting based upon the assumed turnout. Either method is methodologically sound and will work.”

The problem for voting polls is that no one knows whose model is right until the election is over. Even Nate Silver, who is regarded as a God among pollsters now because he accurately predicted the winner in the 2012 Presidential election for every 50 states, including the District Of Colombia, has had his critics.

This year, several assumption pollsters have to consider include:

  • Will the minority voters turn out for Hillary Clinton at the sample level they turned out for Barack Obama?
  • Will Donald Trump be perceived in such a negative way by Republican women that they will either vote for Hillary Clinton or stay home?
  • With both candidates having a majority of voters view them unfavorably, will turnout among all voters decline? Low turnout usually means an older, more conservative electorate.
  • Will the outrage from Hispanic leaders toward Donald Trump actually drive a significant percentage of new Hispanic voters into the electorate?
  • Every poll has to be built upon the assumed correct answer to these questions. So, it will be election day before the argument about whose polls are correct can be answered.

Select your respondents

While we may not know whose opinion polls will be right or wrong until after the 2016 Presidential election, I’m sure Mitt Romney would agree with the following statement: Get your sample and data collection methodology right!

SHARE THIS ARTICLE:

About the author
Rudly Raphael
Rudly has more than 15 years of experience in the market research industry, implementing primary and secondary research for a number of high profile clients. He's a frequent blogger and has published a number of articles in various online journals, magazines, and other publications.
View all posts by Rudly Raphael

Primary Sidebar

Unlock the Power of Research with QuestionPro Audience

Gain insights from more than 22 million high-quality respondents around the globe

Get a Free Quote Now!

RELATED ARTICLES

HubSpot - QuestionPro Integration

Synthetic Monitoring: What It Is and How to Get Started?

Oct 06,2023

HubSpot - QuestionPro Integration

22 Most intriguing Christmas trivia questions to ask this Holiday season

Dec 20,2022

HubSpot - QuestionPro Integration

10 Benefits of Net Promoter Score and How to Maximize It

Oct 02,2023

BROWSE BY CATEGORY

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

Footer

MORE LIKE THIS

ken tcxt

Experience – What’s Included? | Tuesday CX Toughts

May 20, 2025

artificial-data

What is Artificial Data & How It’s Shaping Research

May 20, 2025

wells-fargo-nps-2025

Wells Fargo NPS 2025: What Businesses Can Learn

May 19, 2025

word-cloud

Word Cloud: What it is & How to Use QuestionPro Word Cloud?

May 16, 2025

Other categories

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

questionpro-logo-nw
Help center Live Chat SIGN UP FREE
  • Sample questions
  • Sample reports
  • Survey logic
  • Branding
  • Integrations
  • Professional services
  • Security
  • Survey Software
  • Customer Experience
  • Workforce
  • Communities
  • Audience
  • Polls Explore the QuestionPro Poll Software - The World's leading Online Poll Maker & Creator. Create online polls, distribute them using email and multiple other options and start analyzing poll results.
  • Research Edition
  • LivePolls
  • InsightsHub
  • Blog
  • Articles
  • eBooks
  • Survey Templates
  • Case Studies
  • Training
  • Webinars
  • All Plans
  • Nonprofit
  • Academic
  • Qualtrics Alternative Explore the list of features that QuestionPro has compared to Qualtrics and learn how you can get more, for less.
  • SurveyMonkey Alternative
  • VisionCritical Alternative
  • Medallia Alternative
  • Likert Scale Complete Likert Scale Questions, Examples and Surveys for 5, 7 and 9 point scales. Learn everything about Likert Scale with corresponding example for each question and survey demonstrations.
  • Conjoint Analysis
  • Net Promoter Score (NPS) Learn everything about Net Promoter Score (NPS) and the Net Promoter Question. Get a clear view on the universal Net Promoter Score Formula, how to undertake Net Promoter Score Calculation followed by a simple Net Promoter Score Example.
  • Offline Surveys
  • Customer Satisfaction Surveys
  • Employee Survey Software Employee survey software & tool to create, send and analyze employee surveys. Get real-time analysis for employee satisfaction, engagement, work culture and map your employee experience from onboarding to exit!
  • Market Research Survey Software Real-time, automated and advanced market research survey software & tool to create surveys, collect data and analyze results for actionable market insights.
  • GDPR & EU Compliance
  • Employee Experience
  • Customer Journey
  • Synthetic Data
  • About us
  • Executive Team
  • In the news
  • Testimonials
  • Advisory Board
  • Careers
  • Brand
  • Media Kit
  • Contact Us

QuestionPro in your language

  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))

Awards & certificates

  • survey-leader-asia-leader-2023
  • survey-leader-asiapacific-leader-2023
  • survey-leader-enterprise-leader-2023
  • survey-leader-europe-leader-2023
  • survey-leader-latinamerica-leader-2023
  • survey-leader-leader-2023
  • survey-leader-middleeast-leader-2023
  • survey-leader-mid-market-leader-2023
  • survey-leader-small-business-leader-2023
  • survey-leader-unitedkingdom-leader-2023
  • survey-momentumleader-leader-2023
  • bbb-acredited
The Experience Journal

Find innovative ideas about Experience Management from the experts

  • © 2022 QuestionPro Survey Software | +1 (800) 531 0228
  • Sitemap
  • Privacy Statement
  • Terms of Use