• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
QuestionPro

QuestionPro

questionpro logo
  • Products
    survey software iconSurvey softwareEasy to use and accessible for everyone. Design, send and analyze online surveys.research edition iconResearch SuiteA suite of enterprise-grade research tools for market research professionals.CX iconCustomer ExperienceExperiences change the world. Deliver the best with our CX management software.WF iconEmployee ExperienceCreate the best employee experience and act on real-time data from end to end.
  • Solutions
    IndustriesGamingAutomotiveSports and eventsEducationGovernment
    Travel & HospitalityFinancial ServicesHealthcareCannabisTechnology
    Use CaseAskWhyCommunitiesAudienceContactless surveysMobile
    LivePollsMember ExperienceGDPRPositive People Science360 Feedback Surveys
  • Resources
    BlogeBooksSurvey TemplatesCase StudiesTrainingHelp center
  • Features
  • Pricing
Language
  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))
Call Us
+1 800 531 0228 +1 (647) 956-1242 +52 999 402 4079 +49 301 663 5782 +44 20 3650 3166 +81-3-6869-1954 +61 2 8074 5080 +971 529 852 540
Log In Log In
SIGN UP FREE

Home Audience

Trends in online panel data quality 2022

online data quality trends

High data quality is vital for the success of any market research project. We know that everybody has a different approach to measuring bad data quality. While some may purely focus on completing the interview, others concentrate on answer patterns and attention checks. Nevertheless, using a single method is never enough.

Over the years, there has been a shift in how survey data is collected, and online panelists have given rise to panel fraudsters. These fraudsters have evolved, but panel companies have found new ways to arrest unhealthy responses. Panel providers are at constant war with cheaters, speeders, and bots, and both parties find ways to outsmart each other all the time.

Select your respondents

Trends that will improve online panel data quality in 2022

Combating bogus respondents and responses is a crucial step to maintaining the integrity of online panel providers. Various methods to spot such respondents are identified and continuously developed, but applying a mix brings out the best results. Let’s look at the different techniques used to eliminate bad respondents and improve panel health and data panel data quality.

Catching fraudsters in the act

One effective method of identifying genuine panelists from the fakes is by asking them a question or a series of questions that are impossible to answer. For example, you can ask the question – Can you name the pet dogs of every NFL player that has ever played? Yes/No. Respondents that answer ‘Yes’ are very likely the fake ones. 

Identifying skimmers

Those who answer surveys purely for monetary benefit will not read questions and other texts attentively. Identifying and eliminating them has already become standard practice in many research areas. For example, we asked respondents to read a paragraph and answer questions in a survey. The text contained 152 words, which approximately takes 35 seconds to read. Unfortunately, 28% of respondents clicked through the section in under 10 seconds; some even clicked through under five seconds.

Tracking speeders

Speeders, too, like skimmers, select options at random and complete the survey within minutes. A 10-minute survey is completed in considerably less time than usual. We can identify how long the respondent has stayed on each page to answer multiple questions or look at the total time to complete the survey. The ones flagged can automatically or manually be taken off.

Straight-liners

Straight-liners are the ones that blindly select the same answer option for every question. They can be identified when choosing identical or near similar answer choices. This pattern can be easily recognized and flagged for elimination. 

Attention Checks

There are multiple questions to use when it comes to checking respondents’ attention. Usually, attention check questions have obvious correct answers and are embedded data at the beginning of the survey. These questions help identify careless panel respondents initially and help distinguish the high-quality responses from the low-quality, unreliable ones. Red herring and data manipulation checks, too, are good indicators of inadequate responses.

Select your respondents

Panel data quality with QuestionPro Audience

QuestionPro offers the highest quality survey panels. We screen millions of online panelists and ensure that all profile data points are updated. Controlling the quality of panelists ensures that unhealthy respondents are eliminated before they enter the project. We also have the mechanisms above to arrest survey fraud and provide our customers with the highest quality data. Try QuestionPro Audience for a hassle-free data collection experience.

SHARE THIS ARTICLE:

About the author
Dan Fleetwood
President of Research and Insights at QuestionPro, a leader in web-based research technologies, with over 15 years of market research experience.
View all posts by Dan Fleetwood

Primary Sidebar

Unlock the Power of Research with QuestionPro Audience

Gain insights from more than 22 million high-quality respondents around the globe

Get a Free Quote Now!

RELATED ARTICLES

HubSpot - QuestionPro Integration

Customer Repurchase Intention: What Is It & How to Boost It?

Mar 11,2025

HubSpot - QuestionPro Integration

User Journey vs User Flow: Differences and Similarities

Apr 26,2024

HubSpot - QuestionPro Integration

Synthetic Users: What They Are & How to Use Them in Your Research

Oct 16,2023

BROWSE BY CATEGORY

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

Footer

MORE LIKE THIS

Credit-Unions-NPS-2025

Credit Unions NPS Leading in Loyalty in 2025

May 21, 2025

ken tcxt

Experience – What’s Included? | Tuesday CX Toughts

May 20, 2025

artificial-data

What is Artificial Data & How It’s Shaping Research

May 20, 2025

wells-fargo-nps-2025

Wells Fargo NPS 2025: What Businesses Can Learn

May 19, 2025

Other categories

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

questionpro-logo-nw
Help center Live Chat SIGN UP FREE
  • Sample questions
  • Sample reports
  • Survey logic
  • Branding
  • Integrations
  • Professional services
  • Security
  • Survey Software
  • Customer Experience
  • Workforce
  • Communities
  • Audience
  • Polls Explore the QuestionPro Poll Software - The World's leading Online Poll Maker & Creator. Create online polls, distribute them using email and multiple other options and start analyzing poll results.
  • Research Edition
  • LivePolls
  • InsightsHub
  • Blog
  • Articles
  • eBooks
  • Survey Templates
  • Case Studies
  • Training
  • Webinars
  • All Plans
  • Nonprofit
  • Academic
  • Qualtrics Alternative Explore the list of features that QuestionPro has compared to Qualtrics and learn how you can get more, for less.
  • SurveyMonkey Alternative
  • VisionCritical Alternative
  • Medallia Alternative
  • Likert Scale Complete Likert Scale Questions, Examples and Surveys for 5, 7 and 9 point scales. Learn everything about Likert Scale with corresponding example for each question and survey demonstrations.
  • Conjoint Analysis
  • Net Promoter Score (NPS) Learn everything about Net Promoter Score (NPS) and the Net Promoter Question. Get a clear view on the universal Net Promoter Score Formula, how to undertake Net Promoter Score Calculation followed by a simple Net Promoter Score Example.
  • Offline Surveys
  • Customer Satisfaction Surveys
  • Employee Survey Software Employee survey software & tool to create, send and analyze employee surveys. Get real-time analysis for employee satisfaction, engagement, work culture and map your employee experience from onboarding to exit!
  • Market Research Survey Software Real-time, automated and advanced market research survey software & tool to create surveys, collect data and analyze results for actionable market insights.
  • GDPR & EU Compliance
  • Employee Experience
  • Customer Journey
  • Synthetic Data
  • About us
  • Executive Team
  • In the news
  • Testimonials
  • Advisory Board
  • Careers
  • Brand
  • Media Kit
  • Contact Us

QuestionPro in your language

  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))

Awards & certificates

  • survey-leader-asia-leader-2023
  • survey-leader-asiapacific-leader-2023
  • survey-leader-enterprise-leader-2023
  • survey-leader-europe-leader-2023
  • survey-leader-latinamerica-leader-2023
  • survey-leader-leader-2023
  • survey-leader-middleeast-leader-2023
  • survey-leader-mid-market-leader-2023
  • survey-leader-small-business-leader-2023
  • survey-leader-unitedkingdom-leader-2023
  • survey-momentumleader-leader-2023
  • bbb-acredited
The Experience Journal

Find innovative ideas about Experience Management from the experts

  • © 2022 QuestionPro Survey Software | +1 (800) 531 0228
  • Sitemap
  • Privacy Statement
  • Terms of Use