• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
QuestionPro

QuestionPro

questionpro logo
  • Products
    survey software iconSurvey softwareEasy to use and accessible for everyone. Design, send and analyze online surveys.research edition iconResearch SuiteA suite of enterprise-grade research tools for market research professionals.CX iconCustomer ExperienceExperiences change the world. Deliver the best with our CX management software.WF iconEmployee ExperienceCreate the best employee experience and act on real-time data from end to end.
  • Solutions
    IndustriesGamingAutomotiveSports and eventsEducationGovernment
    Travel & HospitalityFinancial ServicesHealthcareCannabisTechnology
    Use CaseAskWhyCommunitiesAudienceContactless surveysMobile
    LivePollsMember ExperienceGDPRPositive People Science360 Feedback Surveys
  • Resources
    BlogeBooksSurvey TemplatesCase StudiesTrainingHelp center
  • Features
  • Pricing
Language
  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))
Call Us
+1 800 531 0228 +1 (647) 956-1242 +52 999 402 4079 +49 301 663 5782 +44 20 3650 3166 +81-3-6869-1954 +61 2 8074 5080 +971 529 852 540
Log In Log In
SIGN UP FREE

Home CX Customer Satisfaction

Where Should I Put that “Overall” question? — Question order bias

Sample Bias

Seriously, where?

We’ve talked in the past about what questions you might want to consider including in your surveys. We’ve told you about things to avoid when putting together customer feedback surveys. And we’ve discussed some biases that can be involved when employees administer a customer satisfaction survey incorrectly.

With this post, we’re going to dive into one of many oft-discussed market research questions: Where should the “overall” question go in a survey? Should it be first or last? This question applies to a wide variety of survey subjects: customer satisfaction, employee engagement, product evaluation, event evaluation, website design evaluation…just about any survey on any subject eventually seems to include some type of summary, overall rating question.

To give you an idea of how long this item has been researched, I found an article from 1975 in  The Public Opinion Quarterly, a journal published by the American Association for Public Opinion Research. This article referred to research conducted in 1959 on the topic of “Questionnaire Construction and Interview Procedure.” In 55 years, the answer hasn’t really changed: how you order your questions depends on what you want to get from the respondent.

Create memorable experiences based on real-time data, insights and advanced analysis. Request Demo

The argument for placing it first

Putting the overall question first does a few things. First, according to the research, it can actually act as an anchor by which a respondent answers the rest of the questions. So, if we ask an overall question first and get that knee-jerk reaction from a respondent that might be given if asked about their experience by a friend, as they take the rest of the survey, they tend to adjust their following answers to match the answer to the overall question. This is great for the researcher if the answer to that overall question is positive; this isn’t great if that answer is negative.

When should you put the overall question first? When you want to know how your audience would be answering their friends or colleagues when asked about their experience.

LEARN ABOUT: This or that questions

The argument for placing it last

So, what about putting the overall question last? According to another research article from 2003, “Order Effects in Customer Satisfaction Modelling,” from the Journal of Marketing Management, “…customers’ overall evaluations are more extreme and better explained when provided after attribute evaluations.” By asking the specifics before asking the overall question, respondents will be thinking more about how the specifics add up to their overall level of satisfaction. Arguably, this could mean they are giving a more thought-out answer to that overall question.

When should you put the overall question last? When you want your audience to remember various aspects of their experience and give a more thoughtful response. You may also want to consider placing it last if your respondents will be answering while after the experience you’re asking them about. That way, you can remind them of the particulars about the experience before asking them to give their overall impression.

Looking to start a survey? Check out these free customer loss survey template

It’s all about strategy

Still not sure where to put that overall question? Why not place it both at the beginning, and then at the end? That way, you’re capturing both the initial impression and the impression they are left with after reminding them of the particulars.

What have been your experiences with where you’ve placed the overall question? Do you tend to place it more at the beginning or at the end of your survey? Have you tried changing where you placed it, or how you worded the question, to see if it affected results?

Looking to deliver exceptional customer experience? Discover more about how to delight your customer at every touchpoint and turn them into brand advocates.

Learn more about QuestionPro CX

SHARE THIS ARTICLE:

About the author
Zontziry (Z) Johnson

View all posts by Zontziry (Z) Johnson

Primary Sidebar

Research what's on your mind. Find out what's on theirs!

A suite of tools to leverage research and transform insights.

Discover our insight platform

RELATED ARTICLES

HubSpot - QuestionPro Integration

Usability Problems: What Is It, Common Issues, and Solutions

Oct 24,2023

HubSpot - QuestionPro Integration

Emotional Scoring: Revolutionizing Business Insights

Dec 08,2023

HubSpot - QuestionPro Integration

Remote User Research: What is it, How to do it, Pros & Cons

Mar 16,2023

BROWSE BY CATEGORY

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

Footer

MORE LIKE THIS

data-augmentation

What is Data Augmentation? Methods & Uses in Research

May 22, 2025

livecast a new way to do research

Here’s how LiveCast can help you survive the great Stanley Cup debate of 2025

May 22, 2025

Credit-Unions-NPS-2025

Credit Unions NPS Leading in Loyalty in 2025

May 21, 2025

ken tcxt

Experience – What’s Included? | Tuesday CX Toughts

May 20, 2025

Other categories

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

questionpro-logo-nw
Help center Live Chat SIGN UP FREE
  • Sample questions
  • Sample reports
  • Survey logic
  • Branding
  • Integrations
  • Professional services
  • Security
  • Survey Software
  • Customer Experience
  • Workforce
  • Communities
  • Audience
  • Polls Explore the QuestionPro Poll Software - The World's leading Online Poll Maker & Creator. Create online polls, distribute them using email and multiple other options and start analyzing poll results.
  • Research Edition
  • LivePolls
  • InsightsHub
  • Blog
  • Articles
  • eBooks
  • Survey Templates
  • Case Studies
  • Training
  • Webinars
  • All Plans
  • Nonprofit
  • Academic
  • Qualtrics Alternative Explore the list of features that QuestionPro has compared to Qualtrics and learn how you can get more, for less.
  • SurveyMonkey Alternative
  • VisionCritical Alternative
  • Medallia Alternative
  • Likert Scale Complete Likert Scale Questions, Examples and Surveys for 5, 7 and 9 point scales. Learn everything about Likert Scale with corresponding example for each question and survey demonstrations.
  • Conjoint Analysis
  • Net Promoter Score (NPS) Learn everything about Net Promoter Score (NPS) and the Net Promoter Question. Get a clear view on the universal Net Promoter Score Formula, how to undertake Net Promoter Score Calculation followed by a simple Net Promoter Score Example.
  • Offline Surveys
  • Customer Satisfaction Surveys
  • Employee Survey Software Employee survey software & tool to create, send and analyze employee surveys. Get real-time analysis for employee satisfaction, engagement, work culture and map your employee experience from onboarding to exit!
  • Market Research Survey Software Real-time, automated and advanced market research survey software & tool to create surveys, collect data and analyze results for actionable market insights.
  • GDPR & EU Compliance
  • Employee Experience
  • Customer Journey
  • Synthetic Data
  • About us
  • Executive Team
  • In the news
  • Testimonials
  • Advisory Board
  • Careers
  • Brand
  • Media Kit
  • Contact Us

QuestionPro in your language

  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))

Awards & certificates

  • survey-leader-asia-leader-2023
  • survey-leader-asiapacific-leader-2023
  • survey-leader-enterprise-leader-2023
  • survey-leader-europe-leader-2023
  • survey-leader-latinamerica-leader-2023
  • survey-leader-leader-2023
  • survey-leader-middleeast-leader-2023
  • survey-leader-mid-market-leader-2023
  • survey-leader-small-business-leader-2023
  • survey-leader-unitedkingdom-leader-2023
  • survey-momentumleader-leader-2023
  • bbb-acredited
The Experience Journal

Find innovative ideas about Experience Management from the experts

  • © 2022 QuestionPro Survey Software | +1 (800) 531 0228
  • Sitemap
  • Privacy Statement
  • Terms of Use