• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
QuestionPro

QuestionPro

questionpro logo
  • Products
    survey software iconSurvey softwareOur flagship survey solution. Sophisticated tools to get the answers you need.research edition iconResearch SuiteTuned for researchers. Get more insights. Response based pricing.CX iconCXExperiences change the world. Deliver the best with our CX management software.WF iconWorkforceEmpower your work leaders, make informed decisions and drive employee engagement.
  • Solutions
    IndustriesGamingAutomotiveSports and eventsEducationGovernment
    Travel & HospitalityFinancial ServicesHealthcareCannabisTechnology
    Use CaseNPS+CommunitiesAudienceContactless surveysMobile
    LivePollsMember ExperienceGDPRPositive People Science360 Feedback Surveys
  • Resources
    BlogeBooksSurvey TemplatesCase StudiesTrainingHelp center
  • Features
  • Pricing
Language
  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
Call Us
+1 800 531 0228 +1 (647) 956-1242 +52 999 402 4079 +49 301 663 5782 +44 20 3650 3166 +81-3-6869-1954 +61 2 8074 5080 +971 529 852 540
Log In Log In
SIGN UP FREE

Home Market Research

Using Open Ended Question and Close Ended Questions in Surveys

When designing surveys, we often need to decide whether to use an open ended question versus close ended questions to get specific information. Yet we need to be aware of the fact that open ended question and close ended questions each have their own strengths and weaknesses and perform in different ways.

In a study conducted by the Pew Research in their November 2008 post-election survey, respondents were asked, “What one issue mattered most to you in deciding how you voted for president?” One group was asked this question in a close ended questions format while the other group was asked this question in an open ended question format. The results are displayed below:

2016-04-15_1608

In the close ended questions format, 58% of respondents chose “The economy,” while in the open-ended format only 35% wrote in a response that indicated “The economy.” Note also that in the close ended questions format, only 8% of respondents selected “Other,” while in the open-ended format 43% of respondents wrote in a response that would have been categorized as “Other.”

Open Ended Question and Close Ended QuestionsUsing Open Versus Closed-Ended Questions in Surveys

1. The open ended question and close ended questions are different tasks for respondents. In the open-ended task, respondents write down what is readily available in their minds, whereas in the close ended questions task we have respondents focus their “attention on specific responses chosen by the investigator,” (Converse and Presser, 1986).

2. Asking the same question in these two different formats will almost always produce different results. Many investigators have demonstrated this over several decades.

3. Few respondents are going to select the “Other” category and write in responses that are different than the answer choices that are listed.

So what does this mean for us? If you can, do qualitative research first and make sure your close ended questions represent the items that are in people’s heads. We need the list of items to be complete since few respondents will select the “Other” category. It may also be necessary to list items that are not readily available to respondents if those items are important to you. I will discuss this further in my next blog post.

Consider doing split sample studies where half of the respondents see the question in the open-ended format while the other half sees the question in the close ended questions format.

When presenting results, I have found it helpful to explain to the audience, in a sentence or two, the fundamental differences between open ended question and close ended questions. This helps them understand that these are not necessarily precise measurements, but measurements that require some interpretation relative to other questions in the survey and other information from qualitative research. Hence, that is why they need an analyst like you or me!

The differences in the performance and appropriate use of open ended question and close ended questions are an enormous topic. I will follow up with more discussion in my next few blog posts.

* Converse, Jean M., and Stanley Presser. 1986. Survey Questions: Handcrafting the Standardized Questionnaire, Beverly Hills, CA: Sage.

David F. Harris designs qualitative and quantitative research for companies that want better information for decision-making. He also conducts state-of-the-art training on questionnaire design. He is the author of, The Complete Guide to Writing Questionnaires: How to Get Better Information for Better Decisions, 2014. He received his B.A. from Reed College, in Portland, Oregon, and his M.A. in Quantitative Psychology from the L. L. Thurstone Psychometric Laboratory at the University of North Carolina at Chapel Hill.

SHARE THIS ARTICLE:

About the author
Santa Rimsevica
View all posts by Santa Rimsevica

Primary Sidebar

Gain insights with 80+ features for free

Create, Send and Analyze Your Online Survey in under 5 mins!

Create a Free Account

RELATED ARTICLES

HubSpot - QuestionPro Integration

Customer Empathy: What It Is, Importance & How to Build

Oct 10,2022

HubSpot - QuestionPro Integration

CX Tuesday Recap | Spring XDay 2022 NAM

Jun 09,2022

HubSpot - QuestionPro Integration

Your Brand Promise

May 03,2021

BROWSE BY CATEGORY

  • Academic
  • Academic Research
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Brand Awareness
  • Branding
  • Business
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Experience IN
  • Customer Loyalty
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • Customer Satisfaction
  • CX
  • Decision Making
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Employee Retention
  • Employee Retention
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Intercept
  • klantervaring
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Market Research
  • Marketing
  • Marketing
  • Marktonderzoek
  • medewerkersonderzoek
  • Mercadotecnia
  • Mobile
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • QuestionPro Products
  • Release Notes
  • Research
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Surveys
  • Tech News
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Uncategorized
  • Video Learning Series
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce
  • Workforce
  • Workforce
  • Workforce Intelligence
  • Workforce Intelligence
  • Workforce Intelligence

Footer

MORE LIKE THIS

A positive work environment improves employee morale, retention, and productivity. It helps making a workplace better for everyone.

Work Environment: What it is, Types & Elements to Create it

Mar 23, 2023

People science is an approach to market research that goes beyond traditional methods to understand the people behind the data.

People Science: What it Means for the Workforce

Mar 22, 2023

Let's learn the importance of personalization in a successful customer experience program from my recent ski trip experience.

Ski Days and CX: Defining Fun For Everyone — Tuesday CX Thoughts

Mar 21, 2023

Adaptive conjoint analysis is a market research method that adapts to each person's answers to determine which product features are liked.

Adaptive Conjoint Analysis: What is it, Types & User Cases

Mar 19, 2023

Other categories

  • Academic
  • Academic Research
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Brand Awareness
  • Branding
  • Business
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Experience IN
  • Customer Loyalty
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • Customer Satisfaction
  • CX
  • Decision Making
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Employee Retention
  • Employee Retention
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Intercept
  • klantervaring
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Market Research
  • Marketing
  • Marketing
  • Marktonderzoek
  • medewerkersonderzoek
  • Mercadotecnia
  • Mobile
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • QuestionPro Products
  • Release Notes
  • Research
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Surveys
  • Tech News
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Uncategorized
  • Video Learning Series
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce
  • Workforce
  • Workforce
  • Workforce Intelligence
  • Workforce Intelligence
  • Workforce Intelligence

questionpro-logo-nw
Help center Live Chat SIGN UP FREE
  • Sample questions
  • Sample reports
  • Survey logic
  • Branding
  • Integrations
  • Professional services
  • Security
  • Survey Software
  • Customer Experience
  • Workforce
  • Communities
  • Audience
  • Polls Explore the QuestionPro Poll Software - The World's leading Online Poll Maker & Creator. Create online polls, distribute them using email and multiple other options and start analyzing poll results.
  • Research Edition
  • LivePolls
  • InsightsHub
  • Blog
  • Articles
  • eBooks
  • Survey Templates
  • Case Studies
  • Training
  • Webinars
  • Coronavirus Resources
  • All Plans
  • Nonprofit
  • Academic
  • Qualtrics Alternative Explore the list of features that QuestionPro has compared to Qualtrics and learn how you can get more, for less.
  • SurveyMonkey Alternative
  • VisionCritical Alternative
  • Medallia Alternative
  • Likert Scale Complete Likert Scale Questions, Examples and Surveys for 5, 7 and 9 point scales. Learn everything about Likert Scale with corresponding example for each question and survey demonstrations.
  • Conjoint Analysis
  • Net Promoter Score (NPS) Learn everything about Net Promoter Score (NPS) and the Net Promoter Question. Get a clear view on the universal Net Promoter Score Formula, how to undertake Net Promoter Score Calculation followed by a simple Net Promoter Score Example.
  • Offline Surveys
  • Customer Satisfaction Surveys
  • Employee Survey Software Employee survey software & tool to create, send and analyze employee surveys. Get real-time analysis for employee satisfaction, engagement, work culture and map your employee experience from onboarding to exit!
  • Market Research Survey Software Real-time, automated and advanced market research survey software & tool to create surveys, collect data and analyze results for actionable market insights.
  • GDPR & EU Compliance
  • Employee Experience
  • Customer Journey
  • About us
  • Executive Team
  • In the news
  • Testimonials
  • Advisory Board
  • Careers
  • Brand
  • Media Kit
  • Contact Us

QuestionPro in your language

  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)

Awards & certificates

  • survey-leader-asia-leader-2023
  • survey-leader-asiapacific-leader-2023
  • survey-leader-enterprise-leader-2023
  • survey-leader-europe-leader-2023
  • survey-leader-latinamerica-leader-2023
  • survey-leader-leader-2023
  • survey-leader-middleeast-leader-2023
  • survey-leader-mid-market-leader-2023
  • survey-leader-small-business-leader-2023
  • survey-leader-unitedkingdom-leader-2023
  • survey-momentumleader-leader-2023
  • bbb-acredited
The Experience Journal

Find innovative ideas about Experience Management from the experts

  • © 2022 QuestionPro Survey Software | +1 (800) 531 0228
  • Sitemap
  • Privacy Statement
  • Terms of Use