• Skip to main content
  • Skip to primary sidebar
  • Skip to footer
QuestionPro

QuestionPro

questionpro logo
  • Products
    survey software iconSurvey softwareEasy to use and accessible for everyone. Design, send and analyze online surveys.research edition iconResearch SuiteA suite of enterprise-grade research tools for market research professionals.CX iconCustomer ExperienceExperiences change the world. Deliver the best with our CX management software.WF iconEmployee ExperienceCreate the best employee experience and act on real-time data from end to end.
  • Solutions
    IndustriesGamingAutomotiveSports and eventsEducationGovernment
    Travel & HospitalityFinancial ServicesHealthcareCannabisTechnology
    Use CaseAskWhyCommunitiesAudienceContactless surveysMobile
    LivePollsMember ExperienceGDPRPositive People Science360 Feedback Surveys
  • Resources
    BlogeBooksSurvey TemplatesCase StudiesTrainingHelp center
  • Features
  • Pricing
Language
  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))
Call Us
+1 800 531 0228 +1 (647) 956-1242 +52 999 402 4079 +49 301 663 5782 +44 20 3650 3166 +81-3-6869-1954 +61 2 8074 5080 +971 529 852 540
Log In Log In
SIGN UP FREE

Home Market Research

Long Surveys are here to stay – Its the economy stupid!

It’s become fashionable to say – “researchers who administer long surveys have their head up their you know what” — Hell, I’ve said it in the past. The Future of Insight blog predicts that it’s definitely NOT part of the future. Sandra Rathod and Andrea la Bruna concluded in 2004 (Yes that is 6 Years ago) – that respondents “check out” after 15-20 mins. Our buddies from Survey Sampling say that again a couple of months ago.

LEARN ABOUT: Survey Mistakes And How to Avoid

So, I thought WHAT IS THE DEAL here. Two questions –

a) Are we still administering long surveys?
b) If so – why?

As it turns out, I actually have access to some real data. As part of the group of services and companies I am a part of, we cumulatively conduct about 2 million surveys a month across thousands of clients. So, I thought, I’d mine the data for some insight into how long are the surveys exactly.

In March, we conducted 1.96 Million surveys. Median Question Length: 35.

Now, lets think about it – In the age of 140 Character Tweets, we are asking 2 million users to fill out a 35 question survey?

Now – lets think about some of the reasons. From our vantage point, there are 4 audiences for surveys:

a) Market Research
b) Customer Satisfaction
c) Public Opinion / Social Science Research
e) Employee Satisfaction

Of the 4 broad categories, Market Research has traditionally been the culprit. We know, Customer Satisfaction has pretty much undergone the transformation from overtly long surveys to “One Question” – aka Net Promoter Score – so the issue of long-running Customer Sat surveys are our of the question. Even if you are not using Net Promoter, most companies I know use a variant of the Net Promoter — Secure Customer Index, or ACSI Index — all of which are very short – 3 questions max.
I also happen to know empirically that public opinion, social science research and employee sat. studies account for less than 20% of our customer base – so – in effect they are a non-participant here — at least in no significant way.

This leads us to Market Research. Traditional Market Research consists of 4 players in the value chain:

a) Client – Pays the bills. Has the problem. Has a checkbook. Think – BP, P&G etc.
b) MR Agency – Big agencies traditionally outsource parts of the work to smaller ones. Think GFK, Kantar, IPSOS and then over 14,000 smaller MR firms that service them.
b) Sample Provider — Provides the list of participants to the survey. SSI, e-Rewards, PeanutLabs etc.
d) Technology Providers / Data Collector  – QuestionPro, SurveyMonkey, Zoomerang, Survey Analytics, Vovici, Confirmit etc.

So – let’s think about this purely from one axis – Length of the Survey.

Client:
Market Research studies generally have budget on a temporal basis – they can do X projects in a year and have budgeted for that. So, its natural to cram as many questions into each project – natural bloat. There is no significant cost differential between running a 20 question survey vs. a 40 question survey vs. an 80 question survey. The incremental cost are not 2x or 4x.

MR Agency / Sub Agency / Consultant:
Typically – there is a base cost for conducting research – then MR agencies, as with most service oriented businesses, are fundamentally dependent on time. Everyone knows the agency business ultimately is an arbitrage – Pay X and charge Y – for time. The more complicated and lengthy a project it – its better for business. Duh! – So there is no compelling reason for any agency to try and shorten the size of the study – unless they felt the study was too large for success. So, in effect there is absolutely no financially compelling reason why ANY MR Agency would advise a client to shorten the study, break the study into multiple parts. It would have the direct effect of simply reduce their billings.

Sample Provider:
OK – this entity in the value chain is probably hurt the most – however, since all panel providers are priced based on the length of the survey, they are (in theory) covered. The two axis that determine price for any sample provider is a) incidence — what kind of respondents are you looking for, and b) completion rates — directly a function of survey length. I have talked in great length to many sample providers on how much they HATE long surveys and non-interactive surveys. I understand — this is core to their business. They are about the only entity that actually cares about the respondent. However keep in mind, that relationship is not a typical Vendor-Client relationship.  Lost revenue on incorrectly priced projects as well as the bad taste that respondents have, vis-a-vis  the panel provider, are compelling enough reasons for most panel providers to hate studies that are long. However, since they have factored in time – this should be reflected in price they quote. But then competition kicks in and we all have to do what we need to do to get a deal done!

Technology Providers / Data Collector:
I obviously can attest to this part personally. Frankly, we don’t really care. The cost of storing more data (more questions) is insignificant. When we started our business, it used to matter. But once you achieve scale, it really does not matter. So, technically we are ambivalent to this — from a pure economic standpoint – it does not cost us much more to run a 30 question survey vs. a 10 question survey. Since it does not cost us (or for that matter any other technology service provider) more, we are not at a position to charge more. So, in effect we are enabling this phenomenon. I’ll admit to that. I know some tech. providers and in some of our own services, we charge on a per completed response basis – again – this has absolutely no effect on the number of questions/length of the survey.

So, when we net it out, there is actually no one who actually, from a strict economic standpoint, cares about the length of the survey. It does not even scale linearly — in fact if you model it out, its usually exponentially inverse. Its cheaper to run longer surveys (on a per question basis.)

Customer Sat. studies used to be overly long and terrifying – until Bain, McKinsey and BCG told all the CEO’s of the world that the only thing they should care about is the single question on “How likely are you to recommend?” – Will Kantar, IPSOS post a “You shall not ask more than 20 questions at a time” rule? I doubt it. Long surveys are here to stay – and we all like it – that is unless someone asks us to take one!

SHARE THIS ARTICLE:

About the author
Vivek Bhaskaran
Vivek Bhaskaran is the founding member and executive chairman of QuestionPro, one of the industry's leading providers of web-based research technologies.
View all posts by Vivek Bhaskaran

Reader Interactions

Trackbacks

  1. What Type of Survey is Best? « QuestionPro Blog says:
    Apr 12, 2010 at 8:00 am

    […] Long Surveys are here to stay – Its the economy stupid! (questionpro.com) 41.138388 -81.863747 […]

  2. What Type of Survey is Best? « SurveyAnalytics Blog says:
    Apr 12, 2010 at 8:04 am

    […] Long Surveys are here to stay – Its the economy stupid! (questionpro.com) Possibly related posts: (automatically generated)Q & A from 10-Point Checklist for Questionnaire Design Webinar held April …Secure and Control Access to Your Survey DataSurvey Analytics: Weighting and BalancingThe following table shows the proportion who answered “a… 41.138388 -81.863747 […]

  3. Top 10 Articles on QuestionPro Blog for 2010 | QuestionPro Blog says:
    Dec 27, 2010 at 10:49 am

    […] Long Surveys are here to stay – Its the economy stupid! – April 7, 2010 […]

  4. Report Scheduler | QuestionPro Blog says:
    Nov 16, 2012 at 8:42 am

    […] and automated interface to email you reports on a periodic basis. Typically this is used in a long running survey (transactional surveys) where you have a continuous data collection stream On one hand you have […]

Primary Sidebar

Research what's on your mind. Find out what's on theirs!

A suite of tools to leverage research and transform insights.

Discover our insight platform

RELATED ARTICLES

HubSpot - QuestionPro Integration

First Call Resolution: What it is & How to Improve It

Oct 23,2022

HubSpot - QuestionPro Integration

United Airlines Customer Experience Actions and Strategies

Aug 05,2023

HubSpot - QuestionPro Integration

Sports Survey Questions: What it is, Importance + Examples

May 10,2023

BROWSE BY CATEGORY

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

Footer

MORE LIKE THIS

albertsons-companies-nps-2025

Albertsons Companies NPS and Insights in 2025

May 23, 2025

data-augmentation

What is Data Augmentation? Methods & Uses in Research

May 22, 2025

livecast a new way to do research

Here’s how LiveCast can help you survive the great Stanley Cup debate of 2025

May 22, 2025

Credit-Unions-NPS-2025

Credit Unions NPS Leading in Loyalty in 2025

May 21, 2025

Other categories

  • Academic
  • Academic Research
  • Artificial Intelligence
  • Assessments
  • Audience
  • Brand Awareness
  • Business
  • Case Studies
  • Communities
  • Consumer Insights
  • Customer effort score
  • Customer Engagement
  • Customer Experience
  • Customer Loyalty
  • Customer Research
  • Customer Satisfaction
  • CX
  • Employee Benefits
  • Employee Engagement
  • Employee Engagement
  • Employee Retention
  • Enterprise
  • Events
  • Forms
  • Friday Five
  • General Data Protection Regulation
  • Guest Post
  • Insights Hub
  • Life@QuestionPro
  • LivePolls
  • Market Research
  • Marketing
  • Mobile
  • Mobile App
  • Mobile diaries
  • Mobile Surveys
  • New Features
  • non-profit
  • NPS
  • Online Communities
  • Polls
  • Question Types
  • Questionnaire
  • QuestionPro
  • QuestionPro Products
  • Release Notes
  • Research Tools and Apps
  • Revenue at Risk
  • Startups
  • Survey Templates
  • Surveys
  • Tech News
  • Tips
  • Training
  • Training Tips
  • Trending
  • Tuesday CX Thoughts (TCXT)
  • Uncategorized
  • VOC
  • Webinar
  • Webinars
  • What’s Coming Up
  • Workforce
  • Workforce Intelligence

questionpro-logo-nw
Help center Live Chat SIGN UP FREE
  • Sample questions
  • Sample reports
  • Survey logic
  • Branding
  • Integrations
  • Professional services
  • Security
  • Survey Software
  • Customer Experience
  • Workforce
  • Communities
  • Audience
  • Polls Explore the QuestionPro Poll Software - The World's leading Online Poll Maker & Creator. Create online polls, distribute them using email and multiple other options and start analyzing poll results.
  • Research Edition
  • LivePolls
  • InsightsHub
  • Blog
  • Articles
  • eBooks
  • Survey Templates
  • Case Studies
  • Training
  • Webinars
  • All Plans
  • Nonprofit
  • Academic
  • Qualtrics Alternative Explore the list of features that QuestionPro has compared to Qualtrics and learn how you can get more, for less.
  • SurveyMonkey Alternative
  • VisionCritical Alternative
  • Medallia Alternative
  • Likert Scale Complete Likert Scale Questions, Examples and Surveys for 5, 7 and 9 point scales. Learn everything about Likert Scale with corresponding example for each question and survey demonstrations.
  • Conjoint Analysis
  • Net Promoter Score (NPS) Learn everything about Net Promoter Score (NPS) and the Net Promoter Question. Get a clear view on the universal Net Promoter Score Formula, how to undertake Net Promoter Score Calculation followed by a simple Net Promoter Score Example.
  • Offline Surveys
  • Customer Satisfaction Surveys
  • Employee Survey Software Employee survey software & tool to create, send and analyze employee surveys. Get real-time analysis for employee satisfaction, engagement, work culture and map your employee experience from onboarding to exit!
  • Market Research Survey Software Real-time, automated and advanced market research survey software & tool to create surveys, collect data and analyze results for actionable market insights.
  • GDPR & EU Compliance
  • Employee Experience
  • Customer Journey
  • Synthetic Data
  • About us
  • Executive Team
  • In the news
  • Testimonials
  • Advisory Board
  • Careers
  • Brand
  • Media Kit
  • Contact Us

QuestionPro in your language

  • English
  • Español (Spanish)
  • Português (Portuguese (Brazil))
  • Nederlands (Dutch)
  • العربية (Arabic)
  • Français (French)
  • Italiano (Italian)
  • 日本語 (Japanese)
  • Türkçe (Turkish)
  • Svenska (Swedish)
  • Hebrew IL (Hebrew)
  • ไทย (Thai)
  • Deutsch (German)
  • Portuguese de Portugal (Portuguese (Portugal))

Awards & certificates

  • survey-leader-asia-leader-2023
  • survey-leader-asiapacific-leader-2023
  • survey-leader-enterprise-leader-2023
  • survey-leader-europe-leader-2023
  • survey-leader-latinamerica-leader-2023
  • survey-leader-leader-2023
  • survey-leader-middleeast-leader-2023
  • survey-leader-mid-market-leader-2023
  • survey-leader-small-business-leader-2023
  • survey-leader-unitedkingdom-leader-2023
  • survey-momentumleader-leader-2023
  • bbb-acredited
The Experience Journal

Find innovative ideas about Experience Management from the experts

  • © 2022 QuestionPro Survey Software | +1 (800) 531 0228
  • Sitemap
  • Privacy Statement
  • Terms of Use