

{"id":916,"date":"2009-12-09T06:59:37","date_gmt":"2009-12-09T06:59:37","guid":{"rendered":"http:\/\/www.questionpro.com\/?p=916"},"modified":"2023-08-24T06:18:39","modified_gmt":"2023-08-24T06:18:39","slug":"what-happens-when-you-change-survey-methods","status":"publish","type":"post","link":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/","title":{"rendered":"What Happens When You Change Survey Methods"},"content":{"rendered":"<div class=\"wp-block-image\">\n<figure class=\"alignleft\"><img decoding=\"async\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2009\/12\/istock_000005290011xsmall-150x150.jpg\" alt=\"image\" class=\"wp-image-917\" title=\"iStock_000005290011XSmall\"\/><\/figure><\/div>\n\n\n<p>My last article about <a href=\"https:\/\/www.questionpro.com\/blog\/2009\/12\/02\/how-to-change-from-one-rating-scale-to-another\/\">changing rating scales <\/a>prompted this e-mail from a reader.<\/p>\n\n\n\n<p><em>Over many years of surveying customers and guests I have had to grapple many times with changing methodology: not just changing scales but in changing data collection methods.&nbsp; Now, more than ever, many clients are thinking about, if not already, switching to data collection through email surveys and internet based surveying.&nbsp; As the saying goes \u201cEveryone else is doing it so we should too\u201d.<\/em><\/p>\n\n\n\n<p><em>What faces us is the question of how to explain the differences in scores achieved by the surveying methods. For example, having conducted large scale guest satisfaction surveys across many European countries using intercept surveying we must now convert our collection methods to internet services.&nbsp; Using the exact same questionnaire but administering the survey by email we witness an average drop in satisfaction rating of 9-10% across the board.&nbsp; For companies firmly focused on customer satisfaction this drop is very disconcerting.<\/em><\/p>\n\n\n\n\t<div class=\"banner-section wf-section\" lang=\"\" >\n\t\t<div class=\"right-column-container\">\n\t\t\t<div class=\"bannerbg white\">\n\t\t\t\t<span class=\"h1-2\">Create memorable experiences based on real-time data, insights and advanced analysis.<\/span>\n\t\t\t\t<a href=\"#userliteForm\" data-toggle=\"modal\" class=\"button w-button\">Request Demo<\/a>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n\t<div class=\"userlite-modal modal fade\" id=\"userliteForm\" tabindex=\"-1\" role=\"dialog\" style=\"display: none;\">\n\t\t<div class=\"modal-dialog\" role=\"document\">\n\t\t\t<div class=\"modal-content\" role=\"document\">\n\t\t\t\t<div class=\"modal-body\">\n\t\t\t\t\t<div class=\"modal-header\">\n\t\t\t\t\t\t<button type=\"button\" class=\"close\" data-dismiss=\"modal\" aria-label=\"Close\">\n\t\t\t\t\t\t\t<i class=\"material-icons\">close<\/i>\n\t\t\t\t\t\t<\/button>\n\t\t\t\t\t<\/div>\n\t\t\t\t\t<div class=\"contact-us-form-wrapper contact-box\">\n\t\t\t\t\t\t<div class=\"userlite-form-wrapper\">\n\t\t\t\t\t\t\t<iframe src=\"https:\/\/www.questionpro.com\/userlite-form-blog-en.html?product=Research&amp;referralurl=https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/916&amp;lang=en&amp;cat=market-research\" style=\"display: block;\" ><\/iframe>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<div class=\"demo-form-wrapper success-message-div\" style=\"display:none\">\n\t\t\t\t\t\t\t<p class=\"success-message-para\"><\/p>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n\n\n\n<p><em>Yes, the \u201chalo effect\u201d may explain some of the change but a drop of 10%?&nbsp; Does primacy and recency affect the scores but by how much?&nbsp; Having intercepted the guest before leaving the premises we now mail them a day or two later and get the survey completed sometimes up to 5 to 7 days later.&nbsp; Does the level of satisfaction just drop off as time passes?<\/em><\/p>\n\n\n\n<p><em>In previous years we have tested the change in methodology between face to face, postal and telephone interview and can clearly see that the face to face scores are always the highest, not only because we set the parameters on how respondents can be selected and can to some extent control all the environmental variables, but once we lose this control the data changes substantially.<\/em><\/p>\n\n\n\n<p><em>I just want to pose the question to other interested marketers &nbsp;and ask how they understand this variance in scores, if in evidence and how best can it be explained.<\/em><\/p>\n\n\n\n<p><em>&#8212; Madeleine O\u2019Carroll, consultant researcher working in the EMEA region, specialising in hospitality research.<\/em><\/p>\n\n\n\n<p>I&#8217;ve done some looking on the internet, but haven&#8217;t found a lot of information on this topic. &nbsp;What&#8217;s been your experience? &nbsp;Does anyone have resource or advice for Madeleine? &nbsp;Leave a comment here or send me any links or resources that you have and I will post them.<\/p>\n\n\n\n<p>Better yet &#8211; if you&#8217;ve had experience on this and would like to send a guest post on this topic &#8211; please e-mail it to me ivana@thirdforce.net and I will post it. &nbsp;Be sure to include a one-sentence bio and I link where I can send our readers for more information about you and your organization.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and [&hellip;]<\/p>\n","protected":false},"author":128,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[203],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>What Happens When You Change Survey Methods | QuestionPro<\/title>\n<meta name=\"description\" content=\"My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and guests I have had to grapple\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"What Happens When You Change Survey Methods | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and guests I have had to grapple\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2009-12-09T06:59:37+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-24T06:18:39+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2009\/12\/istock_000005290011xsmall-150x150.jpg\" \/>\n<meta name=\"author\" content=\"Ivana Taylor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ivana Taylor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\"},\"author\":{\"name\":\"Ivana Taylor\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244\"},\"headline\":\"What Happens When You Change Survey Methods\",\"datePublished\":\"2009-12-09T06:59:37+00:00\",\"dateModified\":\"2023-08-24T06:18:39+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\"},\"wordCount\":462,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"articleSection\":[\"Market Research\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\",\"name\":\"What Happens When You Change Survey Methods | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2009-12-09T06:59:37+00:00\",\"dateModified\":\"2023-08-24T06:18:39+00:00\",\"description\":\"My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and guests I have had to grapple\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Market Research\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/market-research\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"What Happens When You Change Survey Methods\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244\",\"name\":\"Ivana Taylor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g\",\"caption\":\"Ivana Taylor\"},\"description\":\"Ivana Taylor provides DIY Marketing advice, marketing trends and marketing how-to tips and strategies for small business owners and CEOs.\",\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"What Happens When You Change Survey Methods | QuestionPro","description":"My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and guests I have had to grapple","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/","og_locale":"en_US","og_type":"article","og_title":"What Happens When You Change Survey Methods | QuestionPro","og_description":"My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and guests I have had to grapple","og_url":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2009-12-09T06:59:37+00:00","article_modified_time":"2023-08-24T06:18:39+00:00","og_image":[{"url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2009\/12\/istock_000005290011xsmall-150x150.jpg"}],"author":"Ivana Taylor","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Ivana Taylor","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/"},"author":{"name":"Ivana Taylor","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244"},"headline":"What Happens When You Change Survey Methods","datePublished":"2009-12-09T06:59:37+00:00","dateModified":"2023-08-24T06:18:39+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/"},"wordCount":462,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"articleSection":["Market Research"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/","url":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/","name":"What Happens When You Change Survey Methods | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2009-12-09T06:59:37+00:00","dateModified":"2023-08-24T06:18:39+00:00","description":"My last article about changing rating scales prompted this e-mail from a reader. Over many years of surveying customers and guests I have had to grapple","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/what-happens-when-you-change-survey-methods\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Market Research","item":"https:\/\/www.questionpro.com\/blog\/category\/market-research\/"},{"@type":"ListItem","position":3,"name":"What Happens When You Change Survey Methods"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244","name":"Ivana Taylor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g","caption":"Ivana Taylor"},"description":"Ivana Taylor provides DIY Marketing advice, marketing trends and marketing how-to tips and strategies for small business owners and CEOs.","url":"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/"}]}},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Ivana Taylor","author_link":"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/916"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/128"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=916"}],"version-history":[{"count":1,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/916\/revisions"}],"predecessor-version":[{"id":809593,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/916\/revisions\/809593"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=916"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=916"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=916"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}