

{"id":2365,"date":"2010-07-23T16:16:51","date_gmt":"2010-07-23T16:16:51","guid":{"rendered":"http:\/\/www.questionpro.com\/?p=2365"},"modified":"2023-05-29T11:40:59","modified_gmt":"2023-05-29T11:40:59","slug":"response-style-bias-and-how-to-overcome-it","status":"publish","type":"post","link":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/","title":{"rendered":"Response Style Bias and How to Overcome It"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-2368 size-full\" title=\"Scale Rating\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2010\/07\/istock_000012753624xsmall.jpg\" alt=\"Happy Face Neutral Face Sad Face with Buttons\" width=\"400\" height=\"300\" \/>A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the &#8220;extreme&#8221; responses that\u00a0occurred\u00a0in rating scales. \u00a0If you&#8217;ve ever received a survey with too many matrix rating questions and then mindlessly checked all the lowest ratings, mid-ratings or high ratings &#8212; you know who you are and you know what I&#8217;m talking about.<\/p>\n<p>This put a bug in my mind about those people who never give the highest rating &#8212; or those people who consistently give a high rating. \u00a0In many ways, they are no better than those panelists who were mindlessly answering their survey. \u00a0In other words &#8212; their responses were suspect in being valid answers to help us make a decision.<\/p>\n<p>Then I ran into this article by <a href=\"https:\/\/www.linkedin.com\/in\/jhenning\/\">Jeff Henning<\/a> and realized that I wasn&#8217;t the only one thinking about this. \u00a0In fact, people much smarter than I&#8217;ll ever be have done loads of research on the topic and have come up with several solutions that I&#8217;m going to show you here.<\/p>\n<p>Henning&#8217;s article actually gets into the discussion about cultural response bias, and you can read more about that in his article. \u00a0The following are <a href=\"https:\/\/www.questionpro.com\/article\/types-of-questions-question-types.html\">question types<\/a> that Henning listed that will help you overcome general response style <a href=\"https:\/\/www.questionpro.com\/blog\/research-bias\/\">research bias<\/a>:<\/p>\n<blockquote>\n<ul>\n<li><strong>Binary scales<\/strong> \u2013 As far back as 1946, to minimize response style bias, Lee Joseph Cronbach (of <a title=\"Cronbach\u2019s alpha\" href=\"http:\/\/en.wikipedia.org\/wiki\/Cronbach's_alpha\">Cronbach\u2019s alpha<\/a> fame) advocated using two-item scales: yes\/no, agree\/disagree, dissatisfied\/satisfied, describes\/does not describe. Essentially this treats everyone as Extreme Response Style responders.<\/li>\n<li><strong>Choose-many questions<\/strong> \u2013 Presenting a list of choices and instructing the respondent to \u201cselect all that apply\u201d is an economical form of binary scale, prompting respondents to choose the items they agree with, find important or are dissatisfied with.<\/li>\n<li><strong>Ranking questions<\/strong> \u2013 Another way to avoid traditional response bias is to use\u00a0<a title=\"ranking scales\" href=\"https:\/\/www.questionpro.com\/blog\/rating-scale\/\">ranking scales<\/a>, where each choice on the scale may be used only once: most important to least important, most satisfactory to least satisfactory, most likely to least likely.<\/li>\n<li><strong>MaxDiff scaling<\/strong> &#8212; Maximum-difference discrete-choice models are a more sophisticated type of ranking question, typically showing attributes four at a time and asking the respondent to select the best and worst attributes from each set: the attributes with the maximum difference. Research has demonstrated that MaxDiff scaling is superior to rating scales for cross-cultural analysis. (Steve Cohen &amp; Leopoldo Neira, 2003, \u201c<a title=\"Measuring Preference for Product Benefits Across Countries: Overcoming scale usage bias with Maximum Difference Scaling\" href=\"http:\/\/scholar.google.com\/scholar?cites=9396518297114321783&amp;as_sdt=2005&amp;sciodt=2000&amp;hl=en\">Measuring Preference for Product Benefits Across Countries: Overcoming scale usage bias with Maximum Difference Scaling<\/a>\u201d.)<\/li>\n<\/ul>\n<\/blockquote>\n<p><strong>Lessons Learned: Surveys should provide additional data for your decision &#8212; not MAKE Your Decision<\/strong><\/p>\n<p>So it isn&#8217;t just panels that can &#8220;dirty&#8221; your data enough to mis-represent how respondents really feel. \u00a0Response bias comes in as many shapes and forms as there are human opinions. \u00a0The key point here is that decisions are ultimately made by human beings. \u00a0Managers and business owners can use survey data as an additional information resource to help them decide &#8212; sort of like the \u00a0&#8220;Ask the audience&#8221; option in &#8220;Who Wants to be a Millionaire&#8221; but that doesn&#8217;t mean you shouldn&#8217;t use your own judgement.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods [&hellip;]<\/p>\n","protected":false},"author":128,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[180],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Response Style Bias and How to Overcome It | QuestionPro<\/title>\n<meta name=\"description\" content=\"A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the &quot;extreme&quot; responses\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Response Style Bias and How to Overcome It | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the &quot;extreme&quot; responses\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2010-07-23T16:16:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-05-29T11:40:59+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2010\/07\/istock_000012753624xsmall.jpg\" \/>\n<meta name=\"author\" content=\"Ivana Taylor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ivana Taylor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\"},\"author\":{\"name\":\"Ivana Taylor\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244\"},\"headline\":\"Response Style Bias and How to Overcome It\",\"datePublished\":\"2010-07-23T16:16:51+00:00\",\"dateModified\":\"2023-05-29T11:40:59+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\"},\"wordCount\":533,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\",\"name\":\"Response Style Bias and How to Overcome It | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2010-07-23T16:16:51+00:00\",\"dateModified\":\"2023-05-29T11:40:59+00:00\",\"description\":\"A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the \\\"extreme\\\" responses\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Uncategorized\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/uncategorized\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Response Style Bias and How to Overcome It\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244\",\"name\":\"Ivana Taylor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g\",\"caption\":\"Ivana Taylor\"},\"description\":\"Ivana Taylor provides DIY Marketing advice, marketing trends and marketing how-to tips and strategies for small business owners and CEOs.\",\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Response Style Bias and How to Overcome It | QuestionPro","description":"A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the \"extreme\" responses","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/","og_locale":"en_US","og_type":"article","og_title":"Response Style Bias and How to Overcome It | QuestionPro","og_description":"A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the \"extreme\" responses","og_url":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2010-07-23T16:16:51+00:00","article_modified_time":"2023-05-29T11:40:59+00:00","og_image":[{"url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2010\/07\/istock_000012753624xsmall.jpg"}],"author":"Ivana Taylor","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Ivana Taylor","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/"},"author":{"name":"Ivana Taylor","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244"},"headline":"Response Style Bias and How to Overcome It","datePublished":"2010-07-23T16:16:51+00:00","dateModified":"2023-05-29T11:40:59+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/"},"wordCount":533,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/","url":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/","name":"Response Style Bias and How to Overcome It | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2010-07-23T16:16:51+00:00","dateModified":"2023-05-29T11:40:59+00:00","description":"A few weeks ago, Research Access had an article that talked about cleaning data from panels. \u00a0One of the methods was to remove all the \"extreme\" responses","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/response-style-bias-and-how-to-overcome-it\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Uncategorized","item":"https:\/\/www.questionpro.com\/blog\/category\/uncategorized\/"},{"@type":"ListItem","position":3,"name":"Response Style Bias and How to Overcome It"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244","name":"Ivana Taylor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g","caption":"Ivana Taylor"},"description":"Ivana Taylor provides DIY Marketing advice, marketing trends and marketing how-to tips and strategies for small business owners and CEOs.","url":"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/"}]}},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Ivana Taylor","author_link":"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/2365"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/128"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=2365"}],"version-history":[{"count":1,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/2365\/revisions"}],"predecessor-version":[{"id":794614,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/2365\/revisions\/794614"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=2365"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=2365"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=2365"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}