

{"id":12196,"date":"2015-04-22T12:06:51","date_gmt":"2015-04-22T19:06:51","guid":{"rendered":"http:\/\/www.questionpro.com\/?p=12196"},"modified":"2023-08-21T06:25:17","modified_gmt":"2023-08-21T06:25:17","slug":"everyone-chooses-the-answer-to-the-left-scale-order","status":"publish","type":"post","link":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/","title":{"rendered":"Everyone chooses the answer to the left: scale order"},"content":{"rendered":"<div class=\"wp-block-image size-medium wp-image-12200\">\n<figure class=\"alignright\"><img decoding=\"async\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2015\/04\/left_scale-300x225.jpg\" alt=\"Photo by Winnifredxoxo. Used under Creative Commons License\" class=\"wp-image-12200\"\/><figcaption class=\"wp-element-caption\">Photo by Winnifredxoxo. Used under Creative Commons License<\/figcaption><\/figure><\/div>\n\n\n<p>Yesterday&#8217;s discussion of Likert scale and <a href=\"https:\/\/www.questionpro.com\/blog\/what-is-likert-scale\/\">Likert<\/a>-style scales included the assertion that presenting the scales with the positive items to the left will result in a <a href=\"https:\/\/www.questionpro.com\/blog\/research-bias\/\">research bias<\/a> towards the positive side of the scale, as opposed to presenting the same scale with the negative items to the left. Let&#8217;s dive into some issues with the way scales are presented to respondents, and the research-approved recommendation for how to present a scale in your online survey.<br><\/p>\n\n\n\n<!--more-->\n\n\n\n<h2 class=\"wp-block-heading\">Left-side bias<\/h2>\n\n\n\n<p>When using <a href=\"https:\/\/www.questionpro.com\/article\/likert-scale-survey-questions.html\">Likert-type scales<\/a> for measuring respondent attitudes and opinions, the way in which you present the scale matters. A number of studies have been conducted to measure the difference between responses gathered when the scale was presented with positive options to the left versus negative options to the left. One by Jason Chan from University of Texas at Austin (pdf download) showed that, while respondents were more likely in general to choose the left-most options in a scale, when the most positive options were listed first on the left, the response bias was higher than when listing the same options with the negative options on the left. A similar study was repeated and had the same results (pdf download): whatever is listed to the left is chosen more, but it&#8217;s more pronounced when the positive options are listed to the left.<\/p>\n\n\n\n<p>Here&#8217;s a caveat, though &#8211; the bias is more pronounced when you&#8217;re dealing with 100 or more responses. The bias is not measured as strongly for fewer than 100 responses.<\/p>\n\n\n\n\t<div class=\"banner-section wf-section\" lang=\"\" >\n\t\t<div class=\"right-column-container\">\n\t\t\t<div class=\"bannerbg white\">\n\t\t\t\t<span class=\"h1-2\">Create memorable experiences based on real-time data, insights and advanced analysis.<\/span>\n\t\t\t\t<a href=\"#userliteForm\" data-toggle=\"modal\" class=\"button w-button\">Request Demo<\/a>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n\t<div class=\"userlite-modal modal fade\" id=\"userliteForm\" tabindex=\"-1\" role=\"dialog\" style=\"display: none;\">\n\t\t<div class=\"modal-dialog\" role=\"document\">\n\t\t\t<div class=\"modal-content\" role=\"document\">\n\t\t\t\t<div class=\"modal-body\">\n\t\t\t\t\t<div class=\"modal-header\">\n\t\t\t\t\t\t<button type=\"button\" class=\"close\" data-dismiss=\"modal\" aria-label=\"Close\">\n\t\t\t\t\t\t\t<i class=\"material-icons\">close<\/i>\n\t\t\t\t\t\t<\/button>\n\t\t\t\t\t<\/div>\n\t\t\t\t\t<div class=\"contact-us-form-wrapper contact-box\">\n\t\t\t\t\t\t<div class=\"userlite-form-wrapper\">\n\t\t\t\t\t\t\t<iframe src=\"https:\/\/www.questionpro.com\/userlite-form-blog-en.html?product=Surveys&amp;referralurl=https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/12196&amp;lang=en&amp;cat=survey-software\" style=\"display: block;\" ><\/iframe>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t\t<div class=\"demo-form-wrapper success-message-div\" style=\"display:none\">\n\t\t\t\t\t\t\t<p class=\"success-message-para\"><\/p>\n\t\t\t\t\t\t<\/div>\n\t\t\t\t\t<\/div>\n\t\t\t\t<\/div>\n\t\t\t<\/div>\n\t\t<\/div>\n\t<\/div>\n\n\n\n<h2 class=\"wp-block-heading\">Vertical versus horizontal representation<\/h2>\n\n\n\n<p>This left-side bias presents a new question: what if we listed the same items in a vertical order, one per line, instead of the left-to-right horizontal order?<\/p>\n\n\n\n<p>Researchers investigated this question, too. In 2009, an article was published in the <a href=\"https:\/\/www.researchgate.net\/profile\/Vera-Toepoel\/publication\/4784408_Design_of_Web_Questionnaires_The_Effect_of_Layout_in_Rating_Scales\/links\/0deec520de9f388043000000\/Design-of-Web-Questionnaires-The-Effect-of-Layout-in-Rating-Scales.pdf\" rel=\"nofollow\">Journal of Official Statistics (pdf download)<\/a> describing the results of a variety of tests for rating scale layouts for online surveys. Here&#8217;s the net result: horizontal scales seemed to produce less bias than vertical scales. Interestingly, when scales were laid out vertically, it seemed respondents were less likely to read through the entire list of options than if the scale was laid out horizontally in one line.<\/p>\n\n\n\n<p>They also tested showing respondents the five-point scale in three columns with the options reading across horizontally, the five-point scale in three columns with the options reading vertically, and showing the scale options with numbers. Their summary recommendation based on their research is to use a horizontal layout with words to minimize bias in responses. Combine that with the left-side bias, and it&#8217;s better to arrange the items with the negative options first which will produce <em>less<\/em> bias than if the same items are arranged with the positive options first.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Re-arranging response layout in QuestionPro<\/h2>\n\n\n\n<p>When it comes to putting this into practice for your own <a href=\"https:\/\/www.questionpro.com\/blog\/surveys\/\">surveys<\/a> created with QuestionPro, the steps to changing the layout from vertical to horizontal are simple. The steps below assume you are working with a single-select question (the most likely for using a <a href=\"https:\/\/www.questionpro.com\/article\/likert-scale-survey-questions.html\">Likert-style scale<\/a> or any other rating scale).<\/p>\n\n\n\n<ol>\n<li>Hover over the question you want to modify. Click <strong>More<\/strong> on the right-side fly-out menu.<\/li>\n\n\n\n<li>Select <strong>Settings<\/strong>.<\/li>\n\n\n\n<li>Under <strong>Answer Display<\/strong> select <strong>Next to each other<\/strong> from the second drop-down (default shown is One Per Line (vertical)).<\/li>\n\n\n\n<li>Click <strong>Save Settings<\/strong>.<\/li>\n<\/ol>\n","protected":false},"excerpt":{"rendered":"<p>Yesterday&#8217;s discussion of Likert scale and Likert-style scales included the assertion that presenting the scales with the positive items to [&hellip;]<\/p>\n","protected":false},"author":108,"featured_media":12200,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[187],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Everyone chooses the answer to the left: scale order | QuestionPro<\/title>\n<meta name=\"description\" content=\"Photo by Winnifredxoxo. Used under Creative Commons License Yesterday&#039;s discussion of Likert scale and Likert-style scales included the assertion that\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Everyone chooses the answer to the left: scale order | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"Photo by Winnifredxoxo. Used under Creative Commons License Yesterday&#039;s discussion of Likert scale and Likert-style scales included the assertion that\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2015-04-22T19:06:51+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-08-21T06:25:17+00:00\" \/>\n<meta name=\"author\" content=\"Zontziry (Z) Johnson\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Zontziry (Z) Johnson\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\"},\"author\":{\"name\":\"Zontziry (Z) Johnson\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/76d93efd09c3825604f7ca1c5267bd5e\"},\"headline\":\"Everyone chooses the answer to the left: scale order\",\"datePublished\":\"2015-04-22T19:06:51+00:00\",\"dateModified\":\"2023-08-21T06:25:17+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\"},\"wordCount\":568,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"articleSection\":[\"Surveys\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\",\"name\":\"Everyone chooses the answer to the left: scale order | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2015-04-22T19:06:51+00:00\",\"dateModified\":\"2023-08-21T06:25:17+00:00\",\"description\":\"Photo by Winnifredxoxo. Used under Creative Commons License Yesterday's discussion of Likert scale and Likert-style scales included the assertion that\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Surveys\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Everyone chooses the answer to the left: scale order\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/76d93efd09c3825604f7ca1c5267bd5e\",\"name\":\"Zontziry (Z) Johnson\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/947313867c80697f17a00bf371bea253?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/947313867c80697f17a00bf371bea253?s=96&d=mm&r=g\",\"caption\":\"Zontziry (Z) Johnson\"},\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/zontziry\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Everyone chooses the answer to the left: scale order | QuestionPro","description":"Photo by Winnifredxoxo. Used under Creative Commons License Yesterday's discussion of Likert scale and Likert-style scales included the assertion that","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/","og_locale":"en_US","og_type":"article","og_title":"Everyone chooses the answer to the left: scale order | QuestionPro","og_description":"Photo by Winnifredxoxo. Used under Creative Commons License Yesterday's discussion of Likert scale and Likert-style scales included the assertion that","og_url":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2015-04-22T19:06:51+00:00","article_modified_time":"2023-08-21T06:25:17+00:00","author":"Zontziry (Z) Johnson","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Zontziry (Z) Johnson","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/"},"author":{"name":"Zontziry (Z) Johnson","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/76d93efd09c3825604f7ca1c5267bd5e"},"headline":"Everyone chooses the answer to the left: scale order","datePublished":"2015-04-22T19:06:51+00:00","dateModified":"2023-08-21T06:25:17+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/"},"wordCount":568,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"articleSection":["Surveys"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/","url":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/","name":"Everyone chooses the answer to the left: scale order | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2015-04-22T19:06:51+00:00","dateModified":"2023-08-21T06:25:17+00:00","description":"Photo by Winnifredxoxo. Used under Creative Commons License Yesterday's discussion of Likert scale and Likert-style scales included the assertion that","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/everyone-chooses-the-answer-to-the-left-scale-order\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Surveys","item":"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/"},{"@type":"ListItem","position":3,"name":"Everyone chooses the answer to the left: scale order"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/76d93efd09c3825604f7ca1c5267bd5e","name":"Zontziry (Z) Johnson","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/947313867c80697f17a00bf371bea253?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/947313867c80697f17a00bf371bea253?s=96&d=mm&r=g","caption":"Zontziry (Z) Johnson"},"url":"https:\/\/www.questionpro.com\/blog\/author\/zontziry\/"}]}},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Zontziry (Z) Johnson","author_link":"https:\/\/www.questionpro.com\/blog\/author\/zontziry\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/12196"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/108"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=12196"}],"version-history":[{"count":4,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/12196\/revisions"}],"predecessor-version":[{"id":807844,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/12196\/revisions\/807844"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=12196"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=12196"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=12196"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}