

{"id":86974,"date":"2020-01-08T05:10:56","date_gmt":"2020-01-08T13:10:56","guid":{"rendered":"https:\/\/www.questionpro.com\/blog\/?p=86974"},"modified":"2023-07-31T08:49:32","modified_gmt":"2023-07-31T08:49:32","slug":"eliminate-order-bias-in-surveys-with-question-randomization","status":"publish","type":"post","link":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/","title":{"rendered":"Eliminate order bias in surveys with question randomization"},"content":{"rendered":"<p><span style=\"font-weight: 400;\">Depending on the flow of the questions in a survey, a respondent might feel inclined to think in a certain direction. It influences people to behave or develop an opinion in a way you desire. This can affect data quality. Hence, it is the survey creator\u2019s responsibility to make sure that the respondents aren\u2019t influenced by any kind of bias and extract honest opinion from them. Unbiased responses will ensure data accuracy and will, in turn, ensure good quality insights from the market research. Question randomization removes discrepancies in the method of collecting data and eliminates bias.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Randomization is a technique used to overcome order bias &#8211; the bias that generates from the order of answer choices. Respondents tend to favor choices at the beginning and end of a list because they stay in memory. It is likely that the respondents\u2019 first few answers selection is based on the need to save time. Question randomization solves this problem by presenting survey questions randomly to the respondent.<\/span><\/p>\n<p style=\"text-align: center;\"><strong>LEARN ABOUT:<\/strong> <a href=\"https:\/\/www.questionpro.com\/blog\/6-problems-with-online-surveys-and-how-to-avoid-them\/\" data-rich-text-format-boundary=\"true\">Survey Mistakes And How to Avoid<\/a><\/p>\n<h3><span style=\"font-weight: 400;\">What\u2019s new in QuestionPro surveys?<\/span><\/h3>\n<p><span style=\"font-weight: 400;\">QuestionPro lets its users create survey blocks to better organize and manage questions in the survey. You can now also randomize the order of questions in these blocks. This feature is available to all users with the research edition license.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">With question randomization, you can randomize all questions on a page or specific questions on a page. The randomization order can be set as one of the below types:<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\"><b>Random<\/b><span style=\"font-weight: 400;\">:\u00a0 Randomly display all the questions placed under this option.<\/span><\/li>\n<\/ol>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-87212\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/help-1223-3.png\" alt=\"random questions in survey\" width=\"1366\" height=\"667\" \/><\/p>\n<ol start=\"2\">\n<li style=\"font-weight: 400;\"><b>Random subse<\/b><span style=\"font-weight: 400;\">t: Display specific questions from the list of questions placed under this option<\/span><\/li>\n<\/ol>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-87219\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/help-1223-4.png\" alt=\"randomization\" width=\"1366\" height=\"667\" \/><\/p>\n<ol start=\"3\">\n<li style=\"font-weight: 400;\"><b>Do not display<\/b><span style=\"font-weight: 400;\">: Hide the question(s) which placed under this option.<\/span><\/li>\n<\/ol>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-87226 size-full\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/help-1223-5.png\" alt=\"hide survey questions\" width=\"1366\" height=\"667\" \/><\/p>\n<p><b>Note<\/b><span style=\"font-weight: 400;\">: This feature will be available only in new surveys.<\/span><\/p>\n<h3><span style=\"font-weight: 400;\">How to randomize questions in a survey block?<\/span><\/h3>\n<ul>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Login <\/span><b>QuestionPro Surveys<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Create a new survey.\u00a0 A survey block will be created automatically with a new survey.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Click on the three dots at the tops of the survey block.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Click on <\/span><b>Question Randomization<\/b><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">You will find all the questions present under the <\/span><b>Current Display Order<\/b><span style=\"font-weight: 400;\"> category. You can use the up and down arrows to the left to reorder the selected question.<\/span><\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-87233 size-full\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/2020-01-08_1825.png\" alt=\"randomization\" width=\"893\" height=\"525\" \/><\/p>\n<ul>\n<li>You can use the left and right arrows in front of the respective randomization option to add the selected question into that category.<\/li>\n<li style=\"font-weight: 400;\"><span style=\"font-weight: 400;\">Click on the <\/span><b>Save<\/b><span style=\"font-weight: 400;\"> button to save the question randomization.<\/span><\/li>\n<\/ul>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone wp-image-87240 size-full\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/2020-01-08_1826.png\" alt=\"question randomization\" width=\"885\" height=\"519\" \/><\/p>\n<p><span style=\"font-weight: 400;\">Learn more: <\/span><a href=\"https:\/\/www.questionpro.com\/help\/question-randomization.html\"><span style=\"font-weight: 400;\">Question Randomization<\/span><\/a><\/p>\n<p><span style=\"font-weight: 400;\">Question randomization ensures the questions are displayed in the correct order so as to get the best insights from the data collected.\u00a0 If you need any help with the surveys or market research, get in touch with us!<\/span><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Depending on the flow of the questions in a survey, a respondent might feel inclined to think in a certain [&hellip;]<\/p>\n","protected":false},"author":86,"featured_media":87205,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[270,187],"tags":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>Eliminate order bias in surveys with question randomization | QuestionPro<\/title>\n<meta name=\"description\" content=\"Get accurate insights from your survey results by eliminating order bias in surveys with question randomization.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Eliminate order bias in surveys with question randomization | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"Get accurate insights from your survey results by eliminating order bias in surveys with question randomization.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2020-01-08T13:10:56+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-07-31T08:49:32+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/2.png\" \/>\n\t<meta property=\"og:image:width\" content=\"992\" \/>\n\t<meta property=\"og:image:height\" content=\"594\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/png\" \/>\n<meta name=\"author\" content=\"Adi Bhat\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Adi Bhat\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\"},\"author\":{\"name\":\"Adi Bhat\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/6240dce6e1901b1a6c7f3dbd3e22567f\"},\"headline\":\"Eliminate order bias in surveys with question randomization\",\"datePublished\":\"2020-01-08T13:10:56+00:00\",\"dateModified\":\"2023-07-31T08:49:32+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\"},\"wordCount\":452,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"articleSection\":[\"New Features\",\"Surveys\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\",\"name\":\"Eliminate order bias in surveys with question randomization | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2020-01-08T13:10:56+00:00\",\"dateModified\":\"2023-07-31T08:49:32+00:00\",\"description\":\"Get accurate insights from your survey results by eliminating order bias in surveys with question randomization.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"QuestionPro\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/questionpro\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"New Features\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/questionpro\/new-features\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Eliminate order bias in surveys with question randomization\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/6240dce6e1901b1a6c7f3dbd3e22567f\",\"name\":\"Adi Bhat\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/33be79da19de28bbea9b5a059532a027?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/33be79da19de28bbea9b5a059532a027?s=96&d=mm&r=g\",\"caption\":\"Adi Bhat\"},\"description\":\"Aditya Bhat, a.k.a. \u2018Adi\u2019, is a thought leader in market strategy and business development. He leads QuestionPro's sales teams to partner with companies, government organizations, and nonprofit institution.\",\"sameAs\":[\"https:\/\/www.questionpro.com\/\"],\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/adityabhat\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Eliminate order bias in surveys with question randomization | QuestionPro","description":"Get accurate insights from your survey results by eliminating order bias in surveys with question randomization.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/","og_locale":"en_US","og_type":"article","og_title":"Eliminate order bias in surveys with question randomization | QuestionPro","og_description":"Get accurate insights from your survey results by eliminating order bias in surveys with question randomization.","og_url":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2020-01-08T13:10:56+00:00","article_modified_time":"2023-07-31T08:49:32+00:00","og_image":[{"width":992,"height":594,"url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/2.png","type":"image\/png"}],"author":"Adi Bhat","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Adi Bhat","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/"},"author":{"name":"Adi Bhat","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/6240dce6e1901b1a6c7f3dbd3e22567f"},"headline":"Eliminate order bias in surveys with question randomization","datePublished":"2020-01-08T13:10:56+00:00","dateModified":"2023-07-31T08:49:32+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/"},"wordCount":452,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"articleSection":["New Features","Surveys"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/","url":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/","name":"Eliminate order bias in surveys with question randomization | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2020-01-08T13:10:56+00:00","dateModified":"2023-07-31T08:49:32+00:00","description":"Get accurate insights from your survey results by eliminating order bias in surveys with question randomization.","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/eliminate-order-bias-in-surveys-with-question-randomization\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"QuestionPro","item":"https:\/\/www.questionpro.com\/blog\/category\/questionpro\/"},{"@type":"ListItem","position":3,"name":"New Features","item":"https:\/\/www.questionpro.com\/blog\/category\/questionpro\/new-features\/"},{"@type":"ListItem","position":4,"name":"Eliminate order bias in surveys with question randomization"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/6240dce6e1901b1a6c7f3dbd3e22567f","name":"Adi Bhat","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/33be79da19de28bbea9b5a059532a027?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/33be79da19de28bbea9b5a059532a027?s=96&d=mm&r=g","caption":"Adi Bhat"},"description":"Aditya Bhat, a.k.a. \u2018Adi\u2019, is a thought leader in market strategy and business development. He leads QuestionPro's sales teams to partner with companies, government organizations, and nonprofit institution.","sameAs":["https:\/\/www.questionpro.com\/"],"url":"https:\/\/www.questionpro.com\/blog\/author\/adityabhat\/"}]}},"featured_image_src":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/2.png","featured_image_src_square":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2020\/01\/2.png","author_info":{"display_name":"Adi Bhat","author_link":"https:\/\/www.questionpro.com\/blog\/author\/adityabhat\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/86974"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/86"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=86974"}],"version-history":[{"count":1,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/86974\/revisions"}],"predecessor-version":[{"id":804732,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/86974\/revisions\/804732"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media\/87205"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=86974"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=86974"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=86974"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}