![\"Statistical](\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2015\/11\/startup-photos-large-21.jpg\")
<\/a>As market researchers, it is our task to sort the wheat from the chaff. Whether the data is from a survey or customer transactions it is our function to extrapolate meaning and educate those who can do something with it. When we dig into the details underlying our data we are often confronted with a fundamental question:<\/p>\nWhat is significant and what is not?<\/em><\/p>\nStatistical significance has a long history. There have been many great statisticians, economists and applied mathematicians who have contributed to the body of knowledge that we as market researchers use daily. There are several tests and procedures from which to choose depending upon our hypotheses and the complexity of the data. Survey researchers commonly employ a chi-square, t-test, F-test, or many others with our banner tables, ANOVAs, factor analyses, and regressions. Yet the question remains what is significant and what is not?<\/p>\n
When you are blessed to have a significant number of responses to your survey then you can easily run into this question head on. A recent example involves comparing responses from two annual employee training surveys, with a combined 12,500 respondents. When examining the proportion that trained on a particular technology I noticed a three percentage point difference between the two iterations. Under normal circumstances (aka those with far fewer responses) I would dismiss such a difference as not significant, but the impact of the large respondent pool forced my hand. The difference was significant at the .001 level, certainly more so than the gold standard of 0.05.<\/p>\n
Hence the dilemma \u2013 does statistically significant mean the same thing as managerially significant? The answer to this question calls upon the judgment of the researcher. In my reporting, I made the decision to report the difference as statistically significant. What would make it managerially significant? One has to look to the bottom-line impacts before making such a call. If a three percent drop in your customer base or sales volume translates to a substantial drop in profitability then the figure has both statistical and managerial significance.<\/p>\n
As researchers, we are tasked with taking a holistic view of the data as it represents the market. Not all of the findings from our research will have a measurable impact on the business, at least in the short-run. The essential guidance then is to keep your reporting focus on the most salient points and reserve those that are off-center for \u2018color commentary\u2019.<\/p>\n","protected":false},"excerpt":{"rendered":"
Statistical vs. Managerial Significance As market researchers, it is our task to sort the wheat from the chaff. Whether the […]<\/p>\n","protected":false},"author":136,"featured_media":16236,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[188],"tags":[531,377],"yoast_head":"\n
Statistical vs. Managerial Significance | QuestionPro<\/title>\n<meta name=\"description\" content=\"Statistical significance has a long history. Learn in this post what Statistical vs. Managerial Significance is and what is it not.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"Statistical vs. Managerial Significance | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"Statistical significance has a long history. Learn in this post what Statistical vs. Managerial Significance is and what is it not.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2015-12-01T02:16:37+00:00\" \/>\n<meta name=\"author\" content=\"Greg Timpany\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Greg Timpany\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"2 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\"},\"author\":{\"name\":\"Greg Timpany\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/dd964eb1605a56ae265b9c32f202ac62\"},\"headline\":\"Statistical vs. Managerial Significance\",\"datePublished\":\"2015-12-01T02:16:37+00:00\",\"dateModified\":\"2015-12-01T02:16:37+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\"},\"wordCount\":408,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"keywords\":[\"@DataDudeGreg\",\"Top10\"],\"articleSection\":[\"Academic Research\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\",\"name\":\"Statistical vs. Managerial Significance | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2015-12-01T02:16:37+00:00\",\"dateModified\":\"2015-12-01T02:16:37+00:00\",\"description\":\"Statistical significance has a long history. Learn in this post what Statistical vs. Managerial Significance is and what is it not.\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Surveys\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Academic Research\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/academic-research\/\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Statistical vs. Managerial Significance\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/dd964eb1605a56ae265b9c32f202ac62\",\"name\":\"Greg Timpany\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/ebac56c008c5c547e956fc3f9c99c5f7?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/ebac56c008c5c547e956fc3f9c99c5f7?s=96&d=mm&r=g\",\"caption\":\"Greg Timpany\"},\"description\":\"Consumer and B2B Insights and Research Thought Leader. Passionate About Translating Insights into Action.\",\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/gregtimpany\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Statistical vs. Managerial Significance | QuestionPro","description":"Statistical significance has a long history. Learn in this post what Statistical vs. Managerial Significance is and what is it not.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/","og_locale":"en_US","og_type":"article","og_title":"Statistical vs. Managerial Significance | QuestionPro","og_description":"Statistical significance has a long history. Learn in this post what Statistical vs. Managerial Significance is and what is it not.","og_url":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2015-12-01T02:16:37+00:00","author":"Greg Timpany","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Greg Timpany","Est. reading time":"2 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/"},"author":{"name":"Greg Timpany","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/dd964eb1605a56ae265b9c32f202ac62"},"headline":"Statistical vs. Managerial Significance","datePublished":"2015-12-01T02:16:37+00:00","dateModified":"2015-12-01T02:16:37+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/"},"wordCount":408,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"keywords":["@DataDudeGreg","Top10"],"articleSection":["Academic Research"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/","url":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/","name":"Statistical vs. Managerial Significance | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2015-12-01T02:16:37+00:00","dateModified":"2015-12-01T02:16:37+00:00","description":"Statistical significance has a long history. Learn in this post what Statistical vs. Managerial Significance is and what is it not.","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/statistical-vs-managerial-significance\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Surveys","item":"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/"},{"@type":"ListItem","position":3,"name":"Academic Research","item":"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/academic-research\/"},{"@type":"ListItem","position":4,"name":"Statistical vs. Managerial Significance"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/dd964eb1605a56ae265b9c32f202ac62","name":"Greg Timpany","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/ebac56c008c5c547e956fc3f9c99c5f7?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/ebac56c008c5c547e956fc3f9c99c5f7?s=96&d=mm&r=g","caption":"Greg Timpany"},"description":"Consumer and B2B Insights and Research Thought Leader. Passionate About Translating Insights into Action.","url":"https:\/\/www.questionpro.com\/blog\/author\/gregtimpany\/"}]}},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Greg Timpany","author_link":"https:\/\/www.questionpro.com\/blog\/author\/gregtimpany\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/15584"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/136"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=15584"}],"version-history":[{"count":0,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/15584\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=15584"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=15584"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=15584"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}