

{"id":3954,"date":"2011-01-31T13:38:44","date_gmt":"2011-01-31T13:38:44","guid":{"rendered":"http:\/\/www.questionpro.com\/?p=3954"},"modified":"2023-04-28T04:58:09","modified_gmt":"2023-04-28T04:58:09","slug":"the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good","status":"publish","type":"post","link":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/","title":{"rendered":"The Benefit Real Life Testing Outweighs the Payoff of Looking Good"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"aligncenter wp-image-3955 size-medium\" title=\"iStock_000012753624XSmall\" src=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2011\/01\/istock_000012753624xsmall-300x225.jpg\" alt=\"image\" width=\"300\" height=\"225\" \/>Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it&#8217;s OK to make a mistake. \u00a0 I have to keep reminding myself that not only are most marketing tests or published pieces not carved in stone &#8212; they aren&#8217;t even printed on PAPER! \u00a0So what am I freaking out about?<\/p>\n<p><strong>Testing by Launching<\/strong><\/p>\n<p>I&#8217;m not advocating rushing out into the world with just anything, but when you&#8217;re at the 80% mark and you need to do some testing &#8212; don&#8217;t be afraid of testing live or pre-launching your product or service.<\/p>\n<p>That&#8217;s what Survey Analytics did with their new SurveySwipe product. \u00a0They had developed a mobile market research platform but needed some real life input to tweak the bugs.<\/p>\n<p>They weren&#8217;t shy about it either &#8211; they decided to pick the State of the Union address as their test. \u00a0I think that was BOLD and very visible. \u00a0The risk to most of us traditional marketing types might be &#8220;BUT WHAT IF WE FAIL&#8221; \u00a0what if people can&#8217;t use the tool? \u00a0What if they think badly of us? \u00a0What if&#8230; What if&#8230;<\/p>\n<p>Well &#8211; what if we TELL them it&#8217;s a test? \u00a0And what if we expect that there will be issues and what if we approach the whole thing as a game and as an exciting learning opportunity where we&#8217;re are all learning something together? \u00a0That would be a whole different kind of event.<\/p>\n<p>The result might even be a more energized and excited consumer base &#8212; one that accepts that this is a test and can&#8217;t wait to see the bugs worked out. \u00a0WHAT A DIFFERENCE!<\/p>\n<p><strong>What Survey Analytics Learned<\/strong><\/p>\n<ul>\n<li><strong>Mobile Platforms are Definitely Exciting.<\/strong> Based on the overall engagement &#8212; this is HOT HOT HOT!<\/li>\n<li><strong>Email or push &#8211; not both.<\/strong> This is a valuable lesson for all of us &#8211; how does your market want to be notified? \u00a0Be sure to ask what they want and then do it exactly that way.<\/li>\n<li><strong>Don&#8217;t be afraid to wing it.<\/strong> This is my favorite lesson. \u00a0The Survey Analytics team KNEW that one of the features was getting real time data. \u00a0Instead of playing it safe &#8211; they started PLAYING and polling in real time with their beta testers &#8212; asking questions on the fly!<\/li>\n<\/ul>\n<p>You can read all the details of what they did well and what the Survey Analytics team learned from their SurveySwipe beta test. \u00a0But the real lesson here wasn&#8217;t in the technology, but in the mindset.<\/p>\n<p>Today&#8217;s technology makes it virtually impossible to really test anything to perfection. \u00a0 In fact, the standard practice for web content is to actually create several versions of the content and split test using tools like <a href=\"https:\/\/www.google.com\/accounts\/ServiceLogin?hl=en&amp;service=websiteoptimizer&amp;continue=https:\/\/www.google.com\/analytics\/siteopt\/%3Fet%3Dreset%26hl%3Den\" target=\"_blank\" rel=\"noopener noreferrer\">Google Web Site Optimizer.<\/a><\/p>\n<p>Wondering what to charge for a product or service? \u00a0Chances are you can post a description and prototype on ebay at a variety of prices and see which sells best.<\/p>\n<p>It&#8217;s clear that the old days of testing something to death have been overtaken by actually putting it out there and working out the kinks in real time.<\/p>\n<p>How do you feel about that? \u00a0What are your tips, Do&#8217;s and Don&#8217;ts about when it&#8217;s ok to test a beta in real time and when more traditional pre-launch analysis is required?<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that [&hellip;]<\/p>\n","protected":false},"author":74,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[180],"tags":[428],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v20.4 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>The Benefit Real Life Testing Outweighs the Payoff of Looking Good | QuestionPro<\/title>\n<meta name=\"description\" content=\"Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it&#039;s OK to make a mistake. \u00a0 I have to\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Benefit Real Life Testing Outweighs the Payoff of Looking Good | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it&#039;s OK to make a mistake. \u00a0 I have to\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2011-01-31T13:38:44+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-04-28T04:58:09+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2011\/01\/istock_000012753624xsmall-300x225.jpg\" \/>\n<meta name=\"author\" content=\"Esther LaVielle\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Esther LaVielle\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"3 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\"},\"author\":{\"name\":\"Esther LaVielle\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/2609a5088a41bddcd765aeee4945ccf4\"},\"headline\":\"The Benefit Real Life Testing Outweighs the Payoff of Looking Good\",\"datePublished\":\"2011-01-31T13:38:44+00:00\",\"dateModified\":\"2023-04-28T04:58:09+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\"},\"wordCount\":578,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"keywords\":[\"Essay\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\",\"name\":\"The Benefit Real Life Testing Outweighs the Payoff of Looking Good | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2011-01-31T13:38:44+00:00\",\"dateModified\":\"2023-04-28T04:58:09+00:00\",\"description\":\"Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it's OK to make a mistake. \u00a0 I have to\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Uncategorized\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/uncategorized\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"The Benefit Real Life Testing Outweighs the Payoff of Looking Good\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/2609a5088a41bddcd765aeee4945ccf4\",\"name\":\"Esther LaVielle\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/0ad2379820a7342029395882101cc737?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/0ad2379820a7342029395882101cc737?s=96&d=mm&r=g\",\"caption\":\"Esther LaVielle\"},\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/ermahlvl\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"The Benefit Real Life Testing Outweighs the Payoff of Looking Good | QuestionPro","description":"Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it's OK to make a mistake. \u00a0 I have to","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/","og_locale":"en_US","og_type":"article","og_title":"The Benefit Real Life Testing Outweighs the Payoff of Looking Good | QuestionPro","og_description":"Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it's OK to make a mistake. \u00a0 I have to","og_url":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2011-01-31T13:38:44+00:00","article_modified_time":"2023-04-28T04:58:09+00:00","og_image":[{"url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2011\/01\/istock_000012753624xsmall-300x225.jpg"}],"author":"Esther LaVielle","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Esther LaVielle","Est. reading time":"3 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/"},"author":{"name":"Esther LaVielle","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/2609a5088a41bddcd765aeee4945ccf4"},"headline":"The Benefit Real Life Testing Outweighs the Payoff of Looking Good","datePublished":"2011-01-31T13:38:44+00:00","dateModified":"2023-04-28T04:58:09+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/"},"wordCount":578,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"keywords":["Essay"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/","url":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/","name":"The Benefit Real Life Testing Outweighs the Payoff of Looking Good | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2011-01-31T13:38:44+00:00","dateModified":"2023-04-28T04:58:09+00:00","description":"Having grown up in the more traditional pen and paper world of marketing, I have to constantly remind myself that it's OK to make a mistake. \u00a0 I have to","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/the-benefit-real-life-testing-outweighs-the-payoff-of-looking-good\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Uncategorized","item":"https:\/\/www.questionpro.com\/blog\/category\/uncategorized\/"},{"@type":"ListItem","position":3,"name":"The Benefit Real Life Testing Outweighs the Payoff of Looking Good"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/2609a5088a41bddcd765aeee4945ccf4","name":"Esther LaVielle","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/0ad2379820a7342029395882101cc737?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/0ad2379820a7342029395882101cc737?s=96&d=mm&r=g","caption":"Esther LaVielle"},"url":"https:\/\/www.questionpro.com\/blog\/author\/ermahlvl\/"}]}},"featured_image_src":null,"featured_image_src_square":null,"author_info":{"display_name":"Esther LaVielle","author_link":"https:\/\/www.questionpro.com\/blog\/author\/ermahlvl\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/3954"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/74"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=3954"}],"version-history":[{"count":1,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/3954\/revisions"}],"predecessor-version":[{"id":788648,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/3954\/revisions\/788648"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=3954"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=3954"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=3954"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}