{"id":7602,"date":"2013-08-26T06:00:25","date_gmt":"2013-08-26T13:00:25","guid":{"rendered":"http:\/\/www.questionpro.com\/?p=7602"},"modified":"2023-11-07T05:05:41","modified_gmt":"2023-11-07T05:05:41","slug":"3-things-you-didnt-know-about-survey-measurement-scales","status":"publish","type":"post","link":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/","title":{"rendered":"3 Things You Didn’t Know About Survey Measurement Scales"},"content":{"rendered":"

Isn’t it funny how so many things that we do are automatic; just because that’s the way it’s always been done? \u00a0When was the last time you stopped to think about measurement scales, for example? \u00a0I have to admit that I hardly ever did — until one day, I noticed something and it made me mad. \u00a0So mad, that I started my very own scale revolution.<\/p>\n

I never really shared this with anyone, in fact, I didn’t even know if it was the “proper” thing to do. \u00a0But before I get into that, let me fill you in on my own personal revolt, a few key findings I ran across in my tour around the web on the topic , and when we are done, you just might have a revolt of your own.\"reasoning<\/p>\n

Why I boycotted the 5 and 7 point Likert Scale<\/h2>\n

I was doing some customer research and noticed that my data was consistently skewing in the middle, neutral range. \u00a0I know — there are analytical fixes for this — especially if you have a PhD in stats — but I don’t. \u00a0I barely passed enough QBA (Quantitative Business Analysis) \u00a0courses to get the credits required to earn the few credits I got. \u00a0But I digress.<\/p>\n

Something strange happened to me. \u00a0I had this visceral response while I was looking at the data. \u00a0I was increasingly getting PISSED OFF! \u00a0“COME ON!” \u00a0I thought, “You know that I know that you know you are NOT neutral on this!” \u00a0Then it dawned on me — I could change the scale! \u00a0I was the all powerful survey designer and I could change the scale!<\/p>\n

No more neutral – BABY!<\/strong><\/p>\n

And from that moment on — no more neutral ratings for me. \u00a0I started using 4-point scales and 8-point scales. \u00a0It was actually a freeing experience and when I told my clients why I was doing it, they jumped on board as well. “YEAH! \u00a0Damn straight! \u00a0We are NOT giving you a neutral option because you either fall positive or negative – no neutral here!”<\/p>\n

Yes, we do this knowing that respondents like neutrals and lots and lots of very smart people will snicker and chastise us. \u00a0But because we want to make certain decisions, we have taken the risk of forcing respondents to fall one way or the other.<\/p>\n

And now for your own survey measurement scale revolution<\/h2>\n

There. \u00a0I’ve given you my reasons for changing how I look at scales — now I’m going to give you a few other facts that might get you thinking about changing the measurement scales<\/a> you use in your online surveys.<\/p>\n

Here’s an excerpt I found really interesting. \u00a0Unfortunately if you want the references, you’ll have to ask the author<\/a>.<\/p>\n

More than seven points on a scale are too much.<\/strong>\u00a0Studies show that people are not able to place their point of view on a scale greater than seven. So go for seven or less. What is the perfect number? Studies are not conclusive on this, most commonly mentioned are five, four or three point scales.<\/p>\n

Numbered scales are difficult for people.<\/strong>\u00a0For example, scales that are marked \u201c1 to 5, with 5 being the highest\u201d result in less accurate results than scales with labels such as \u201cgood\u201d or \u201cpoor\u201d. If numbered scales are used, signposts are recommended (e.g. put \u201cpoor\u201d above 1, \u201csatisfactory\u201d above 3 and \u201cexcellent\u201d above 5).<\/p>\n

Labelled scales need to be as accurate as possible.<\/strong>\u00a0Commonly uses labels such as \u201coften\u201d or \u201csometimes\u201d often result in inaccurate responses. As these terms mean different notions of engagement from person to person, culture to culture (not to add the complexity of translating these terms). Scholars recommend using time-bound labels for frequency measures such as \u201conce a week\u201d (although problems of correct recall are also an issue). In addition, studies show that people find it difficult to differentiate between \u201cvery good\u201d and \u201cgood\u201d \u2013 better to use \u201cgood\u201d and \u201cexcellent\u201d.<\/p><\/blockquote>\n

How QuestionPro’s measurement scale options help your survey results<\/h2>\n

Since the folks over at QuestionPro are used to being revolutionaries in the world of online surveys, you won’t be surprised to find out that they actually have solutions to these scaling problems and can also help you run your own revolt against the dreadfully boring and predictable Likert Scale<\/a>.<\/p>\n

Check it:<\/p>\n

Star rating scale: \u00a0<\/strong> This is one of my favorite scares mostly because it’s traditionally a 4-point scale. \u00a0And since you know my proclivity for NO NEUTRALS — it should be no surprise that this is one of my favorite options. \u00a0Who says that you only use star ratings for restaurants, books and movies? \u00a0You can use this rating scale for any satisfaction measurement including customer satisfaction, apps ratings — whatever and whenever you want to see how customers FEEL about something or the level of enthusiasm they have for a product, service or experience. \u00a0Let’s move on.<\/p>\n

Interactive sliding scale: <\/a>\u00a0Notice that some very smart people said that respondents don’t particularly care for numbers. \u00a0Well, an interactive sliding scale gives you the best of both worlds — you can create a numeric scale and the respondent gets to SLIDE along the rating bar. \u00a0This gives them a more “emotional” representation of their rating. \u00a0Another really terrific way that you can customize the rating scale is by using more descriptive rating levels. \u00a0You aren’t stuck with “Excellent, Good, Fair or Poor” consider using more fun descriptors like “LOVE it, Like it, Ho Hum. Blech” for example.<\/p>\n

Smiley Face rating scale:<\/a> \u00a0Go ahead and call me a complete dweeb, but this is one of my favorite survey scales<\/a> and QuestionPro has made some real improvements in this one. \u00a0So if you tried it in the past (like me) and were disappointed that you had to insert your own smiley faces — rejoice! \u00a0They’ve pre-programmed all the smiley faces you need here. \u00a0Again, the studies say that numbers and words don’t match respondents emotional levels enough to give you a good rating – but this is much better.<\/p>\n

Drag and drop:<\/a> \u00a0Ok, people, I know that ranking and rating are not really the same thing. \u00a0But, in the spirit of revolutionary ways to figure out how much people like something (or dislike it) I think this is a viable question type to feature here. \u00a0Instead of using ratings scales, numbers and descriptions, why not place your “rating” in the question itself. \u00a0For example, “Please rank the following search engines in order of preference from “Couldn’t live without it” to “If it were the last engine available on the planet”.<\/p>\n

WOW! \u00a0 I can’t wait to develop my next survey – How about YOU?<\/h2>\n

See how much fun creating online surveys can be ? \u00a0Don’t you just love when someone tries to put a damper on your good time, but you overcome their silliness with some super creative way to get what you want anyway?<\/p>\n

That’s why I love QuestionPro!<\/p>\n","protected":false},"excerpt":{"rendered":"

Isn’t it funny how so many things that we do are automatic; just because that’s the way it’s always been […]<\/p>\n","protected":false},"author":128,"featured_media":7205,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_genesis_hide_title":false,"_genesis_hide_breadcrumbs":false,"_genesis_hide_singular_image":false,"_genesis_hide_footer_widgets":false,"_genesis_custom_body_class":"","_genesis_custom_post_class":"","_genesis_layout":"","footnotes":""},"categories":[6,187],"tags":[284],"yoast_head":"\n3 Things You Didn't Know About Survey Measurement Scales | QuestionPro<\/title>\n<meta name=\"description\" content=\"Isn't it funny how so many things that we do are automatic; just because that's the way it's always been done? \u00a0When was the last time you stopped to\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"3 Things You Didn't Know About Survey Measurement Scales | QuestionPro\" \/>\n<meta property=\"og:description\" content=\"Isn't it funny how so many things that we do are automatic; just because that's the way it's always been done? \u00a0When was the last time you stopped to\" \/>\n<meta property=\"og:url\" content=\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\" \/>\n<meta property=\"og:site_name\" content=\"QuestionPro\" \/>\n<meta property=\"article:publisher\" content=\"https:\/\/www.facebook.com\/questionpro\" \/>\n<meta property=\"article:published_time\" content=\"2013-08-26T13:00:25+00:00\" \/>\n<meta property=\"article:modified_time\" content=\"2023-11-07T05:05:41+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2013\/05\/bad-decision.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"490\" \/>\n\t<meta property=\"og:image:height\" content=\"368\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"author\" content=\"Ivana Taylor\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:creator\" content=\"@questionpro\" \/>\n<meta name=\"twitter:site\" content=\"@questionpro\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Ivana Taylor\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"6 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/#article\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\"},\"author\":{\"name\":\"Ivana Taylor\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244\"},\"headline\":\"3 Things You Didn’t Know About Survey Measurement Scales\",\"datePublished\":\"2013-08-26T13:00:25+00:00\",\"dateModified\":\"2023-11-07T05:05:41+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\"},\"wordCount\":1174,\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"keywords\":[\"Best Practice\"],\"articleSection\":[\"QuestionPro Products\",\"Surveys\"],\"inLanguage\":\"en-US\"},{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\",\"name\":\"3 Things You Didn't Know About Survey Measurement Scales | QuestionPro\",\"isPartOf\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\"},\"datePublished\":\"2013-08-26T13:00:25+00:00\",\"dateModified\":\"2023-11-07T05:05:41+00:00\",\"description\":\"Isn't it funny how so many things that we do are automatic; just because that's the way it's always been done? \u00a0When was the last time you stopped to\",\"breadcrumb\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.questionpro.com\/blog\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Surveys\",\"item\":\"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"3 Things You Didn’t Know About Survey Measurement Scales\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#website\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"name\":\"QuestionPro\",\"description\":\"\",\"publisher\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\"},\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Organization\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#organization\",\"name\":\"QuestionPro\",\"url\":\"https:\/\/www.questionpro.com\/blog\/\",\"logo\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\",\"url\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"contentUrl\":\"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg\",\"caption\":\"QuestionPro\"},\"image\":{\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/\"},\"sameAs\":[\"https:\/\/www.facebook.com\/questionpro\",\"https:\/\/twitter.com\/questionpro\",\"https:\/\/www.linkedin.com\/company\/questionpro\/\"]},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244\",\"name\":\"Ivana Taylor\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g\",\"caption\":\"Ivana Taylor\"},\"description\":\"Ivana Taylor provides DIY Marketing advice, marketing trends and marketing how-to tips and strategies for small business owners and CEOs.\",\"url\":\"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"3 Things You Didn't Know About Survey Measurement Scales | QuestionPro","description":"Isn't it funny how so many things that we do are automatic; just because that's the way it's always been done? \u00a0When was the last time you stopped to","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/","og_locale":"en_US","og_type":"article","og_title":"3 Things You Didn't Know About Survey Measurement Scales | QuestionPro","og_description":"Isn't it funny how so many things that we do are automatic; just because that's the way it's always been done? \u00a0When was the last time you stopped to","og_url":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/","og_site_name":"QuestionPro","article_publisher":"https:\/\/www.facebook.com\/questionpro","article_published_time":"2013-08-26T13:00:25+00:00","article_modified_time":"2023-11-07T05:05:41+00:00","og_image":[{"width":490,"height":368,"url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2013\/05\/bad-decision.jpg","type":"image\/jpeg"}],"author":"Ivana Taylor","twitter_card":"summary_large_image","twitter_creator":"@questionpro","twitter_site":"@questionpro","twitter_misc":{"Written by":"Ivana Taylor","Est. reading time":"6 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/#article","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/"},"author":{"name":"Ivana Taylor","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244"},"headline":"3 Things You Didn’t Know About Survey Measurement Scales","datePublished":"2013-08-26T13:00:25+00:00","dateModified":"2023-11-07T05:05:41+00:00","mainEntityOfPage":{"@id":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/"},"wordCount":1174,"publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"keywords":["Best Practice"],"articleSection":["QuestionPro Products","Surveys"],"inLanguage":"en-US"},{"@type":"WebPage","@id":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/","url":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/","name":"3 Things You Didn't Know About Survey Measurement Scales | QuestionPro","isPartOf":{"@id":"https:\/\/www.questionpro.com\/blog\/#website"},"datePublished":"2013-08-26T13:00:25+00:00","dateModified":"2023-11-07T05:05:41+00:00","description":"Isn't it funny how so many things that we do are automatic; just because that's the way it's always been done? \u00a0When was the last time you stopped to","breadcrumb":{"@id":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.questionpro.com\/blog\/3-things-you-didnt-know-about-survey-measurement-scales\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.questionpro.com\/blog\/"},{"@type":"ListItem","position":2,"name":"Surveys","item":"https:\/\/www.questionpro.com\/blog\/category\/survey-software\/"},{"@type":"ListItem","position":3,"name":"3 Things You Didn’t Know About Survey Measurement Scales"}]},{"@type":"WebSite","@id":"https:\/\/www.questionpro.com\/blog\/#website","url":"https:\/\/www.questionpro.com\/blog\/","name":"QuestionPro","description":"","publisher":{"@id":"https:\/\/www.questionpro.com\/blog\/#organization"},"potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.questionpro.com\/blog\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Organization","@id":"https:\/\/www.questionpro.com\/blog\/#organization","name":"QuestionPro","url":"https:\/\/www.questionpro.com\/blog\/","logo":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/","url":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","contentUrl":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2022\/10\/questionpro-logo.svg","caption":"QuestionPro"},"image":{"@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/logo\/image\/"},"sameAs":["https:\/\/www.facebook.com\/questionpro","https:\/\/twitter.com\/questionpro","https:\/\/www.linkedin.com\/company\/questionpro\/"]},{"@type":"Person","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/5a547e9ba0ad62a9ffa6f12466a7a244","name":"Ivana Taylor","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/www.questionpro.com\/blog\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/d23fe73ba92b9a95ce057e280755df6b?s=96&d=mm&r=g","caption":"Ivana Taylor"},"description":"Ivana Taylor provides DIY Marketing advice, marketing trends and marketing how-to tips and strategies for small business owners and CEOs.","url":"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/"}]}},"featured_image_src":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2013\/05\/bad-decision.jpg","featured_image_src_square":"https:\/\/www.questionpro.com\/blog\/wp-content\/uploads\/2013\/05\/bad-decision.jpg","author_info":{"display_name":"Ivana Taylor","author_link":"https:\/\/www.questionpro.com\/blog\/author\/thirdforce\/"},"_links":{"self":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/7602"}],"collection":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/users\/128"}],"replies":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/comments?post=7602"}],"version-history":[{"count":1,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/7602\/revisions"}],"predecessor-version":[{"id":822111,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/posts\/7602\/revisions\/822111"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media\/7205"}],"wp:attachment":[{"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/media?parent=7602"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/categories?post=7602"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.questionpro.com\/blog\/wp-json\/wp\/v2\/tags?post=7602"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}