Why is it important to determine the sample size?
Are you ready to survey your research target? Research surveys help you gain insights from your target audience. The data you collect gives you insights to meet customer needs, leading to increased sales and customer loyalty. Sample size calculation and determination are imperative to the researcher to determine the right number of respondents, keeping in mind the research study’s quality.
So, how should you determine the sample size? How do you know who should get your survey? How do you decide on the number of the target audience?
Sending out too many surveys can be expensive without giving you a definitive advantage over a smaller sample. But if you send out too few, you won’t have enough data to draw accurate conclusions. Knowing how to calculate and determine sample size accurately can give you an edge over your competitors. Let’s take a look at what a good sample includes. Also, let’s look at the sample size calculation formula so you can determine the perfect sample size for your next survey.
What is ‘sample size’?
‘Sample size’ is a market research term used for defining the number of individuals included to conduct research. Researchers choose their sample based on demographics, such as age, gender, or physical location.
Samples can be vague or specific. For example, you may want to know what people within the 18-25 age range think of your product. Or, you may only require your sample to live in the United States, which gives you a wide range of the population. The total number of individuals in a particular sample is the sample size.
Why do you need to determine sample size?
Let’s say you are a market researcher in the US and want to send out a survey or questionnaire. The purpose of the survey is to understand your audience’s feelings toward a new cell phone you are about to launch. You want to know what people in the US think about the new product to predict the phone’s success or failure before launch.
Hypothetically, you choose the population of New York, which is 8.49 million. You use a sample size determination formula to select a sample of 500 individuals that fit into the consumer panel requirement. You can use the responses to help you determine how your audience will react to the new product.
However, knowing how to determine a sample size requires more than just throwing your survey at as many people as you can. If your sample size is too big, it could waste resources, time, and money. A sample size that’s too small doesn’t allow you to gain maximum insights, leading to inconclusive results.
What are the terms used around the sample size?
Before we jump into sample size determination, let’s take a look at the terms you should know:
- Population size: Population size is how many people fit your demographic. For example, you want to get information on doctors residing in North America. Your population size is the total number of doctors in North America. Don’t worry! Your population size doesn’t always have to be that big. Smaller population sizes can still give you accurate results as long as you know who you’re trying to represent.
- Confidence level: Confidence level tells you how sure you can be that your data is accurate. It is expressed as a percentage and aligned to the confidence interval. For example, if your confidence level is 90%, your results will most likely be 90% accurate.
- The margin of error (confidence interval): When it comes to surveys, there’s no way to be 100% accurate. Confidence intervals tell you how far off from the population means you’re willing to allow your data to fall. A margin of error describes how close you can reasonably expect a survey result to fall relative to the real population value.
- Standard deviation: Standard deviation is the measure of the dispersion of a data set from its mean. It measures the absolute variability of a distribution. The higher the dispersion or variability, the greater the standard deviation and the greater the magnitude of the deviation. For example, you have already sent out your survey. How much variance do you expect in your responses? That variation in response is the standard of deviation.
Sample size calculation formula – Learn how to determine a sample size
With all the necessary terms defined, it’s time to learn how to determine sample size using a sample calculation formula.
Your confidence level corresponds to a Z-score. This is a constant value needed for this equation. Here are the z-scores for the most common confidence levels:
90% – Z Score = 1.645
95% – Z Score = 1.96
99% – Z Score = 2.576
If you choose a different confidence level, various online tools can help you find your score.
Here is an example of how the math works, assuming you chose a 90% confidence level, .6 standard deviation, and a margin of error (confidence interval) of +/- 4%.
((1.64)2 x .6(.6)) / (.04)2
( 2.68x .0.36) / .0016
.9648 / .0016
603 respondents are needed and that becomes your sample size.
How is a sample size determined?
Determining the right sample size for your survey is one of the most common questions researchers ask when they begin a market research study. Luckily, sample size determination isn’t as hard to calculate as you might remember from an old high school statistics class.
Before you can calculate your sample size, make sure you have these things in place:
- Goals and objectives: What do you hope to do with the survey? Are you planning on projecting the results onto a whole demographic or population? Do you want to see how a specific group thinks? Are you trying to make a big decision or just set a direction?
If you’re going to be projecting your survey results on a larger population, the sample size is critical. You’ll want to make sure that it’s balanced and reflects the community as a whole. If you’re trying to get a feel for preferences, then the sample size isn’t as critical.
For example, you’re surveying homeowners across the US on the cost of cooling their homes in the summer. A homeowner in the South probably spends a lot more money, cooling their home in the humid heat than someone in Denver, where the climate is more dry and cool. For the most accurate results, you’ll need to get responses from people in all US areas and environments. If you only collect responses from one extreme, such as the warm South, your results will be skewed.
- Precision level: How close do you want the survey results to mimic the true value if everyone responded? Again, if this survey will determine how you’re going to spend millions of dollars, then your sample size determination should be exact. The more accurate you need to be, the larger sample you’re going to want to have, and the more your sample will have to represent the overall population. If your population is small, say, 200 people, you may want to survey the entire population rather than cut it down with a sample.
- Confidence level? Think of confidence from the perspective of risk. How much risk are you willing to take on? This is where your Confidence Interval numbers become important. How confident do you want to be — 98% confident, 95% confident? Understand that the confidence percentage you choose has a big impact on the number of completions you’ll need for accuracy. This can increase the survey’s length and how many responses you need, which means increased costs to your survey. Knowing the actual numbers and amounts behind percentages can help make more sense of your sample size needs vs. survey costs. For example, you want to be 99% confident. After using the sample size determination formula, you find you need to collect an additional 1000 respondents. This, in turn, means you’ll be paying for samples or keeping your survey running for an extra week or two. You have to determine if the increased accuracy is more important than the cost.
- Population variability: What variability exists in your population? In other words, how similar or different is the population?
If you are surveying consumers on a broad topic, you may have lots of variations. You’ll need a larger sample size to get the most accurate picture of the population.
However, if you’re surveying a population with similar characteristics, your variability will be less, and you can sample fewer people. More variability equals more sample, and less variability equals less sample. If you’re not sure, you can start with 50% variability.
- Response rate: You want everyone to respond to your survey. Unfortunately, every survey comes with targeted respondents who either never open the study or drop out halfway. Your response rate will depend on how engaged your population is with your product, service organization, or brand. The higher the response rate, the higher the level of engagement from your population. Your base sample size is the number of responses you must get for a successful survey.
- Consider Your audience: In addition to the variability within your population, you need to make sure your sample doesn’t include people who won’t benefit from the results. One of the biggest mistakes you can make in sample size determination is forgetting to consider your actual audience. You don’t want to send a survey asking about the quality of local apartment amenities to a group of homeowners, for example.
- Focus on your survey’s objectives: You may start with general demographics and characteristics, but can you narrow those characteristics down even more? Narrowing down your audience makes it easier to get a more accurate result from a small sample size. For example, you want to know how people will react to new automobile technology. Your current population includes anyone who owns a car in a particular market. However, you know your target audience is people who drive cars that are less than five years old. You can remove anyone with an older vehicle from your sample because they’re unlikely to purchase your product.
Once you know what you hope to gain from your survey and what variables exist within your population, you can decide how to calculate the sample size. Using the formula for determining sample size is a great starting point to get accurate results. After calculating your sample size, you’ll want to find a reliable survey software platform to help you accurately collect survey responses and turn them into analyzed reports.
Tips to increase response rates
To meet the goal of your survey, you may have to try a few methods to increase the response rate, such as:
- Increase the list of people who receive the survey.
- Use multiple distribution channels, such as SMS surveys, website surveys, and email surveys, to reach a wider audience.
- Send reminders to survey participants to complete the survey.
- Offer incentives for completing the survey, such as an entry into a prize drawing or a discount on the respondent’s next order.
- Consider your survey structure and find ways to make your questions more straightforward. The less work someone has to do to complete the survey, the more likely they will finish it. Longer surveys tend to have lower response rates due to the length of time it takes to complete the survey. In this case, you can reduce the number of questions in your survey to increase responses.