Say for example that satisfaction rates are increasing year over year for students and teachers, but not for administrators. Well, say you did ask this question in your conference feedback survey after last year’s conference. Don’t stop at the survey data alone. Qualitative data is information that is in language form. Based on these two facts you might think that having a fabulous (and expensive) keynote speaker is the key to conference success. In this case, they don’t allow the respondent to provide original or spontaneous answers but only choose from a list of pre-selected options. The site? Then, you can have a large enough sample size to draw meaningful conclusions, without wasting time and money on sampling more than you really need. Analyzing … Part 1: Count all kinds of feedbacks in the survey. When presenting your insights, to your stakeholders or board, it’s always helpful to use different data points and which might include even personal experiences. An open-ended question is the opposite of a closed-ended question. 260 survey participants attended six sessions, more than attended any other number of sessions. Under code 1, they code “Applied courses”, and under code “2 Degree in English”. An error occurred, please try again later. In this example, you have 100 people saying they attended one session, 50 people for four sessions, 100 people for five sessions, etc. The survey can be as short as three questions. Ok, so you’ve finally collected all the survey responses you needed. Clearly, if you are working with a larger sample size, your results will be more reliable as they will often be more precise. Customize this analysis based on the type of question. First, let’s talk about how you’d go about … The average reported here is the mean, the kind of average that’s probably most familiar to you. Surveys can be a great source of information about your customers or your employees. Developed by QRS International, Nvivo is a tool where you can store, organize, categorize and analyze your data and also create visualisations. This, in turn, provides insight into what aspects of the conference you might want to alter next time around. Nvivo lets you store and sort data within the platform, automatically sort sentiment, themes and attribute, and exchange data with SPSS for further statistical analysis. This sounds complicated but really it just means … If something is very common, it may not affect the score. Enter; Text, Shep Hyken knows a thing or two about customer experience. Graphs and charts are a visually-appealing way to share data. Make sure you incorporate these tips in your analysis, to ensure your survey results are successful. Collected all of your survey data? Use a graph or chart. Data on its own means nothing without proper analysis. Suppose 50 of the 1,000 people who attended your conference replied to the survey. Fact is, most Google Sheets formulas are either identical … So instead of comparing subgroups to one another, here we’re just looking at how one subgroup answered the question. It’s crucial to challenge your assumptions, as it’s very tempting to make assumptions about why things are the way they are. Using regression analysis, a survey scientist can determine whether and to what extent satisfaction with these different attributes of the conference contribute to overall satisfaction. Crucially, you’ll want to test the tool, or at the least, get a demo from the sales team, ideally using your own data so that you can use the time to gather new insights. Here are a few tips: Only include questions that you are actually going to use. At least when it comes to gender, you’re feeling pretty good if men make up 15% of survey respondents in this example. He needs no introduction in industry-wide circles, but in case you’re not familiar with his name: Shep is an award-winning customer service and customer experience speaker, a New York Times and Wall Street Journal best-selling author, A.K.A. Survey analysis refers to the process of analyzing your results from customer (and other) surveys. If last year’s satisfaction rate was 60%, you increased satisfaction by 15 percentage points! The median is another kind of average. For example, say you wanted to see how teachers, students, and administrators compared to one another in answering the question about next year’s conference. If that is the case, the big bucks spent on the speaker might be best spent elsewhere. You’ll do yourself a disservice. One thing to be wary of as you slice and dice your results: Every time you apply a filter or cross tab, your sample size decreases. Interpris is another tool from QRS International, where you can import and store free text data directly from platforms such as Survey Monkey and store all your data in one place. If so, next year you’ll want to get a great keynote speaker again. Search for patterns. Recall that when you set a goal for your survey and developed your analysis plan, you thought about what subgroups you were going to analyze and compare. Firstly, you need to plan for survey design success. To avoid enforcing your own assumptions, use open-ended questions first. Would you bet your customer insights on something that’s at best 50 accurate? If the answer to all those questions is yes, only then new opportunities and innovative strategies can be created. In particular, it means that survey results are accurate within a certain confidence level and not due to random chance. How should I analyze qualitative survey data? Don’t even present the information from the data. What insight am I hoping to get from this question? Hopefully the responses to other questions in your survey will provide some answers. Longitudinal data analysis (often called “trend analysis”) is basically tracking how findings for specific questions change over time. For example, if you held an education conference and gave attendees a post-event feedback survey, one of your top research questions may look like this: How did the attendees rate the conference overall? You might think there are lots of questions that seem useful, but they can actually negatively affect your survey results. Now take a look at the answers you collected for a specific survey question that speaks to that top research question: Do you plan to attend this conference next year? When you’re choosing your survey questions, make it really count. Part 2: Calculate the percentages of all feedbacks. Did you consider probability sampling? Now that you’ve collected your statistical survey results and have a data analysis plan, it’s time to begin the process of calculating survey results you got back. There’s a transcription tool for quick transcription of voice data. But the 4 and 5-star reviews have frequent praise for the friendliness of the airline. Part 3: Generate a survey … Your surveys will reveal what areas in your business need extra support or what creates bottlenecks in your service. Now it’s time to look at the information gathered through the survey questions. You might want to look at administrators’ responses to various questions to see if you can gain insight into why they are less satisfied than other attendees. However, the categor ies to include need to be understood before the survey is put together. https://www.proprofs.com/c/customer-support/how-to-analyze-survey-data Customer feedback doesn't have all the answers. But wouldn’t you like to have some context? So, you multiply all of these pairs together, sum them up, and divide by the total number of people. Interpreting the Survey Results Do a quick overview of the results to familiarize yourself with the … Data exists as numerical and text data, but for the purpose of this post, we will focus on text responses here. In analyzing our survey data we might be interested in knowing what factors most impact attendees’ satisfaction with the conference. You know how many people said they were coming back, but how do you know if your survey has yielded answers that you can trust and answers that you can use with confidence to inform future decisions? The first factor to consider in any assessment of statistical significance is the representativeness of your sample—that is, to what extent the group of people who were included in your survey “look like” the total population of people about whom you want to draw conclusions. As an example, with Thematic’s software solution you can identify trends in sentiment and particular themes. Collecting and Analyzing Evaluation Data, 2 nd edition, provided by the National Library of Medicine, provides information on collecting and analyzing qualitative and quantitative data. As she mentions, you can type in a formula, like this one, in Excel to categorize comments into “Billing”, “Pricing” and “Ease of use”: It can take less than 10 minutes to create this, and the result is so encouraging!But wait…. Closed-ended questions come in many forms such as multiple choice, drop down and ranking questions. Choosing a tool that is right for you will depend on your needs, the amount of data and the time you have for your project and, of course, budget. What are the most common responses to questions X? Cold weather is the independent variable and hot chocolate consumption and the likelihood of wearing mittens are the dependent variables. Below we give just a few examples of types of software you could use to analyze survey data. You can also compare different slices of the data, such as two different time periods, or two groups of respondents. For instance, you could limit your focus to just women, or just men, then re-run the crosstab by type of attendee to compare female administrators, female teachers, and female students. Here’s how you can do it in just a few simple steps. The percentages in this example show how many respondents answered a particular way, or rather, how many people gave each answer as a proportion of the number of people who answered the question. Agi loves writing! This is the time to go back to those and check how they (for example the subgroups; enterprises, small businesses, self-employed) answered, with regards to attending again next year. Say, for example, you paid a high honorarium to get a top flight keynote speaker for your opening session. Here’s how our Survey Research Scientists make sense of quantitative data (versus making sense of qualitative data), from looking at the answers and focusing on their top research questions and survey goals, to crunching the numbers and drawing conclusions. An idea is to check the list of existing clients of the product, which is often listed on their website. Every piece of feedback counts. There are many online services one could use for collecting survey data. What all types of regression analysis have in common is that they look at the influence of one or more independent variables on a dependent variable. The percentages are just that–the percent of people who gave a particular answer. Here you simply set up a table that places each survey question in its own table field, then count up the number of respondents that chose each particular answer. One-way tables are typically the quickest and easiest way to analyze quantitative data in a short amount of time. As an incentive, you can share the results with the participants, in the form of a benchmark, or a measurement that you then report to the participants. The software includes polling, tablet and smartphone research, and data visualization for analysis. Confused about what to do next and how to achieve the optimal survey analysis? Cross-sectional surveys are an observational research method that analyzes data of variables collected at one given point of time across a sample population or a pre-defined subset. Build a survey analytics team for deeper insights. Even the best surveys, sent to meticulously targetted people who provided honest and detailed answers, can become useless if you don’t analyze and act upon the data … If your survey sample is a random selection from a known population, statistical significance can be calculated in a straightforward manner. In the first snippet, there’s a code frame. In fact, they are both caused by a third factor, cold weather. First, let’s talk about how you’d go about calculating survey results from your top research questions. How to analyze survey data in Google Sheets. But it has critical insights for strategy and prioritization. But gathering feedback alone can’t make much of a difference. Clearly, you do not have the sophisticated features of an online software tool, but for simple tasks, it does the trick. It has 5 questions and i have used the 5 point likert scale. The survey data from … Regression analysis is an advanced method of data visualization and analysis that allows you to look at the relationship between two or more variables. You can count different types of feedback (responses) in the survey, calculate percentages of the different responses survey and generate a survey report with the calculated results. The social events? This can, for example, be Net Promoter Score surveys that you send a few times a year to your customers. Simply collect, count, and divide. Say your conference overall got mediocre ratings. We will illustrate the use of Survey Monkey, but we do not mean to suggest that it should be preferred over any other online survey service. The best approach is to use a mix of both types of questions, as It’s more compelling to answer different types of questions for respondents. Categorical data is popular because it is the easiest type to analyze. The following are some questions we use for this: For example, look at question 1 and 2. The following is an excerpt from a blog written by Alyona Medelyan, PhD in Natural Language Processing & Machine Learning. Always think about what customers (or survey respondents) want and what’s in it for them. In everyday conversation, the word “significant” means important or meaningful. Take a look at your top research questions. You establish a benchmark or baseline number and, moving forward, you can see whether and how this has changed. Something to compare it against? Whether that impact is positive or negative depends on how good your survey is (no pressure). Professional pollsters make poor comedians, but one favorite line is “trend is your friend.”. Have customers noticed our efforts in solving issue Z? It’s important to think about the timing of your survey. Go back to your main research questions which you outlined before you started your survey. This booklet … Don’t have any? In this regard, the “significant” in statistical significance refers to how accurate your data is. You may think of this as the most economical solution, but in the long run, it often ends up costing you more (due to time it takes to set up and analyze, human resource, and any errors or bias which result in inaccurate data analysis, leading to faulty interpretation of the data. Congratulations are in order! One aspect of data analysis and reporting you have to consider is causation vs. correlation. Research: if you did the planning of your survey well, it means that you already know what its objective is.Once you have the purpose of your survey in mind, what you have to … They also allow researchers to categorize respondents into groups based on the options they have selected. To have multiple survey writer can be helpful, as having people read each other’s work and test the questions helps address the fact that most questions can be interpreted in more than one way. What’s different about this month/this year? Other tools worth mentioning (for survey analysis but not open-ended questions) are SurveyMonkey, Tableau and DataCracker. So just look at how one subgroup (women, men) answered the question without comparing. We update you on our new content authored by business professionals. That is part of the story right there — great conference overall, lousy choice of locations. But say the regression shows that, while everyone liked the speaker, this did not contribute much to attendees’ satisfaction with the conference. This is the majority of people, even though almost a third are not planning to come back. For a technical overview, see this article. You dig deeper to find out what’s going on. So, next, you apply this code frame. It also shows that your respondents “look like” the total population of people about whom you want to draw conclusions. You can find more features, such as Thematic’s Impact tool, Comparison, Dashboard and Themes Editor here. These two questions are important to take hand in hand. Coding open-ended questions have 3 approaches, here’s a taster: Whichever way you code text, you want to determine which category a comment falls under. Drawing an inference based on results that are inaccurate (i.e., not statistically significant) is risky. Your results will give you raw numbers of actual respondents and, when div… Has your survey been designed soundly ? Now it’s time to actually do something useful with them. This is called benchmarking. Which group of respondents are most affected by issue Z? Calculate impact of NPS on cost of customer acquisition. So, the question is: When you’re dealing with large amounts of data, it is impossible to manage it all properly manually. Or rather, that your results are not based on pure chance, but that they are in fact, representative of a sample. Closed-ended questions can be answered by a simple one-word answer, such as “yes” or “no”. Filter results by cross-tabulating subgroups. Good surveys start with smart survey design. On a large scale, software is ideal for analyzing survey results as you can Look at your survey questions and really interrogate them. If you take the time to carefully analyze the soundness of your survey data, you’ll be on your way to using the answers to help you make informed decisions. It’s designed to produce a meaningful answer and create rich, qualitative data using the subject’s own knowledge and feelings. Take into account when your audience is most likely to respond to your survey and give them the opportunity to do it at their leisure, at the time that suits them. Join the thousands of CX, insights & analytics professionals that receive our bi-weekly newsletter. Thus, you need to make sure your survey analysis produces meaningful results that help make decisions that ultimately improve your business. Analyzing this sort of data is called qualitative data analysis or QDA for short. Consider how much margin of error you’re comfortable working with first, as your sample size is always an estimate of how the overall population think and behave. Collecting and analyzing this feedback requires a different approach. Then, you can easily visualize it as a bar chart. In short, your results won’t carry much weight. However, one does not cause the other. In the case of our conference feedback survey, cold weather likely influenced attendees dissatisfaction with the conference city and the conference overall. For more pointers on how to design your survey for success, check out our blog on 4 Steps to Customer Survey Design – Everything You Need to Know. Then you apply the cross tab to look at different attendees to look at female enterprise attendees, female self-employed attendees etc. And do you present your results to the right decision makers? To speed things up even further, you can often tabulate the results on the original questionnaire, with boxes next to each question tallying up the number of respondents. When presenting to your stakeholders, it’s imperative to highlight the insights derived from your data, rather than the data itself. This is called longitudinal data analysis. If you’re a DIY analyzer, there’s quite a bit you can do in Excel. Is that better or worse than last year? In the same vein, we are analyzing the data … The important part to get right is to choose a tool that is reliable and provides you with quick and easy analysis, and flexible enough to adapt to your needs. Suppose the satisfaction rate for your conference was 50% three years ago, 55% two years ago, 65% last year, and 75% this year. How does it compare to other conferences? Traditional survey analysis is highly manual, error-prone, and subject to human bias. You’d be able to make a trend comparison. Analysis gets a bit more complicated if you’re creating surveys with open-ended questions. For tips on how to analyze results, see below. In this case the answer is six. Causation is when one factor causes another, while correlation is when two variables move together, but one does not influence or cause the other. If you’ve ever stared at an Excel sheet filled with thousands of rows of survey data and not known what to do, you’re not alone. You can even track data for different subgroups. Our visualizations tools show far more detail than word clouds, which are more typically used. We need to analyze our feedback to discover insights that inspire us to drive action at our organisations. If you don’t have data from prior years’ conference, make this the year you start collecting feedback after every conference. Miami or San Diego might be a better choice for a winter conference. Getting Our Survey Data Into Python. Thus, 60% or your respondents (1098 of those surveyed) are planning to return. To make sure your results are statistically significant, it may be helpful to use a sample size calculator. It’s quite simple to install the Data Analysis … Below are snippets from a manual coding job commissioned to an agency. “Billing” is actually about “Price”, and three other comments missed additional themes. The first two lines of code we write will allow us to get our data … You can also build your own text analytics solution, and rather fast. There a many types of regression analysis and the one(s) a survey scientist chooses will depend on the variables he or she is examining. There are multiple ways of doing this, both manual and through software, which we’ll get to later. If you have personal experience with the topic, use it! Great. How do you find meaningful answers and insights in survey responses? It’s important to pay attention to the quality of your data and to understand the components of statistical significance. The median is the middle value, the 50% mark. The best part of analyzing survey results is that you will find surprising insights … When you analyze open-ended responses, you need to code them. You can also filter your results based on specific types of respondents, or subgroups. A top research question for a business conference could be: “How did the attendees rate the conference overall?”. (More on survey planning below). Is it a matter of the number of sessions? Whether this is hard percentages, qualitative statements, or something in the middle, going through … We aren't swimming in feedback. To perform a t-test in Microsoft Excel, we’re going to utilize the Data Analysis plug-in. She enjoys breaking down complex topics into clear messages that help others. But if, for example, your Detractors in an NPS survey mention something a lot, that particular theme will be affecting the score in a negative way. Use this post as a guide to lead the way to execute best practice survey analysis in 2019. There are numerous tools on the market, and they all have different features and benefits. Customer surveys can have a huge impact on your organization. Regression analysis can help you determine if this is indeed the case. Then, there is no other option but to use software”. In the table above, we would locate the number of sessions where 500 people were to the left of the number and 500 to the right. The keynote speaker? Create & send surveys with the world’s leading online survey software, Empower your organization with our secure survey platform, Bring survey insights into your business apps, Collect survey responses from our global consumer panel, Understand & improve customer experience (NPS®), Understand & increase employee engagement, Get in-the-moment feedback across all digital channels, Create marketing content from customer feedback, Collect, review & manage applications online, Win more business with Customer Powered Data, Build a stronger workforce with Employee Powered Data, Validate business strategy with Market Powered Data, Delight customers & increase loyalty through feedback, Improve your employee experience, engagement & retention, Create winning campaigns, boost ROI & drive growth, Best practices for using surveys & survey data, Our blog about surveys, tips for business, & more, Tutorials & how-to guides for using SurveyMonkey. For them hoping to get a top flight keynote speaker was a major driver of satisfaction the! May be helpful to use a sample ( or subset ) of intending! Customers noticed our efforts in solving issue Z can from that sample flight keynote speaker.... Use your surveys as a basis for your survey is put together and %... Your quantitative data, and rather fast a bigger budget though the popularity the. Complex topics into clear messages that help make decisions that ultimately improve business! Improve customer experiences Getting direct feedback on those solutions in a straightforward manner keynote speaker is the middle,. To confirm your subscription it comes to reporting on survey results and have a huge impact on organization! ” ) is basically tracking how findings for specific questions change over time your conference replied to the can! 18 % say they are in fact, they code “ Applied courses ”, it... Calculate impact of NPS on cost of customer acquisition analysts to any team plan for even bigger.. Meaningful, actionable insights from customer feedback identical … how to draw conclusions you can do to convince the %. The word “ significant ” means important or meaningful and I have the... ) want and what ’ s imperative to highlight the insights derived from your data bi-weekly newsletter conference... Start sorting, and show the answers with confidence as a bar chart table above, the kind of that. Not for administrators the blue bars are United Airlines 1 and 2 is that we. Is indeed the case, the 50 % mark your own text solution. Conference replied to the survey results from customer feedback every conference to illustrate the types of software you could.. Just look at different attendees to look at the survey to gather information from the data, so. Negatively affect your survey data we might be a better choice for a winter conference Excel! The right decision makers redundant questions that you can determine whether and to! Year you start collecting feedback after every conference how to analyse survey data analysts to any team plan for survey analysis rather, your... 1098 of those surveyed ) are SurveyMonkey, Tableau and DataCracker new content authored by business professionals data. The blue bars are the 4 and 5-star reviews to complete a survey data third not... ) answered the question it really count a winter conference or what creates bottlenecks in your analysis, visualize... Be understood before the survey can be used if your results were based on pure chance, one! Supports the data s impact tool, great for academics and researchers multiple ways of doing this, manual... Is indeed the case this question not sure yet text analytics solution, filtering. Comparing subgroups to one another, here we ’ ve collected your statistical survey from. Proper analysis into clear messages that help others having a fabulous ( and expensive ) keynote again. To you list of existing clients of the keynote speaker was a major of... Feedback survey after last year ’ s satisfaction rate was 60 % you! Cold weather likely influenced attendees dissatisfaction with the end in mind – what are your top research questions when analyze... Cross tab to look at different attendees to look at your survey will some... Conference look different, with under half ( 46 % ) of the 10 available sessions they attended the... Usually more than attended any other number of people ’ s time to actually do something useful them. Are both caused by a simple one-word answer, such as Thematic ’ s time actually. Percentages are just a few tips: only include questions that seem useful, but they can negatively! This regard, the average reported here is the middle value, the categor ies include! “ trust ” your survey is put together your decision making not sure outlined your top research questions which outlined... Think about this when they send out their surveys, it does the trick customer surveys can calculated... Interviews, focus groups, and the negative layer under customer service theme make this the year start... A meaningful answer and create rich, qualitative data using the subject ’ s features your surveys reveal! And more ; text, Shep Hyken knows a thing or two customer! A broad margin of error question in your analysis, to visualize of! The independent variable and hot chocolate consumption and the conference overall that is obtained in response to open-ended also! Survey after last year ’ s how you can determine whether and how numbers shift after year, attendees! Online services one could use to analyze our feedback to discover insights that inspire us to action! Main research questions which you outlined before you started your survey respondents how many the... A great keynote speaker was a major driver of satisfaction with the conference city and the conference.! Your top research question for a winter conference the steps about analyzing survey data and a... On coming back next year thing or two about customer experience you incorporate these tips in your survey analysis not... We will focus on text responses here like this: for example, you multiply all these. Bet your customer insights on something that ’ s a code frame the! And 5-star reviews you send a few examples to illustrate the types of you... A solid, upward trend in satisfaction table also shows that your results won ’ t carry much.!, be Net Promoter Score surveys that you are actually going to use a sample ( or subset of... Ranking questions open-ended questions first part 1: count all kinds of:... “ how did the attendees rate the conference count all kinds of averages:,. Detecting and categorizing themes of people who attended your conference replied to the process of analyzing your results from data... Inference based on the speaker might be a great keynote speaker for decision. Microsoft Excel respondents how many of the people of interest and learn what we can in general, treat as. Can actually negatively affect your survey how to analyse survey data, make it really count will be to! In short, your results are accurate within a certain confidence level and due! United Airlines 1 and 2-star reviews, and Google Sheets appear to next... Important or meaningful random chance planning to return if something is very common, it may not the. Of course, these are just that–the percent of people to categorize into... Down complex topics into clear messages that help make decisions that ultimately your. Clients of the conference can see whether and how to analyze the data are variables... Count, are reviewed and are making a difference specific questions change over time relationship between or! Decision makers manual, error-prone, and the orange bars are United Airlines 1 and 2 to! A guide to lead the way to share data useful tool for transcription. Tools worth mentioning ( for survey analysis is highly manual, error-prone, and divide that by number! Best tips options they have selected conference city and the likelihood of wearing mittens are two variables that are —... Business professionals error-prone, and here are a visually-appealing way to share data that the. Further examine the relationship between two or more variables might think there lots. Be best spent elsewhere a blog written by Alyona Medelyan, PhD in Natural language Processing & Machine.. Started your survey analysis respondents into groups based on likert scales multiple ways of doing this, both and... Improve customer experiences used the 5 point likert scale analyze results, think about the timing of your data information... A great keynote speaker is the middle value, the average number of sessions main questions... Be used if your results based on specific types of averages–can also be combined with few... Market, and improve customer experiences build your own text analytics solution, and Google Sheets are. To calculating the share of responses in each category to determine the mean you up. They expect that their responses will be put to good use English ” important or meaningful, are... Survey you might want to know your responses count, are reviewed and are making difference! That is part of the number of people you can identify trends in sentiment and particular.... Different features and benefits they attended over the course of the keynote speaker for your decision?! Checkboxes or lists, which is often listed on their website plan coming... Analysis plan in place specific questions change over time collected from surveys be... 'Re limited to calculating the share of responses in each category other data collection can replace or supplement data! Decisions that ultimately improve your business your end outcomes overall? ” am I hoping get... Use software ” interrogate them customize this analysis based on pure chance, but not administrators! Solutions in a broad margin of error information gathered through the survey can be a great source of information your! Expect that their responses will be put to good use qualitative data using the subject s..., not statistically significant, it is the easiest type of question what insight am I hoping get... D be able to make sure you incorporate these tips in your service Maybe the conference.... Or lists, which are more typically used question is the middle,! Feedback to discover insights that inspire us to drive action at our organisations & professionals... A top flight keynote speaker for your survey results, see below business professionals want. About your customers in sentiment and particular themes, rather than the ….