Generating an Analysis Report
Description: Describes how to generate an Analysis Report from the Results Tab of a survey.
You can generate a survey's Results Analysis Report from the Results tab. For more information generating a results report, see View Survey Results.
The report properties of a report are configured on the Confirm Report Properties page of the report process.
- On the Results tab, click Continue.
The Confirm Report Properties page displays.
You can select from the following report properties:
- Introduction - Includes an introduction page at the beginning of the report (right after the cover page) which outlines the report contents.
- Results Analysis - Includes the results analysis and response breakdown for the responses to each question in your survey.
- Confidence intervals - Includes confidence intervals in the response breakdown analysis.
- Correlation analysis - Wherever possible, includes a correlation analysis which highlights statistical links between responses.
- Answers to open-ended questions - Includes the text users entered in response to open-ended questions.
- Questionnaire - Includes a copy of the original questionnaire at the end of the report.
- Notes - Includes a Notes section at the end of the report providing reference information about the analysis performed.
- Completed Questionnaires - Includes a copy of each completed questionnaire at the end of the report. Note that if you have a large number of responses or a very large survey it is recommended that you do NOT check this option as it will greatly increase the size of your report.
When viewing the report, there are active links that enable you to drill into and customize the data. The following are the active links in the report.
- Filter - Brings up a screen where you can select an answer you want to include in the report in order to drill into a subset of answers.
- Show/Hide - A toggle for displaying or not displaying open-ended questions (i.e. Text Box). Clicking this will toggle between showing or hiding the open-ended text for all questions in the report.
Bar Graph Confidence Intervals
The bar graphs presented in the Results Analysis section include 95% confidence intervals to illustrate the degree of precision available in your results. For example, in the following graph 54.2% (160/295) of the respondents indicated they will vote Democrat vs. 45.8% (135/295) Republican.
However, because the survey is based on the results of only 295 respondents, the actual percent of people who will vote Democrat could be somewhat higher or lower than 54.2%. Confidence intervals tell you how much higher or lower the percent could be. The I-bar shows, and the tip of each bar illustrates, the spread between the lowest and highest value you are likely to see if you were to survey the entire population. In the example above, you can be 95% certain that the actual percent of people who will vote Democrat will be between 48% and 60%. Furthermore, somewhere between 40% and 52% of people will vote Republican. As you increase the number of respondents the range of uncertainty shrinks.
Each bar graph group is followed by the text "Confidence:" and a percentage. This number is the largest confidence interval found on any of the bars in the group and can be used as a summary measure of precision. The more precise, non-symmetrical confidence intervals are illustrated separately on each bar.
Some bar graph groups are followed by the text "Average Score:" and a number that represents the weighted average of all options chosen by the respondents. For example, if you asked respondents to rate their satisfaction on a scale including Very satisfied, Satisfied, Neutral, Dissatisfied, and Very dissatisfied and half responded Very satisfied and half responded Satisfied, the average score would be 1.5--half chose the first option (score=1) and half chose the second option (score=2), so the average score is 1.5.
The answers to two questions are correlated when they tend to move together. For example, if you ask respondents to rate their overall satisfaction with your company and also ask if they are likely to purchase from your company again, the answers to these questions will probably show a strong correlation. That is, when satisfaction is high, the likelihood of repeat purchase is high. This is a positive correlation. Some question pairs have negative correlation. For example, the time a person spends on hold when calling for support usually has a negative correlation with overall satisfaction. Correlation is presented as a number from -1 to 1 where -1 is perfect negative correlation, 0 is no correlation, and 1 is perfect positive correlation.
When a statistically significant correlation between the answers of any two questions is found the report will include a note highlighting the correlation. This information can be used to gain insight into what factors drive key measures such as overall satisfaction.
Probability Density Function
For Number Box questions, a Probability Density Function graph will be shown as part of the analysis. The graph shows the distribution of numeric answers submitted for the question. Here is an example of a Probability Density Function graph.
In the graph above we can see that the average (i.e. mean) of responses is around 100 and the responses follow a typical bell-shaped (i.e. normal) distribution.
For Number Box questions, a Cumulative Distribution graph will be shown as part of the analysis. The graph shows the cummulative probabilities for answers to the questions. Here is an example of a Cumulative Distribution graph.
In the graph above we can see that approximately 20% of respondents entered a value less than or equal to 90, approximately 50% of respondents entered a value less than or equal to 100, and approximately 85% entered a value less than or equal to 110.