How Do I Create a One-Way ANOVA & Means Matrix in Excel Using SigmaXL?
One-Way ANOVA & Means Matrix
- One-Way ANOVA and Means Matrix allows you to quickly do multiple pairwise comparisons. The One-Way ANOVA tests H0: μ1 = μ2 = μ3; Ha: at least one pairwise set of means are not equal.
- Open Customer Data.xls, click on Sheet 1 tab (or press F4 to activate last worksheet).
- Click SigmaXL > Statistical Tools > One-Way ANOVA & Means Matrix. Ensure that the entire data table is selected. If not, check Use Entire Data Table.
Click Next. Ensure that Stacked Column Format is checked. Select Overall Satisfaction, click Numeric Data Variable (Y) >>; select Customer Type, click Group Category (X) >>. Uncheck Display ANOVA Table Details. Check Display Test Assumptions Report.
- Click OK. The results are shown below:
- The ANOVA p-value of 0.0000 tells us that at least one pairwise set of means are not equal. From the means matrix, we conclude that Mean Overall Satisfaction is significantly different between Customer Type 2 and 3, as well as 1 and 2.
- A graphical view of the Overall Satisfaction Mean and 95% Confidence Intervals are given to complement the Means Matrix. The fact that the CI’s for Customer Type 2 do not overlap those of Type 1 or 3, clearly shows that Customer Type 2 has a significantly higher mean satisfaction score. The overlap of CI’s for Type 1 and 3 shows that the mean satisfaction scores for 1 and 3 are not significantly different.
- The R-Square (R-Sq) value of 20.95% indicates that Customer type “explains” approximately 21% of the variation in Overall Satisfaction. We need to “drill down” to understand the root causes and best practices associated with Customer Type 2.
Note that the P-Value for Customer Type 2-3 is slightly
different than the previous 2 Sample t-Test result because the
variances from all 3 customer types are “pooled” here. This also
results in slightly different confidence intervals.
Note also that the means matrix P-Values could easily trigger type I errors when the number of X levels gets large. You should only consider the results of the Means Matrix if the ANOVA P-Value is < .05.
- One-Way ANOVA
This is a text report with color highlight: Green (OK), Yellow (Warning) and Red (Serious Violation).
Each sample is tested for Normality using the Anderson Darling test. If not normal, the minimum sample size for robustness of the ANOVA Test is determined utilizing Monte Carlo regression equations (see Basic Statistical Templates – Minimum Sample Size for Robust t-Tests and ANOVA). If the sample size is inadequate, a warning is given and the appropriate Nonparametric test is recommended (Kruskal-Wallis if there are no extreme outliers, Mood’s Median if there are extreme outliers).
Each sample is tested for Outliers defined as: Potential: Tukey's Boxplot (> Q3 + 1.5*IQR or < Q1 – 1.5*IQR); Likely: Tukey's Boxplot 2*IQR; Extreme: Tukey's Boxplot 3*IQR. If outliers are present, a warning is given and recommendation to review the data with a Boxplot and Normal Probability Plot. Here we have a potential outlier for Customer Type 2.
Tip: If the removal of outlier(s) result in an Anderson Darling P-Value that is > 0.1, a notice is given that excluding the outlier(s), the sample data are inherently normal.
Each sample is tested for Randomness using the Exact Nonparametric Runs Test. If the sample data is not random, a warning is given and recommendation to review the data with a Run Chart.
A test for Equal Variances is also applied. If all sample data are normal, Bartlett’s Test is utilized, otherwise Levene’s Test is used. If