Impact of Homogeneity of Variances Violation in Single Factor Components of Variance Model when Sampling from Finite Population
This study aims to appraise the impact of heteroscedasticity on a single factor component of variance model when random effects are sampled from a finite population. Ten thousand data sets in each scenario of difference levels of variances, sample sizes per factor levels, choices of distributions, nominal α-levels, population sizes of random effects (N) and number of factor levels (k) are simulated to perform the assessment of the F-statistic in the one-way ANOVA via the type I error rate and power. Results show that when the null hypothesis is true, the F-test can generally keep the nominal α of 0.05 even though the homogeneity of variances is not satisfied. In contrast, for α = 0.01, its performance is very bad. Further, heterogeneity of variances still be a problem in the ANOVA for both terms, i.e., type I error rate and power even in medium heterogeneity cases. The power in the finite population situations is always greater than that of the standard F-test used in case of the infinite population under heteroscedasticity. Therefore, if the sampling fraction (k/N) exceeds 5 percent, a large value of the type II error rate is presented. Under this condition, one should avoid using the ordinary F-test in a single factor ANOVA.
Bradley, J. V. (1978). Robustness? The British Journal of Mathematical and Statistical Psychology, 31(2), 144-152.
Cochran, W. G. (1977). Sampling Techniques, 3rd ed., John Wiley & Sons, New York: pp. 25.
Cornfield, J. and Tukey, J. W. (1956). Average values of mean squares in factorials. Annals of Mathematical Statistics, 27, 907-949.
Cribbie, R. A., Wilcox, R. R., Bewell, C., and Keselman, H. J. (2007). Test for treatment group equality when data are nonnormal and heteroscedastic. Journal of Modern Applied Statistical Methods, 6(1), 117-132.
Game, P. A., Winkler, H. B., and Probert, D. A. (1972). Robust tests for homogeneity of variance. Educational and Psychological Measurement, 32, 887-909.
Gaylor, D. W. and Hartwell, T. D. (1969). Expected mean squares for nested classifications. Biometrics, 25, 427-430.
Hartley, H. O. (1967). Expectations, variances and covariances of ANOVA mean squares by synthesis. Biometrics, 23, 105-114.
Hecke, T. V. (2010). Power study of anova versus Kruskal-Wallis test. Journal of Statistics and Management Systems, 15(2-3), 241-247.
Liu, H. (2015). Comparing Welch’s ANOVA, a Kruskal-Wallis Test and Traditional ANOVA in Case of Heterogeneity of Variance (master’s thesis). Virginia Commonwealth University, Richmond, Virginia, United States.
Mahamunulu, D. M. (1963). Sampling variances of the estimates of variance components in the unbalanced 3-way nested classification. Annals of Mathematical Statistics, 34, 521-527.
Moder, K. (2007). How to keep the type I error rate in ANOVA if variances are heteroscedastic. Austrian Journal of Statistics, 36(3), 179-188.
Moder, K. (2010). Alternatives to F-Test in one way ANOVA in case of heterogeneity of variances (a simulation study). Psychological Test and Assessment Modelling, 52(4), 343-353.
Montgomery, D. C. (2013). Design and Analysis of Experiments, 8th ed., John Wiley & Sons, New York, pp. 116-118.
Searle, S. R., Casella, G., and McCulloch, C. E. (2006). Variance Components, John Wiley & Sons, New Jersey, pp. 16-18.
Searle, S. R. and Fawcett, R. F. (1970). Expected mean squares in variance components models having finite populations. Biometrics, 26, 243-254.
Simmachan, T. (2011). Analytical Method for the Random Effects One-Way ANOVA Model when Sampling from a Finite Population (master’s thesis). Thammasat University, Thailand.
Simmachan, T., Borkowski, J. J., and Budsaba, K. (2012). Expected mean squares for the random effects one-way ANOVA model when sampling from a finite population. Thailand Statistician, 10(1), 121-128.
Tukey, J.W. (1956). Variances of variance components: I Balanced designs. Annals of Mathematical Statistics, 27, 722-736.
Tukey, J.W. (1957). Variances of variance components: II The unbalanced single classification. Annals of Mathematical Statistics, 28, 43-56.