Statistical Significance and/or Effect Size?
Keywords:
predisposition towards sustainable behaviour, Pre-school Education
Abstract
In the paper, we present some dilemmas concerning the use of statistical significance as the only measure for interpreting results and drawing conclusions. We also introduce effect size measures as a complementary measure in interpretation of the results of statistical tests. We explain the concept of effect size and emphasise the importance of its use in research. We highlight some measures of effect size that we believe could usefully complement the most commonly used statistical test in educational research. We also point out the limitations of using effect size and urge caution in interpreting results.
Downloads
Download data is not yet available.
References
Bachmann, C., Luccio, R., in Salvadori, E. (2005). Statistical significance and its meaning. Psihološka obzorja, 14(3), 7–14.
Cankar, G., in Bajec, B. (2003). Velikost učinka kot dopolnilo testiranju statistične pomembnosti razlik. Psihološka obzorja, 12(2), 97–112.
Capraro, R. M., in Capraro, M. (2002). Treatments of effect sizes and statistical significance tests in textbooks. Educational and Psychological Measurement, 62(5),771–82.
Coe, R. (2000). What is an effect size? Durham: CEM Centre, University of Durham. Pridobljeno s www.cemcentre.org/ebeuk/research/effectsize/ ESbrief.htm
Coe, R. (2002). It's the Effect Size, Stupid. What the effect size is and why it is important. Paper presented at the Annual Conference of the British Education Research Association, University of Exeter, England, 12–14 September 2002.
Cohen, J. (1994). The Earth is round (p < 05). American Psychologist, 49, 997–1003.
Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304–1312.
Cohen, L., Manion, L., in Morrison, K. (2007). Research Methods in Education. Routledge: New York.
Durlak, J. A. (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34(9), 917–928
Field, A. (2005). Discovering Statistics Using SPSS. Thousand Oaks, New Delhi: Sage Publications.
Fitz-Gibbon, C. T. (1997). The Value Added National Project. Final Report. London: School Curriculum and Assessment Authority.
Kirk, R. E. (1999). Statistics: An Introduction. London: Harcourt Brace.
Kline, R. (2004). Beyond Significance Testing. Washington, DC: American Psychological Association.
Košmelj, B., Arh, F., Doberšek Urbanc, A., Ferligoj, A., in Omladič, M. (2001). Statistični terminološki slovar. Ljubljana: Statistično društvo Slovenije in Statistični urad Republike Slovenije.
Kožuh, B. (2011). Statistične metode v pedagoškem raziskovanju. Ljubljana: Znanstvena založba Filozofske fakultete.
Olejnik, S., in Algina J. (2000) Measures of effect size for comparative studies: applications, interpretations, and limitations. Contemporary Educational Psychology, 25, 241–86.
Publication Manual of the American Psychological Association (fourth edition). (1994). Washington, DC: American Psychological Association .
Sullivan, G. M., in Feinn, R. (2012). Using Effect Size – or Why the P Value Is Not Enough. Journal of Graduate Medical Education, 4(3), 279–282.
Thompson, B. (1994) Guidelines for authors. Educational and Psychological Measurement, 54, 837–47.
Thompson B. (2000). A suggested revision of the forthcoming 5th Edition of the APA Publication Manual. Pridobljeno s http://www.coe.tamu.edu/~bthompson/apaeffec.htm (Dostopno .)
Thompson, B. (2003). »Statistica, »pratica«, »clinica«: quanti tipi di significativa deve considerare chi opera hel counseling? Bollettino di Psicologia applicata, 240, 3–13.
Thompson, B. (2001). Significance effect sizes, stepwise methods, and other issues: strong arguments to move the field. Journal of Experimental Education, 71, 80–93.
Thompson, B., in Snyder, P. A. (1997). Statistical significance testing practices in the Journal of Experimental Education. Journal of Experimental Education, 66, 75–83
Wilkinson, L., in The Task Force on Statistical Inference, APA Board of Scientific Affairs (1999). Statistical methods in psychology journals: guidelines and explanations. American Psychologist, 54, 594–604.
Wright, D. B. (2003). Making friends with your data: improving how statistics are conducted and reported. British Journal of Educational Psychology, 73, 123–36.
Cankar, G., in Bajec, B. (2003). Velikost učinka kot dopolnilo testiranju statistične pomembnosti razlik. Psihološka obzorja, 12(2), 97–112.
Capraro, R. M., in Capraro, M. (2002). Treatments of effect sizes and statistical significance tests in textbooks. Educational and Psychological Measurement, 62(5),771–82.
Coe, R. (2000). What is an effect size? Durham: CEM Centre, University of Durham. Pridobljeno s www.cemcentre.org/ebeuk/research/effectsize/ ESbrief.htm
Coe, R. (2002). It's the Effect Size, Stupid. What the effect size is and why it is important. Paper presented at the Annual Conference of the British Education Research Association, University of Exeter, England, 12–14 September 2002.
Cohen, J. (1994). The Earth is round (p < 05). American Psychologist, 49, 997–1003.
Cohen, J. (1990). Things I have learned (so far). American Psychologist, 45, 1304–1312.
Cohen, L., Manion, L., in Morrison, K. (2007). Research Methods in Education. Routledge: New York.
Durlak, J. A. (2009). How to select, calculate, and interpret effect sizes. Journal of Pediatric Psychology, 34(9), 917–928
Field, A. (2005). Discovering Statistics Using SPSS. Thousand Oaks, New Delhi: Sage Publications.
Fitz-Gibbon, C. T. (1997). The Value Added National Project. Final Report. London: School Curriculum and Assessment Authority.
Kirk, R. E. (1999). Statistics: An Introduction. London: Harcourt Brace.
Kline, R. (2004). Beyond Significance Testing. Washington, DC: American Psychological Association.
Košmelj, B., Arh, F., Doberšek Urbanc, A., Ferligoj, A., in Omladič, M. (2001). Statistični terminološki slovar. Ljubljana: Statistično društvo Slovenije in Statistični urad Republike Slovenije.
Kožuh, B. (2011). Statistične metode v pedagoškem raziskovanju. Ljubljana: Znanstvena založba Filozofske fakultete.
Olejnik, S., in Algina J. (2000) Measures of effect size for comparative studies: applications, interpretations, and limitations. Contemporary Educational Psychology, 25, 241–86.
Publication Manual of the American Psychological Association (fourth edition). (1994). Washington, DC: American Psychological Association .
Sullivan, G. M., in Feinn, R. (2012). Using Effect Size – or Why the P Value Is Not Enough. Journal of Graduate Medical Education, 4(3), 279–282.
Thompson, B. (1994) Guidelines for authors. Educational and Psychological Measurement, 54, 837–47.
Thompson B. (2000). A suggested revision of the forthcoming 5th Edition of the APA Publication Manual. Pridobljeno s http://www.coe.tamu.edu/~bthompson/apaeffec.htm (Dostopno .)
Thompson, B. (2003). »Statistica, »pratica«, »clinica«: quanti tipi di significativa deve considerare chi opera hel counseling? Bollettino di Psicologia applicata, 240, 3–13.
Thompson, B. (2001). Significance effect sizes, stepwise methods, and other issues: strong arguments to move the field. Journal of Experimental Education, 71, 80–93.
Thompson, B., in Snyder, P. A. (1997). Statistical significance testing practices in the Journal of Experimental Education. Journal of Experimental Education, 66, 75–83
Wilkinson, L., in The Task Force on Statistical Inference, APA Board of Scientific Affairs (1999). Statistical methods in psychology journals: guidelines and explanations. American Psychologist, 54, 594–604.
Wright, D. B. (2003). Making friends with your data: improving how statistics are conducted and reported. British Journal of Educational Psychology, 73, 123–36.
Published
2021-12-18
How to Cite
Štemberger T. (2021). Statistical Significance and/or Effect Size?. Journal of Elementary Education, 14(4), 485-500. https://doi.org/10.18690/rei.14.4.485-500.2021
Issue
Section
Scientific Articles
Copyright (c) 2021 Tina Štemberger
This work is licensed under a Creative Commons Attribution 4.0 International License.