Analysis of the School Climate Scale in University Environments (ECEAU)
DOI:
https://doi.org/10.15359/ru.38-1.4Keywords:
Factor analysis, higher education, mathematics, reliability, school climate, validityAbstract
[Objective] The aim of this paper is to verify the factorial structure of the School Climate Scale in University Environments (ECEAU) through structural equation models (SEM). [Methodology] A non-experimental cross-sectional study was carried out with a random sample of 381 students of the Universidad Nacional de Costa Rica (UNA), to whom the ECEAU was applied. A SEM model was proposed to confirm the factor structure of the scale and an exploratory factor analysis (EFA) was used to provide the basis for an alternative SEM model with a different structure. The reliability of scales was determined using McDonald’s omega, and the goodness of fit indexes used for the SEM models were the RMSEA, the CFI, the TLI and the GFI. The analysis was carried out using R software. [Results] The reliability of the scales in both models was adequate (w >0.70), although the metrics in the proposed model produced better results. The AFE suggested a different structure for the ECEAU, keeping some dimensions of the original structure and modifying and eliminating others. The goodness of fit indexes in both models were almost identical, with RMSEA=0.02, CFI=0.99, TLI=0.99 and GFI=0.98, which provides supporting evidence for the factorial structures proposed. [Conclusions] The original structure of the ECEAU was confirmed, while the differences in the results of the estimation and rotation methods generated another equally valid factorial structure for measuring the school climate construct in this university, and could be applied to other similar contexts.
References
Al-Natour, S. H. (2019). Medical Students’ Perceptions of their Educational Environment at a Saudi University. Saudi Journal of Medicine & Medical Sciences, 7(3), 163-168. http://doi.org/10.4103/sjmms.sjmms_141_17
Aron, A. M., and Milicic, N. (1995). Resiliencia y clima social en el contexto escolar. [Resilience and social climate in the school context] Psykhe, 4(1), 57-68. http://rchd.uc.cl/index.php/psykhe/article/view/20233
Aron, A. M., Milicic, N. and Armijo, I. (2012). Clima social escolar: Una escala de evaluación-escala de clima social escolar [School social climate: An evaluation scale-school social climate scale], ECLIS. Universitas Psychologica, 11(3), 803-813. https://doi.org/10.11144/Javeriana.upsy11-3.csee
Barksdale, C., Peters, M. L., and Corrales, A. (2021). Middle school students’ perceptions of classroom climate and its relationship to achievement. Educational Studies, 47(1), 84-107. https://doi.org/10.1080/03055698.2019.1664411
Bear, G., Yang, C., Mantz, L., Pansipanodya, E., Hearn, S., and Boyer, D. (2014). Technical manual for the Delaware school survey. Newark, DE: Funded by the Delaware Positive Behavior Support Project at the Center for Disability Studies at University of Delaware and Delaware Department of Education. http://www.delawarepbs.org/wp-content/uploads/2011/12/Delaware-School-Survey-Technical-Manual-Fall-2016.pdf
Berkowitz, R. (2021). School climate and the socioeconomic literacy achievement gap: Multilevel analysis of compensation, mediation, and moderation models. Children and Youth Services Review, 130, 1-10. https://doi.org/10.1016/j.childyouth.2021.106238
Brand, S., Felner, R., Shim, M., Seitsinger, A., and Dumas, T. (2003). Middle School Improvement and Reform: Development and Validation of a School-Level Assessment of Climate, Cultural Pluralism, and School Safety. Journal of Educational Psychology, 95(3), 570-588. http://doi.org/10.1037/0022-0663.95.3.570
Buckman, D. G., Hand, N. W., and Johnson, A. (2021). Improving high school graduation through school climate. NASSP Bulletin, 105(1), 5-24. https://doi.org/10.1177/0192636521993212
Cohen, J., Pickeral, T., and McCloskey, M. (2009). Assessing School Climate. The Education Digest, 74(8), 45-48. https://www.proquest.com/magazines/assessing-school-climate/docview/218196384/se-2?accountid=37045
Council, N. S. C. (2007). The school climate challenge: Narrowing the gap between school climate research and school climate policy, practice guidelines and teacher education policy. Retrieved on. https://schoolclimate.org/wp-content/uploads/2021/05/school-climate-challenge-web.pdf
Djigic, G., and Stojiljkovic, S. (2011). Classroom management styles, classroom climate and school achievement. Procedia-Social and Behavioral Sciences, 29, 819-828. https://doi.org/10.1016/j.sbspro.2011.11.310
Ferrando, P. J. and Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología [Factor analysis as a research technique in psychology]. Papeles del psicólogo, 31(1), 18-33. https://www.papelesdelpsicologo.es/pdf/1793.pdf
Ferrando, P. J. and Lorenzo-Seva, U. (2014). El análisis factorial exploratorio de los ítems: algunas consideraciones adicionales. [Exploratory factor analysis of items: some additional considerations] Anales de Psicología / Annals of Psychology, 30(3), 1170-1175. https://doi.org/10.6018/analesps.30.3.199991
Galván, M. V. T. (2015). Health Sciences student’s perception of faculty attitudes and the impact on the learning climate. Revista Complutense de Educación, 26(2), 275-293. https://core.ac.uk/download/pdf/38821499.pdf
García, A., Andrade, P. and Calleja, N. (2022). Validación de una Escala para evaluar Clima Escolar en estudiantes Universitarios (ECE-U) [Validation of a Scale to Evaluate School Climate in University Students (ECE-U)]. Informes Psicológicos, 22(1), 267-280. https://doi.org/10.18566/infpsic.v22n1a16
Green, S. B., and Yang, Y. (2009). Reliability of summed item scores using structural equation modeling: An alternative to coefficient alpha. Psychometrika, 74(1), 155-167. https://doi.org/10.1007/s11336-008-9099-3
Izquierdo, I., Olea, J., and Abad, F. J. (2014). Exploratory factor analysis in validation studies: Uses and recommendations. Psicothema, 26(3), 395-400. https://doi.org/10.7334/psicothema2013.349
Juárez, M. (2014). Estudio exploratorio del clima escolar universitario [Exploratory study of the university school climate]. (Ph.D. tesis), Universidad Iberoamericana León. http://hdl.handle.net/11117/1428
Kaur, M., Sidhu, T. K., Mahajan, R., and Kaur, P. (2021). Evaluation of the Institutional Educational Environment by using the Dundee Ready Educational Environment Measure. International Journal of Applied and Basic Medical Research, 11(2), 85-89. https://doi.org/10.4103/ijabmr.IJABMR_470_20
Kohl, D., Recchia, S., and Steffgen, G. (2013). Measuring school climate: An overview of measurement scales. Educational Research, 55(4), 411-426. https://doi.org/10.1080/00131881.2013.844944
Krupat, E., Borges, N. J., Brower, R. D., Haidet, P. M., Schroth, W. S., Fleenor, T. J., and Uijtdehaage, S. (2017). The Educational Climate Inventory: Measuring Students’ Perceptions of the Preclerkship and Clerkship Settings. Academic Medicine, 92(12), 1757-1764. http://doi.org/10.1097/ACM.0000000000001730
Kutsyuruba, B., Klinger, D. A., and Hussain, A. (2015). Relationships among school climate, school safety, and student achievement and well-being: A review of the literature. Review of Education, 3(2), 103-135. http://doi.org/10.1002/rev3.3043
Ledesma, R. D., Ferrando, P. J. and Tosi, J. D. (2019). Uso del Análisis Factorial Exploratorio en RIDEP. Recomendaciones para autores y revisores [Use of Exploratory Factor Analysis in RIDEP. Recommendations for authors and reviewers]. Revista Iberoamericana de Diagnóstico y Evaluación–e Avaliação Psicológica, 52(3), 173-180. https://doi.org/10.21865/RIDEP52.3.13
Lee, V. E., and Burkam, D. T. (2003). Dropping Out of High School: The Role of School Organization and Structure. American Educational Research Journal, 40(2), 353-393. https://doi.org/10.3102/00028312040002353
Lenz, A. S., Rocha, L., and Aras, Y. (2020). Measuring school climate: A systematic review of initial development and validation studies. International Journal for the Advancement of Counselling, 43(1), 48-62. https://doi.org/10.1007/s10447-020-09415-9
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A. and Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada [Exploratory Factor Analysis of Items: A Practical Guide, Revised and Updated]. Anales de Psicología/Annals of Psychology, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361
Loza, L. J., Vigueras, A. M. R. and Medina, E. V. (2020). Sentido de pertenencia y percepción del clima social universitario. Binomio clave en la construcción de la comunidad universitaria lasallista [Sense of belonging and perception of the university social climate. Key pairing in the construction of the Lasallian university community]. In J. Brand (Ed.), Memoria del XX encuentro de formación docente: Verano de 2020 (pp. 359-371). Editorial Parmenia: De la Salle ediciones. https://editorialparmenia.com.mx/pub/media/wysiwyg/pdf/E%20Memoria%20del%20XX%20Encuentro%20de%20formacion%20docente%20311220.pdf
National School Climate Council. (2007). The school climate challenge: Narrowing the gap between school climate research and school climate policy, practice guidelines and teacher education policy. https://acortar.link/wBywOk
Nishimura, T., Wakuta, M., Tsuchiya, K. J., Osuka, Y., Tamai, H., Takei, N., and Katayama, T. (2020). Measuring School Climate among Japanese Students-Development of the Japan School Climate Inventory (JaSC). International Journal of Environmental Research and Public Health, 17(12), 1-11. https://doi.org/10.3390/ijerph17124426
O’Malley, M., Voight, A., Renshaw, T. L., and Eklund, K. (2015). School climate, family structure, and academic achievement: A study of moderation effects. School Psychology Quarterly, 30(1), 142-157. https://doi.org/10.1037/spq0000076
Pereira, Z. (2010). Las dinámicas interactivas en el ámbito universitario: el clima de aula [Interactive dynamics in the university environment: the classroom climate]. Revista Electrónica Educare, 14, 7-20. https://doi.org/10.15359/ree.14-Ext.1
Pere-Joan, F., and Anguiano-Carrasco, C. (2010). El análisis factorial como técnica de investigación en psicología [Factor analysis as a research technique in psychology]. Papeles del psicólogo, 31(1), 18-33. https://www.redalyc.org/pdf/778/77812441003.pdf
Ríos, D., Bozzo, N., Marchant, J. and Fernández, P. (2010). Factores que inciden en el clima de aula universitario [Factors that affect the university classroom climate]. Revista Latinoamericana de Estudios Educativos, 40(3-4), 105-126. https://rlee.ibero.mx/index.php/rlee/article/view/341/897
Roby, D. E. (2011). Teacher leaders impacting school culture. Education, 131(4), 782-790. http://www.timeforjapanese.com/media/downloads/research/Roby,%20TEACHER%20LEADERS%20IMPACTING%20SCHOOL%20CULTURE.pdf
Rodríguez-Pineda, M. and Zamora-Araya, J. A. (2021). Abandono temprano en estudiantes universitarios: Un estudio de cohorte sobre sus posibles causas. [Early dropout in university students: A cohort study of its possible causes]. Uniciencia, 35(1), 19-37. https://doi.org/10.15359/ru.35-1.2
Shukla, K. D., Waasdorp, T. E., Lindstrom Johnson, S., Orozco Solís, M. G., Nguyen, A. J., Rodrı́guez, C. C. and Bradshaw, C. P. (2019). Does school climate mean the same thing in the United States as in Mexico? A focus on measurement invariance. Journal of Psychoeducational Assessment, 37(1), 55-68. https://doi.org/10.1177/0734282917731459
Smith, T. K., Connolly, F. and Pryseski, C. (2014). Positive School Climate: What It Looks Like and How It Happens Nurturing Positive School Climate for Student Learning and Professional Growth. Baltimore Education Research Consortium. https://files.eric.ed.gov/fulltext/ED553170.pdf
Sudla, W., Wongwanich, S., and Sriklaub, K. (2020). Development of School Climate Scale Based on School Members’ Shared Experiences. The Journal of Behavioral Science, 15(1), 52-72. https://so06.tci-thaijo.org/index.php/IJBS/article/view/202339
Walankar, P., Panhale, V., and Situt, S. (2019). Students’ Perceptions of the Educational Environment in an Indian Physiotherapy College. The Internet Journal of Allied Health Sciences and Practice, 17(2), 1-9. http://doi.org/10.46743/1540-580X/2019.1807
Wang, M.-T., and Degol, J. L. (2016). School climate: A review of the construct, measurement, and impact on student outcomes. Educational Psychology Review, 28(2), 315-352. https://doi.org/10.1007/s10648-015-9319-1
Zullig, K. J., Koopman, T. M., Patton, J. M., and Ubbes, V. A. (2010). School climate: Historical review, instrument development, and school assessment. Journal of Psychoeducational Assessment, 28(2), 139-152. https://doi.org/10.1177/0734282909344205
Downloads
Published
Issue
Section
License
Copyright (c) 2023 Shared by Journal and Authors (CC-BY-NC-ND)
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
Authors who publish with this journal agree to the following terms:
1. Authors guarantee the journal the right to be the first publication of the work as licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgment of the work's authorship and initial publication in this journal.
2. Authors can set separate additional agreements for non-exclusive distribution of the version of the work published in the journal (eg, place it in an institutional repository or publish it in a book), with an acknowledgment of its initial publication in this journal.
3. The authors have declared to hold all permissions to use the resources they provided in the paper (images, tables, among others) and assume full responsibility for damages to third parties.
4. The opinions expressed in the paper are the exclusive responsibility of the authors and do not necessarily represent the opinion of the editors or the Universidad Nacional.
Uniciencia Journal and all its productions are under Creative Commons Atribución-NoComercial-SinDerivadas 4.0 Unported.
There is neither fee for access nor Article Processing Charge (APC)
