Psychometric Properties of an Instrument to Evaluate the Execution of a Didactic Sequence in Higher Education
DOI:
https://doi.org/10.15359/ree.27-3.17254Keywords:
Factor analysis, teacher competencies, higher education, assessment, teacher assessmentAbstract
Aim. To analyze the psychometric properties of construct validity and reliability of an instrument to assess the didactic sequence. Methodology. The instrument was administered to 488 students enrolled in Bachelor’s Degrees in Preschool and Elementary Education; the students were working on the 2012 study plans. They were informed of the purpose of the research and the confidentiality of the results; they also were asked for their consent to use the data collected. The construct validity analysis implemented a cross-validation process involving an exploratory factor analysis (EFA) and a confirmatory factor analysis (CFA). Reliability was evaluated with Cronbach’s alpha. Results. The EFA revealed the correspondence of the factorial model obtained with the theoretical model, since only one factor was found to explain the 63% of variance, in which all items were represented. The CFA showed the empirical sustainability of the factorial model and optimal fit (Ratio χ2/gl: 2.19; GFI: 0.942; RMSAE: 0.063; RMR: 0.029; CFI: 0.977; TLI: 0.971). The study also confirmed the presence of convergent validity. Finally, the Cronbach’s alpha result was 0.931, indicating optimal reliability. Conclusions. The instrument has adequate psychometric properties. Therefore, its utilization ensures the acquisition of reliable results in the evaluation of didactic sequences in higher education.
References
Ávila-Camacho, G. (2019). Diagnóstico del desempeño docente en la ejecución de proyectos formativos. 4to. Congreso Nacional de Investigación sobre Educación Normal. CONISEN. https://conisen.mx/memorias2019/memorias/2/P267.pdf
Ávila-Camacho, M. G., Juárez-Hernández L. G., Arreola-González, A. L., & Palmares Villarreal, O. G. (2019). Construcción y validación de un instrumento de valoración del desempeño docente en la ejecución de una secuencia didáctica. Revista de Investigación en Educación, 17(2), 122-142. https://revistas.uvigo.es/index.php/reined/article/view/2150/2190
Bollen, K. A. & Long, J. S. (Editores). (1993). Testing structural equation models. Sage.
Brousseau, G. (2007). Iniciación al estudio de la teoría de las situaciones didácticas. Zorzal.
Brown, T. A. (2015). Confirmatory factor analysis for applied research. Guilford Publications.
Burga León, A. (2006). La unidimensionalidad de un instrumento de medición: Perspectiva factorial. Revista de Psicología. 24(1), 53-80. https://doi.org/10.18800/psico.200601.003
Carvajal, A., Centeno, C., Watson, R., Martínez, M., & Sanz Rubiales, Á. (2011). ¿Cómo validar un instrumento de medida de la salud? Anales del Sistema Sanitario de Navarra, 34(1), 63-72. https://doi.org/10.4321/S1137-66272011000100007
Charter, R. A. (2003). A breakdown of reliability coefficients by test type and reliability method, and the clinical implications of low reliability. The Journal of General Psychology, 130(3), 290-304. https://doi.org/10.1080/00221300309601160
Cheung, G. W. & Wang, C. (2017). Current approaches for assessing convergent and discriminant validity with SEM: Issues and solutions. Academy of Management Proceedings, (1), 12706. https://doi.org/10.5465/AMBPP.2017.12706abstract
Cronbach, L. J. (1951). Coefficient Alpha and the internal structure of tests. Psychometrika, 16(3), 297-334. https://doi.org/10.1007/BF02310555
Darling-Hammond, L. & McLaughlin, M. W. (2003). El desarrollo profesional de los maestros. Nuevas estrategias y políticas de apoyo (Cuadernillos de discusión). SEP. https://educacionbasica.sep.gob.mx/multimedia/RSC/BASICA/Documento/201611/201611-3-RSC-mtL7IeHGBY-cds09.pdf
Filadelfo, C. & Guridi, V. (2014). Evaluación de una secuencia didáctica basada en actividades lúdicas para la enseñanza de alimentación y nutrición en los primeros años de la enseñanza secundaria. Revista Enseñanza de la Física, 6(Extra1), 309-320. https://dialnet.unirioja.es/servlet/articulo?codigo=5192248
Fornell, C. & Larcker, D. F. (1981). Evaluating structural equation Models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39-50. https://doi.org/10.2307/3151312
García Marimón, O., Diez-Palomar, J., Morales Maure, L., & Durán González, R. E. (2021, agosto). Evaluación de secuencias de aprendizaje de matemáticas usando la herramienta de los criterios de idoneidad didáctica. Boletim de Educação Matemática, 35(70), 1047-1072. https://doi.org/10.1590/1980-4415v35n70a23
Gatica-Lara, F. & Uribarren-Berrueta, T. del N. J. (2013). ¿Cómo elaborar una rúbrica? Investigación en educación médica, 2(5), 61-65. http://www.scielo.org.mx/scielo.php?script=sci_arttext&pid=S2007-50572013000100010
Guevara-Rodríguez, G. & Veytia-Bucheli, M. G. (2021). Validez de contenido de una rúbrica analítica del diseño de secuencias didácticas como mejora de la práctica pedagógica del equipo docente desde el enfoque de la socioformación. Revista Electrónica Educare, 25(1), 1-20. https://doi.org/10.15359/ree.25-1.20
Hair, Jr., J. F., Black, W. CBabin B. H., & Anderson, R. E. (2014). Multivariate data analysis. Pearson.
Haynes, S. N., Richard, D. C. S., & Kubany, E. S. (1995). Content validity in psychological assessment: A funtional approach to concepts and methods. Pshological Assessment, 7(3), 238-247. https://doi.org/10.1037/1040-3590.7.3.238
Ibarra-Piza, S., Segredo-Santamaría, S., Juárez-Hernández, L. G., & Tobón, S. (2018). Estudio de validez de contenido y confiabilidad de un instrumento para evaluar la metodología socioformativa en el diseño de cursos. Revista espacios, 39(53), 24-33. https://revistaespacios.com/cited2017/cited2017-24.pdf
Jabrayilov, R., Emons, W. H., & Sijtsma, K. (2016). Comparison of classical test theory and item response theory in individual change assessment. Applied Psychological Measurement, 40(8), 559-572. https://doi.org/10.1177/0146621616664046
JASP Team. (2019). JASP (Version 0.11.1) [Computer Software]. https://jasp-stats.org/
Juárez-Hernández, L. G. (2018). Manual práctico de estadística básica para la investigación. Kresearch. https://doi.org/10.24944/isbn.978-1-945721-24-3
Kerlinger, F. N. & Lee, H. B. (2002). Investigación del comportamiento: Métodos de investigación en ciencias sociales. McGraw-Hill.
Maine, C. A. (2017). La secuencia didáctica una oportunidad para pensar, planear, vivir, mirar y sentir la clase de ciencias. Anuario Digital de Investigación Educativa, (1), 501-517. https://revistas.bibdigital.uccor.edu.ar/index.php/adiv/article/view/3250/1962
Messick, S. (1980). Test Validity and Ethics of Assessment. American Psychologist, 35(11), 1012-1027. https://doi.org/10.1037/0003-066X.35.11.1012
Pimienta Prieto, J. H. (2011). Secuencias didácticas: Aprendizaje y evaluación de competencias en educación superior. Revista de Pedagogía, 63(1), 77-92. https://recyt.fecyt.es/index.php/BORDON/article/view/28906
Secretaría de Educación Pública (SEP). (2017). Guía académica del sustentante para la evaluación del desempeño del personal docente tercer grupo 2017. Educación primaria. Educación básica. https://www.academia.edu/34451803/Gu%C3%ADa_Acad%C3%A9mica_del_sustentante_para_la_Evaluaci%C3%B3n_del_Desempe%C3%B1o_del_Personal_Docente_Tercer_Grupo_2017_Educaci%C3%B3n_Primaria
Tabachnick, B. G. & Fidell, L. S. (2001). Using multivariate statistics. Allyn y Bacon.
Tena, È. & Couso, D. (2023). ¿Cómo se que mi secuencia didáctica es de calidad? Propuesta de un marco de evaluación desde la perspectiva de investigación basada en diseño? Revista Eureka sobre Enseñanza y Divulgación de las Ciencias, 20(2), 280101-280115. https://doi.org/10.25267/rev_eureka_ensen_divulg_cienc.2023.v20.i2.2801
Thompson, B. (2004). Exploratory and confirmatory. Factor analysis: Understanding concepts and applications. American Psychological Association. https://doi.org/10.1037/10694-000
Tobón Tobón, S., Pimienta Prieto, J. H., & García-Fraile, J. A. (2010). Secuencias didácticas: Aprendizaje y evaluación de competencias. Pearson.
Tobón, S. (2017). Metodología de la elaboración de una rúbrica socioformativa. CIFE. https://issuu.com/cife/docs/metodologia_rubrica_socioformativa_
Yuan, K.-H. (2005). Fit indices versus test statistics. Multivariate Behavioral Research, 40(1), 15-148. https://doi.org/10.1207/s15327906mbr4001_5
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2023 Authors
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
1. In case the submitted paper is accepted for publication, the author(s) FREELY, COSTLESS, EXCLUSIVELY AND FOR AN INDEFINITE TERM transfer copyrights and patrimonial rights to Universidad Nacional (UNA, Costa Rica). For more details check the Originality Statement and Copyright Transfer Agreement
2. REUTILIZATION RIGHTS: UNA authorizes authors to use, for any purpose (among them selfarchiving or autoarchiving) and to publish in the Internet in any electronic site, the paper´'s final version, both approved and published (post print), as long as it is done with a non commercial purpose, does not generate derivates without previous consentment and recognizes both publisher's name and authorship.
3. The submission and possible publication of the paper in the Educare Electronic Journal is ruled by the Journal’s editorial policies, the institutional rules of Universidad Nacional and the laws of the Republic of Costa Rica. Additionally, any possible difference of opinion or future dispute shall be settled in accordance with the mechanisms of Alternative Dispute Resolution and the Costa Rican Jurisdiction.
4. In all cases, it is understood that the opinions issued are those of the authors and do not necessarily reflect the position and opinion of Educare, CIDE or Universidad Nacional, Costa Rica. It is also understood that, in the exercise of academic freedom, the authors have carried out a rogorous scientific-academic process of research, reflection and argumentation thar lays within the thematic scope of interest of the Journal.
5. The papers published by Educare Electronic Journal use a Creative Commons License:
The articles published by Educare Electronic Journal can be shared with a Creative Commons License: 
