Online Assessment in the Spotlight: A Case Study in a Spanish University
DOI:
https://doi.org/10.15359/ree.28-1.18426Keywords:
Online assessment, formative assessment, summative assessment, higher education, digital technologies in education, SDG4 Quality education, digital learningAbstract
Objective. This exploratory case study aims to analyze the attitudes, practices and preferences of higher education faculty and students in relation to online assessment. Methodology. A quantitative methodology based on a questionnaire was used, and a descriptive and correlational analysis was conducted. Participants included students and faculty members from a Spanish on-site university. Results. Certain similarities and differences in attitudes, practices and preferences between students and teachers are presented. Some relationships, albeit weak, were also identified between the online assessment practices used and some characteristics of the teachers’ profile or teaching (teaching experience, teaching load and class size). Conclusions. The findings show that a large part of the teaching staff shows some reluctance in the design and implementation of online assessment strategies beyond traditional exams, as well as a great concern about student control and the danger of fraud. On the other hand, students show generally more positive attitudes towards online assessment than the teaching staff. The recommendations point to the consideration of the role of institutional support and teacher training units for the improvement of teachers’ digital competence in relation to online assessment, the importance of updating security systems in technical infrastructures, and adjusting the effects of teaching load and class size when online assessment is applied.
References
Abella García, V., Grande de Prado, M., García-Peñalvo, F. J., & Corell Almuzara, A. (2020). Guía de recomendaciones para la evaluación online en las universidades públicas de Castilla y León (versión 1.1). Zenodo. https://doi.org/10.5281/ZENODO.3780661
Aznarte, J. L., Melendos Pardo, M., & Lacruz López, J. M. (2022). Sobre el uso de tecnologías de reconocimiento facial en la universidad: El caso de la UNED. RIED. Revista Iberoamericana de Educación a Distancia, 25(1), 261-277. https://doi.org/10.5944/ried.25.1.31533
Bond, M., Bedenlier, S., Marín, V. I, & Händel, M. (2021). Emergency remote teaching in higher education: Mapping the first global online semester. International Journal of Educational Technology in Higher Education (18), 1-24. https://doi.org/10.1186/s41239-021-00282-x
Brady, M., Devitt, A., & Kiersey, R. A. (2019). Perspectivas del personal académico sobre la tecnología para la evaluación (TfA) en la educación superior: Una revisión sistemática de la literatura, 50(6), 3080-3098. https://doi.org/10.1111/bjet.12742
Coghlan, S., Miller, T., & Paterson, J. (2021). Good proctor or “Big Brother”? Ethics of online exam supervision technologies. Philosophy and Technology, 34(4), 1581-1606. https://doi.org/10.1007/s13347-021-00476-1
Conrad, D. & Openo, J. (2018). Assessment strategies for online learning: Engagement and authenticity. AU Press. https://doi.org/10.15215/aupress/9781771992329.01
Dominguez-Figaredo, D., Gil-Jaurena, I., & Morentin-Encina, J. (2022). The impact of rapid adoption of online assessment on students’ performance and perceptions: evidence from a distance learning university. Electronic Journal of e-Learning, 20(3), 224-241. https://doi.org/10.34190/ejel.20.3.2399
Espasa, A., Mayordomo, R. M., Guasch, T., & Martinez-Melo, M. (2022). Does the type of feedback channel used in online learning environments matter? Students’ perceptions and impact on learning. Active Learning in Higher Education, 23(1), 49-63. https://doi.org/10.1177/1469787419891307
Fernández March, A. (2010). La evaluación orientada al aprendizaje en un modelo de formación por competencias en la educación universitaria. REDU. Revista de Docencia Universitaria, 8(1), 11-34. https://doi.org/10.4995/redu.2010.6216
García Aretio, L. (2021). ¿Podemos fiarnos de la evaluación en los sistemas de educación a distancia y digitales? RIED. Revista Iberoamericana de Educación a Distancia, 24(2), 9-29. https://doi.org/10.5944/ried.24.2.30223
García-Peñalvo, F. J., Corell, A., Abella-García, V., & Grande, M. (2020). La evaluación online en la educación superior en tiempos de la COVID-19. Education in the Knowledge Society (EKS), 21, 1-26. https://doi.org/10.14201/eks.23013
Gikandi, J. W., Morrow, D., & Davis, N. E. (2011). Online formative assessment in higher education: A review of the literature. Computers & Education, 57(4), 2333-2351. https://doi.org/10.1016/j.compedu.2011.06.004
Gros Salvat, B. G., & Cano García, E. (2021). Procesos de feedback para fomentar la autorregulación con soporte tecnológico en la educación superior: Revisión sistemática. RIED. Revista Iberoamericana de Educación a Distancia, 24(2), 107. https://doi.org/10.5944/ried.24.2.28886
Guangul, F. M., Suhail, A. H., Khalit, M. I., & Khidhir, B. A. (2020). Challenges of remote assessment in higher education in the context of COVID-19: A case study of Middle East College. Educational Assessment, Evaluation and Accountability, 32(4), 519-535. https://doi.org/10.1007/s11092-020-09340-w
Hattie, J. (2009). The black box of tertiary assessment: An impending revolution. En L. H. Meyer, S. Davidson, H. Anderson, P. M. Fletcher, P. M. Johnston, & M. Rees (Eds.), Tertiary assessment & higher education student outcomes: Policy, practice & research (pp. 259-275). Ako Aotearoa.
Heil, J. & Ifenthaler, D. (2023). Online assessment in higher education: A systematic review. Online Learning, 27(1), 187-218. https://doi.org/10.24059/olj.v27i1.3398
Hilliger, I., Ruipérez‐Valiente, J. A., Alexandron, G., & Gašević, D. (2022). Trustworthy remote assessments: A typology of pedagogical and technological strategies. Journal of Computer Assisted Learning, 38(6), 1507-1520. https://doi.org/10.1111/jcal.12755
Ibarra Sáiz, M. S. & Rodríguez Gómez, G. (2010). Los procedimientos de evaluación como elementos de desarrollo de la función orientadora en la universidad. REOP - Revista Española de Orientación y Psicopedagogía, 21(2), 443-461. https://doi.org/10.5944/reop.vol.21.num.2.2010.11558
Iglesias Pérez, M. C., Vidal-Puga, J., & Pino Juste, M. R. (2022). El papel de la autoevaluación y la evaluación entre pares en la educación superior. Studies in Higher Education, 47(3), 683-692. https://doi.org/10.1080/03075079.2020.1783526
Jordan, S. (2013). E-assessment: Past, present and future. New Directions in the Teaching of Natural Sciences, 9(1), 87-106. https://doi.org/10.29311/ndtps.v0i9.504
Kondakci, Y., Capa-Aydin, Y., Zayim-Kurtay, M., & Kaya-Kasikci, S. (2022). Framework and taxonomy development of online assessment [Report on IO1]. Zenodo. https://doi.org/10.5281/zenodo.7009967
Mâță, L., Poenaru, A.-G., & Boghian, I. (2022). Current issues of ethical use of information technology from the perspective of university teachers. En L. Mâță (Ed.), Ethical use of information technology in higher education (pp. 163-179). Springer Singapore. https://doi.org/10.1007/978-981-16-1951-9_1
Marín, V. I., & Pérez Garcias, A. (2016). Collaborative e-assessment as a strategy for scaffolding self-regulated learning in higher education. En S. Caballé & R. Clarisó (Eds), Formative assessment, learning data analytics and gamification (pp. 3-24). Elsevier. https://doi.org/10.1016/B978-0-12-803637-2.00001-4
Marín, V. I., & Salinas, J. (2022). Balance between guidance and self-regulated learning: Teaching and learning strategies in online, Hybrid and blended learning in higher education. Journal of Interactive Media in Education (1), 1-4. https://doi.org/10.5334/jime.770
Marín, V. I., Bedenlier, S., Capa-Aydin, Y., Kaya-Kasikci, S., Kondakci, Y., Schieber, J., & Zayim-Kurtay, M. (2022). Apoyo al profesorado para la implementación de la evaluación en línea en educación superior: El proyecto europeo Remote.EDU. En S. Olmos-Migueláñez, M. J. Rodríguez-Conde, A. Bartolomé, J. Salinas, F. J. Frutos-Esteban, & F. J. García-Peñalvo (Eds.), La influencia de la tecnología en la investigación educativa pospandemia (pp. 183-198). Octaedro.
Marín, V. I., Brescó, E., Carrera, X., Coiduras, J., & Alfonso, G. (2022). Evaluation study of stakeholder perspectives on online assessment [Report on IO2]. Zenodo. https://doi.org/10.5281/ZENODO.7010090
Natal, D. (1998). On-line assessment: What, Why, How. Technology Education Conference. https://files.eric.ed.gov/fulltext/ED419552.pdf
Or, C. & Chapman, E. (2022). Development and acceptance of online assessment in higher education: Recommendations for further research. Journal of Applied Learning & Teaching, 5(1), 10-26. https://doi.org/10.37074/jalt.2022.5.1.6
Panadero, E. & Lipnevich, A. A. (2022). A review of feedback models and typologies: Towards an integrative model of feedback elements. Educational Research Review, 35, 100416. https://doi.org/10.1016/j.edurev.2021.100416
Panadero, E., Fraile, J., & García-Pérez, D. (2022). Transition to higher education and assessment: A one year longitudinal study. Educación XX1, 25(2), 15-37. https://doi.org/10.5944/educxx1.29870
Redecker, C. (2013). The use of ICT for the assessment of key competences. Publications Office of The European Union. https://data.europa.eu/doi/10.2791/87007
Senadheera, P. & Kulasekara, G. U. (2022). A formative assessment design suitable for online learning environments and its impact on students’ learning. Open Praxis, 13(4), 385-396. https://doi.org/10.55982/openpraxis.13.4.261
Şenel, S. & Şenel, H. C. (2021). Remote assessment in higher education during COVID-19 pandemic. International Journal of Assessment Tools in Education, 8(2), 181-199. https://doi.org/10.21449/ijate.820140
Surahman, E. & Wang, T.-H. (2022). Academic dishonesty and trustworthy assessment in online learning: A systematic literature review. Journal of Computer Assisted Learning, 38(6), 1535-1553. https://doi.org/10.1111/jcal.12708
Vega-Angulo, H. E., Rozo-García, H., & Dávila-Gilede, J. (2021). Estrategias de evaluación mediadas por las tecnologías de la información y comunicación (TIC): Una revisión de bibliografía. Revista Electrónica Educare, 25(2), 1-22. http://doi.org/10.15359/ree.25-2.16
Winstone, N. & Carless, D. (2019). Designing effective feedback processes in higher education: A learning-focused approach. Routledge. https://doi.org/10.4324/9781351115940
Zawacki-Richter, O., Marín, V. I., Bond, M., & Gouverneur, F. (2019). Systematic review of research on artificial intelligence applications in higher education – where are the educators? International Journal of Technology in Higher Education, 16(1), 1-27. https://doi.org/10.1186/s41239-019-0171-0
Downloads
Published
How to Cite
Issue
Section
Categories
License
Copyright (c) 2024 Victoria Marín, Jordi Coiduras, Enric Brescó, Xavier Carrera
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 3.0 Unported License.
1. In case the submitted paper is accepted for publication, the author(s) FREELY, COSTLESS, EXCLUSIVELY AND FOR AN INDEFINITE TERM transfer copyrights and patrimonial rights to Universidad Nacional (UNA, Costa Rica). For more details check the Originality Statement and Copyright Transfer Agreement
2. REUTILIZATION RIGHTS: UNA authorizes authors to use, for any purpose (among them selfarchiving or autoarchiving) and to publish in the Internet in any electronic site, the paper´'s final version, both approved and published (post print), as long as it is done with a non commercial purpose, does not generate derivates without previous consentment and recognizes both publisher's name and authorship.
3. The submission and possible publication of the paper in the Educare Electronic Journal is ruled by the Journal’s editorial policies, the institutional rules of Universidad Nacional and the laws of the Republic of Costa Rica. Additionally, any possible difference of opinion or future dispute shall be settled in accordance with the mechanisms of Alternative Dispute Resolution and the Costa Rican Jurisdiction.
4. In all cases, it is understood that the opinions issued are those of the authors and do not necessarily reflect the position and opinion of Educare, CIDE or Universidad Nacional, Costa Rica. It is also understood that, in the exercise of academic freedom, the authors have carried out a rogorous scientific-academic process of research, reflection and argumentation thar lays within the thematic scope of interest of the Journal.
5. The papers published by Educare Electronic Journal use a Creative Commons License:
The articles published by Educare Electronic Journal can be shared with a Creative Commons License: 
