Instruments to Measure Teachers’ Artificial Intelligence Competence: Comparison and Integration Based on the UNESCO Framework
DOI:
https://doi.org/10.66778/LU.e02v07n04.01Keywords:
competencias del docente, educación superior, evaluación de la educación, formación de docente, educación superior; inteligencia artificial; proceso de enseñanza-aprendizajeAbstract
Introduction: AI training opportunities within higher education require a prior diagnostic assessment to determine faculty competence levels and suggest tailored learning paths. Although the UNESCO Framework stands out as a key reference due to its human-centered focus, it lacks a measurement instrument and quantitative ranges for proficiency levels. Available scales remain fragmented, in English, validated in other contexts, or poorly aligned with the framework. Given the heterogeneous training demands identified at the University of El Salvador (UES) between 2025 and 2026, integrating a suitable instrument became essential. Objective: To integrate a questionnaire to measure AI competencies among UES faculty using validated subscales aligned with the UNESCO Framework. Methodology: Between May and July 2026, a four-phase procedure evaluated six instruments (TAICS, AI-ED-SAT, AICTS, T-GAIC, AILST, and AITPACK). Key subscales were selected, five custom institutional contextualization blocks were added, and a pilot test was conducted with faculty members. Results and Discussion: A nine-block questionnaire was structured (AI-ED-SAT as the core base, three TAICS subscales, and custom contextual blocks). The pilot test confirmed comprehensibility, achieving an average clarity score of 96.09 % (Excellent). Findings demonstrate that the articulated integration of subscales overcomes local relevance limitations of international scales. Conclusions: The applied methodological framework provides a replicable procedure to assemble tools without compromising the original psychometric rigor. The resulting instrument yields a self-perception diagnosis essential for guiding faculty training at UES.
Downloads
References
Carbajal-Degante, E. (2025). De la UNESCO a la UNAM: adaptación de un marco de competencias docentes en inteligencia artificial para la educación. Revista Mexicana de Bachillerato a Distancia, 17(33). https://doi.org/10.22201/cuaieed.20074751e.2025.33.90977
Celik, I., Dindar, M., Muukkonen, H., y Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616-630. https://doi.org/10.1007/s11528-022-00715-y
Chiu, T. K. F., Ahmad, Z., y Çoban, M. (2025). Development and validation of teacher artificial intelligence (AI) competence self-efficacy (TAICS) scale. Education and Information Technologies, 30, 6667-6685. https://doi.org/10.1007/s10639-024-13094-z
Costello, A. B., y Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(7), 1-9. https://doi.org/10.7275/jyj1-4868
Galán-Íñigo, A., Ruiz-Lázaro, J., y Jiménez-García, E. (2025). Análisis comparado de los marcos de competencias en inteligencia artificial en el ámbito educativo. Edutec. Revista Electrónica de Tecnología Educativa, (93), 185-208. https://doi.org/10.21556/edutec.2025.93.3699
Gallego, L., y Araque, O. (2019). Variables de influencia en la capacidad de aprendizaje: un análisis por conglomerados y componentes principales. Información Tecnológica, 30(2), 257-264. https://doi.org/10.4067/S0718-07642019000200257
Hu, L. T., y Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., y Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: Una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361
López Falcón, A. L., y Ramos Serpa, G. (2021). Acerca de los métodos teóricos y empíricos de investigación: significación para la investigación educativa. Revista Conrado, 17(S3), 22-31. https://conrado.ucf.edu.cu/index.php/conrado/article/view/2133
Majeed, S., y Farooq, M. S. (2025). Artificial Intelligence Competence Teachers’ Assessment Scale (AICTS): Development and validation. Journal of Innovations in Education and Social Sciences, 2(1), 223-238. https://jiess.org.uk/index.php/jiess/article/view/66
Maldonado-Suárez, N., y Santoyo-Telles, F. (2024). Validez de contenido por juicio de expertos: integración cuantitativa y cualitativa en la construcción de instrumentos de medición. REIRE Revista d’Innovació i Recerca en Educació, 17(2), 1-19. https://doi.org/10.1344/reire.46238
Martín-Párraga, L., Llorente-Cejudo, C., y Cabero-Almenara, J. (2022). Análisis de las competencias digitales docentes desde los marcos e instrumentos de evaluación. International Journal of Educational Research and Innovation, (18), 62-79. https://doi.org/10.46661/ijeri.7444
Miao, F., y Cukurova, M. (2024). AI competency framework for teachers. UNESCO. https://doi.org/10.54675/ZJTE2084
Montero, I., y León, O. G. (2007). A guide for naming research studies in Psychology. International Journal of Clinical and Health Psychology, 7(3), 847-862. https://www.aepc.es/ijchp/GNEIP07_es.pdf
Muñiz, J., y Fonseca-Pedrero, E. (2008). Construcción de instrumentos de medida para la evaluación universitaria. Revista de Investigación en Educación, 5(1), 13-25. https://revistas.uvigo.es/index.php/reined/article/view/1816
Ning, Y., Zhang, W., Yao, D., Fang, B., Xu, B., y Wijaya, T. T. (2025). Development and validation of the Artificial Intelligence Literacy Scale for Teachers (AILST). Education and Information Technologies, 30(12), 17769-17803. https://doi.org/10.1007/s10639-025-13347-5
Oviedo, H. C., y Campo-Arias, A. (2005). Aproximación al uso del coeficiente alfade Cronbach. Revista Colombiana de Psiquiatría, 34(4), 572-580. http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0034-74502005000400009
Pereira Pérez, Z. (2011). Los diseños de método mixto en la investigación en educación: una experiencia concreta. Revista Electrónica Educare, 15(1), 15-29. https://doi.org/10.15359/ree.15-1.2
Putnick, D. L., y Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions. Psychological Methods, 21(4), 456-483. https://doi.org/10.1016/j.dr.2016.06.004
Ranganathan, P., Caduff, C., y Frampton, C. M. A. (2024). Designing and validating a research questionnaire - Part 2. Perspectives in Clinical Research, 15(1), 42-45. https://doi.org/10.4103/picr. picr_318_23
Ruiz Mendoza, K. K. (2024). Reflexiones conceptuales: método comparativo, investigación comparativa en educación, ¿educación o pedagogía comparada? Revista Española de Educación Comparada, (44), 417-436. https://doi.org/10.5944/reec.44.2024.35815
Sartor-Harada, A., y Azevedo Gomes, J. (2026). AI-ED-SAT: diseño y validación de un cuestionario para autoevaluar competencias docentes en IA educativa. RIED-Revista Iberoamericana de Educación a Distancia, 29(1), 79-110. https://doi.org/10.5944/ried.45413
Setiyawan, A., Soeharto, S., Wijaya, T. T., Korenova, L., y Lavicza, Z. (2025). Measuring teachers’ competencies for AI integration: Development and validation of the AI-TPACK in vocational education. Computers and Education Open, 9, 100319. https://doi.org/10.1016/j.caeo.2025.100319
Shi, L. (2025). Assessing teachers’ generative artificial intelligence competencies: Instrument development and validation. Education and Information Technologies, 30, 23365-23384. https://doi.org/10.1007/s10639-025-13684-5
UNESCO. (2025). Marco de competencias para docentes en materia de IA. UNESCO. https://doi.org/10.54675/AQKZ9414
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Authors who publish in Revista La Universidad agree to the following terms: Authors continue as owners of their works, non-exclusively assigning dissemination rights to La Universidad Journal under the standards of the Attribution-NonCommercial-ShareAlike License: CC BY-NC-SA 4.0. This license allows the use of a work to create another work or content, modifying or not the original work, as long as the author is cited, the resulting work is shared under the same type of license and has no commercial purposes(https://creativecommons.org/licenses/by-nc-sa/4.0/deed.es).

This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.



