Instruments to Measure Teachers’ Artificial Intelligence Competence: Comparison and Integration Based on the UNESCO Framework

Authors

DOI:

https://doi.org/10.66778/LU.e02v07n04.01

Keywords:

competencias del docente, educación superior, evaluación de la educación, formación de docente, educación superior; inteligencia artificial; proceso de enseñanza-aprendizaje

Abstract

Introduction: AI training opportunities within higher education require a prior diagnostic assessment to determine faculty competence levels and suggest tailored learning paths. Although the UNESCO Framework stands out as a key reference due to its human-centered focus, it lacks a measurement instrument and quantitative ranges for proficiency levels. Available scales remain fragmented, in English, validated in other contexts, or poorly aligned with the framework. Given the heterogeneous training demands identified at the University of El Salvador (UES) between 2025 and 2026, integrating a suitable instrument became essential. Objective: To integrate a questionnaire to measure AI competencies among UES faculty using validated subscales aligned with the UNESCO Framework. Methodology: Between May and July 2026, a four-phase procedure evaluated six instruments (TAICS, AI-ED-SAT, AICTS, T-GAIC, AILST, and AITPACK). Key subscales were selected, five custom institutional contextualization blocks were added, and a pilot test was conducted with faculty members. Results and Discussion: A nine-block questionnaire was structured (AI-ED-SAT as the core base, three TAICS subscales, and custom contextual blocks). The pilot test confirmed comprehensibility, achieving an average clarity score of 96.09 % (Excellent). Findings demonstrate that the articulated integration of subscales overcomes local relevance limitations of international scales. Conclusions: The applied methodological framework provides a replicable procedure to assemble tools without compromising the original psychometric rigor. The resulting instrument yields a self-perception diagnosis essential for guiding faculty training at UES.

Downloads

Download data is not yet available.

Author Biographies

  • Karina Marisol Guardado de Castillo, Universidad de El Salvador

    Investigadora 

  • Francisco Ernesto Ramas Arauz, Ciudad de México, MéxicoUniversidad Nacional Autónoma de México, México

    Investigador 

References

Carbajal-Degante, E. (2025). De la UNESCO a la UNAM: adaptación de un marco de competencias docentes en inteligencia artificial para la educación. Revista Mexicana de Bachillerato a Distancia, 17(33). https://doi.org/10.22201/cuaieed.20074751e.2025.33.90977

Celik, I., Dindar, M., Muukkonen, H., y Järvelä, S. (2022). The promises and challenges of artificial intelligence for teachers: A systematic review of research. TechTrends, 66(4), 616-630. https://doi.org/10.1007/s11528-022-00715-y

Chiu, T. K. F., Ahmad, Z., y Çoban, M. (2025). Development and validation of teacher artificial intelligence (AI) competence self-efficacy (TAICS) scale. Education and Information Technologies, 30, 6667-6685. https://doi.org/10.1007/s10639-024-13094-z

Costello, A. B., y Osborne, J. W. (2005). Best practices in exploratory factor analysis: Four recommendations for getting the most from your analysis. Practical Assessment, Research, and Evaluation, 10(7), 1-9. https://doi.org/10.7275/jyj1-4868

Galán-Íñigo, A., Ruiz-Lázaro, J., y Jiménez-García, E. (2025). Análisis comparado de los marcos de competencias en inteligencia artificial en el ámbito educativo. Edutec. Revista Electrónica de Tecnología Educativa, (93), 185-208. https://doi.org/10.21556/edutec.2025.93.3699

Gallego, L., y Araque, O. (2019). Variables de influencia en la capacidad de aprendizaje: un análisis por conglomerados y componentes principales. Información Tecnológica, 30(2), 257-264. https://doi.org/10.4067/S0718-07642019000200257

Hu, L. T., y Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal, 6(1), 1-55. https://doi.org/10.1080/10705519909540118

Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., y Tomás-Marco, I. (2014). El análisis factorial exploratorio de los ítems: Una guía práctica, revisada y actualizada. Anales de Psicología, 30(3), 1151-1169. https://doi.org/10.6018/analesps.30.3.199361

López Falcón, A. L., y Ramos Serpa, G. (2021). Acerca de los métodos teóricos y empíricos de investigación: significación para la investigación educativa. Revista Conrado, 17(S3), 22-31. https://conrado.ucf.edu.cu/index.php/conrado/article/view/2133

Majeed, S., y Farooq, M. S. (2025). Artificial Intelligence Competence Teachers’ Assessment Scale (AICTS): Development and validation. Journal of Innovations in Education and Social Sciences, 2(1), 223-238. https://jiess.org.uk/index.php/jiess/article/view/66

Maldonado-Suárez, N., y Santoyo-Telles, F. (2024). Validez de contenido por juicio de expertos: integración cuantitativa y cualitativa en la construcción de instrumentos de medición. REIRE Revista d’Innovació i Recerca en Educació, 17(2), 1-19. https://doi.org/10.1344/reire.46238

Martín-Párraga, L., Llorente-Cejudo, C., y Cabero-Almenara, J. (2022). Análisis de las competencias digitales docentes desde los marcos e instrumentos de evaluación. International Journal of Educational Research and Innovation, (18), 62-79. https://doi.org/10.46661/ijeri.7444

Miao, F., y Cukurova, M. (2024). AI competency framework for teachers. UNESCO. https://doi.org/10.54675/ZJTE2084

Montero, I., y León, O. G. (2007). A guide for naming research studies in Psychology. International Journal of Clinical and Health Psychology, 7(3), 847-862. https://www.aepc.es/ijchp/GNEIP07_es.pdf

Muñiz, J., y Fonseca-Pedrero, E. (2008). Construcción de instrumentos de medida para la evaluación universitaria. Revista de Investigación en Educación, 5(1), 13-25. https://revistas.uvigo.es/index.php/reined/article/view/1816

Ning, Y., Zhang, W., Yao, D., Fang, B., Xu, B., y Wijaya, T. T. (2025). Development and validation of the Artificial Intelligence Literacy Scale for Teachers (AILST). Education and Information Technologies, 30(12), 17769-17803. https://doi.org/10.1007/s10639-025-13347-5

Oviedo, H. C., y Campo-Arias, A. (2005). Aproximación al uso del coeficiente alfade Cronbach. Revista Colombiana de Psiquiatría, 34(4), 572-580. http://www.scielo.org.co/scielo.php?script=sci_arttext&pid=S0034-74502005000400009

Pereira Pérez, Z. (2011). Los diseños de método mixto en la investigación en educación: una experiencia concreta. Revista Electrónica Educare, 15(1), 15-29. https://doi.org/10.15359/ree.15-1.2

Putnick, D. L., y Bornstein, M. H. (2016). Measurement invariance conventions and reporting: The state of the art and future directions. Psychological Methods, 21(4), 456-483. https://doi.org/10.1016/j.dr.2016.06.004

Ranganathan, P., Caduff, C., y Frampton, C. M. A. (2024). Designing and validating a research questionnaire - Part 2. Perspectives in Clinical Research, 15(1), 42-45. https://doi.org/10.4103/picr. picr_318_23

Ruiz Mendoza, K. K. (2024). Reflexiones conceptuales: método comparativo, investigación comparativa en educación, ¿educación o pedagogía comparada? Revista Española de Educación Comparada, (44), 417-436. https://doi.org/10.5944/reec.44.2024.35815

Sartor-Harada, A., y Azevedo Gomes, J. (2026). AI-ED-SAT: diseño y validación de un cuestionario para autoevaluar competencias docentes en IA educativa. RIED-Revista Iberoamericana de Educación a Distancia, 29(1), 79-110. https://doi.org/10.5944/ried.45413

Setiyawan, A., Soeharto, S., Wijaya, T. T., Korenova, L., y Lavicza, Z. (2025). Measuring teachers’ competencies for AI integration: Development and validation of the AI-TPACK in vocational education. Computers and Education Open, 9, 100319. https://doi.org/10.1016/j.caeo.2025.100319

Shi, L. (2025). Assessing teachers’ generative artificial intelligence competencies: Instrument development and validation. Education and Information Technologies, 30, 23365-23384. https://doi.org/10.1007/s10639-025-13684-5

UNESCO. (2025). Marco de competencias para docentes en materia de IA. UNESCO. https://doi.org/10.54675/AQKZ9414

Published

2026-10-01

How to Cite

Guardado de Castillo, K. M., & Ramas Arauz, F. E. (2026). Instruments to Measure Teachers’ Artificial Intelligence Competence: Comparison and Integration Based on the UNESCO Framework. La Universidad, 7(4), 11-34. https://doi.org/10.66778/LU.e02v07n04.01