Validation of questionnaires on the evaluation of the quality of LMS platforms in the university context using the modified DELPHI method

Janeth Mora Secaira, Raúl Díaz Ocampo, Francisco P. Rodríguez Miranda

Abstract

The purpose of this study was to develop and validate questionnaires aimed at students, faculty, and administrators to evaluate the quality of Learning Management System (LMS) platforms in university contexts. A methodological design based on the modified Delphi method was adopted, applied in two rounds of consultation with 12 experts in educational technology, pedagogy, instructional design, and digital platform management. The items were evaluated based on criteria of clarity and relevance using a Likert scale, and analyzed through descriptive statistics, Cohen’s Kappa coefficient, and Cronbach’s Alpha. The findings show high levels of agreement among experts (Cohen’s Kappa > 0.75) and high internal reliability of the questionnaires (α > 0.94), demonstrating the robustness of the instruments developed. The multidimensional validation (technical, pedagogical, usability, and administrative) made it possible to construct comprehensive and coherent tools aligned with the current needs of digital higher education. It is concluded that the validated questionnaires are suitable for evaluating the quality of LMS platforms from different institutional perspectives. As a practical implication, these questionnaires can be used by universities to diagnose strengths and weaknesses in their LMS platforms, facilitating continuous improvement processes and evidence-based decision-making.

Authors

Janeth Mora Secaira
jmora@uteq.edu.ec (Primary Contact)
Raúl Díaz Ocampo
Secaira, J. M. ., Ocampo, R. D. ., & Miranda, F. P. R. . (2025). Validation of questionnaires on the evaluation of the quality of LMS platforms in the university context using the modified DELPHI method. International Journal of Innovative Research and Scientific Studies, 8(4), 2205–2218. https://doi.org/10.53894/ijirss.v8i4.8357

Article Details

No Related Submission Found