Multi-dimensional evaluation of e-learning systems in the higher education context: Empirical investigations


Thesis Type: Postgraduate

Institution Of The Thesis: Orta Doğu Teknik Üniversitesi, Graduate School of Informatics, Information Systems, Turkey

Approval Date: 2009

Student: REFİKA KÖSELER

Consultant: SEVGİ ÖZKAN YILDIRIM

Abstract:

There has been little research on assessment of learning management systems (LMS) within educational organizations as both a web-based learning system for e-learning and as a supportive tool for blended learning environments. This study proposes a conceptual e-learning assessment model, HELAM (Hexagonal e-Learning Assessment Model) suggesting a multi-dimensional approach for LMS evaluation via six dimensions: (1) system quality, (2) service quality, (3) information (content) quality, (4) learner perspective, (5) instructor quality, and (6) supportive issues. A survey instrument based on HELAM has been developed and applied to 374 learners. This sample consists of students at both undergraduate and graduate levels who are users of a web-based learning management system, U-Link, at Brunel University, UK and NetClass LMS at METU, Turkey. The survey instrument has been tested for content validity, reliability, and criterion-based predictive validity. The explanatory factor analysis shows that each of the six dimensions of the proposed model had a significant effect on the learners‟ perceived satisfaction. Confirmatory factor analyses used to assess the number of factors and the loadings of variables. The results of confirmatory factor analyses were overlapped with the proposed model. Structural Equation Modeling (SEM) statistical analysis was used to validate the research model. The analytical results strongly support the appropriateness of the proposed model in evaluating LMSs through learners‟ satisfaction. Additionally, individual case results were presented with descriptive statistics, Pearson‟s Product Correlations outputs. Findings of this research will be valuable for both academics and practitioners of e-learning systems. The presented statistical results highlighted the importance of supposing a multidimensional analytical approach for e-learning system success evaluation. The proposed model provided several implications for e-learning effectiveness evaluation.