Generating actionable predictions regarding MOOC learners' engagement in peer reviews


Creative Commons License

Er E., Gomez-Sanchez E., Bote-Lorenzo M. L., Dimitriadis Y., Asensio-Perez J. I.

BEHAVIOUR & INFORMATION TECHNOLOGY, cilt.39, sa.12, ss.1356-1373, 2020 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 39 Sayı: 12
  • Basım Tarihi: 2020
  • Doi Numarası: 10.1080/0144929x.2019.1669222
  • Dergi Adı: BEHAVIOUR & INFORMATION TECHNOLOGY
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Social Sciences Citation Index (SSCI), Scopus, Academic Search Premier, FRANCIS, Aerospace Database, Applied Science & Technology Source, Business Source Elite, Business Source Premier, CINAHL, Communication & Mass Media Index, Communication Abstracts, Compendex, Computer & Applied Sciences, Educational research abstracts (ERA), INSPEC, Library and Information Science Abstracts, Metadex, Psycinfo, Civil Engineering Abstracts, Library, Information Science & Technology Abstracts (LISTA)
  • Sayfa Sayıları: ss.1356-1373
  • Anahtar Kelimeler: Engagement prediction, MOOC, peer review, transfer across courses, in situ learning, STUDENTS, PERFORMANCE, POWER, AREA
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

Peer review is one approach to facilitate formative feedback exchange in MOOCs; however, it is often undermined by low participation. To support effective implementation of peer reviews in MOOCs, this research work proposes several predictive models to accurately classify learners according to their expected engagement levels in an upcoming peer-review activity, which offers various pedagogical utilities (e.g. improving peer reviews and collaborative learning activities). Two approaches were used for training the models: in situ learning (in which an engagement indicator available at the time of the predictions is used as a proxy label to train a model within the same course) and transfer across courses (in which a model is trained using labels obtained from past course data). These techniques allowed producing predictions that are actionable by the instructor while the course still continues, which is not possible with post-hoc approaches requiring the use of true labels. According to the results, both transfer across courses and in situ learning approaches have produced predictions that were actionable yet as accurate as those obtained with cross validation, suggesting that they deserve further attention to create impact in MOOCs with real-world interventions. Potential pedagogical uses of the predictions were illustrated with several examples.