Theory-based learning analytics to explore student engagement patterns in a peer review activity


Er E., Villa-Torrano C., Dimitriadis Y., Gasevic D., Bote-Lorenzo M. L., Asensio-Pérez J. I., ...Daha Fazla

11th International Conference on Learning Analytics and Knowledge: The Impact we Make: The Contributions of Learning Analytics to Learning, LAK 2021, Virtual, Online, Amerika Birleşik Devletleri, 12 - 16 Nisan 2021, ss.196-206 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1145/3448139.3448158
  • Basıldığı Şehir: Virtual, Online
  • Basıldığı Ülke: Amerika Birleşik Devletleri
  • Sayfa Sayıları: ss.196-206
  • Anahtar Kelimeler: Peer reviews, learning analytics, student engagement, process mining, HIGHER-EDUCATION, PERCEPTIONS, FEEDBACK
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

© 2021 ACM.Peer reviews offer many learning benefits. Understanding students' engagement in them can help design effective practices. Although learning analytics can be effective in generating such insights, its application in peer reviews is scarce. Theory can provide the necessary foundations to inform the design of learning analytics research and the interpretation of its results. In this paper, we followed a theory-based learning analytics approach to identifying students' engagement patterns in a peer review activity facilitated via a web-based tool called Synergy. Process mining was applied on temporal learning data, traced by Synergy. The theory about peer review helped determine relevant data points and guided the top-down approach employed for their analysis: moving from the global phases to regulation of learning, and then to micro-level actions. The results suggest that theory and learning analytics should mutually relate with each other. Mainly, theory played a critical role in identifying a priori engagement patterns, which provided an informed perspective when interpreting the results. In return, the results of the learning analytics offered critical insights about student behavior that was not expected by the theory (i.e., low levels of co-regulation). The findings provided important implications for refining the grounding theory and its operationalization in Synergy.