Towards Causal Replay for Knowledge Rehearsal in Continual Learning

Churamani N., Cheong J., KALKAN S., Gunes H.

1st AAAI Bridge Program on Continual Causality, Washington, Amerika Birleşik Devletleri, 7 - 08 Şubat 2023, cilt.208, ss.63-70 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Cilt numarası: 208
  • Basıldığı Şehir: Washington
  • Basıldığı Ülke: Amerika Birleşik Devletleri
  • Sayfa Sayıları: ss.63-70
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Given the challenges associated with the real-world deployment of Machine Learning (ML) models, especially towards efficiently integrating novel information on-the-go, both Continual Learning (CL) and Causality have been proposed and investigated individually as potent solutions. Despite their complementary nature, the bridge between them is still largely unexplored. In this work, we focus on causality to improve the learning and knowledge preservation capabilities of CL models. In particular, positing Causal Replay for knowledge rehearsal, we discuss how CL-based models can benefit from causal interventions towards improving their ability to replay past knowledge in order to mitigate forgetting.