An Analysis on Disentanglement in Machine Learning Makine Öǧrenmesinde Ayrişiklik Üzerine Bir Analiz


MOĞULTAY H., KALKAN S., YARMAN VURAL F. T.

30th Signal Processing and Communications Applications Conference, SIU 2022, Safranbolu, Türkiye, 15 - 18 Mayıs 2022 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1109/siu55565.2022.9864743
  • Basıldığı Şehir: Safranbolu
  • Basıldığı Ülke: Türkiye
  • Anahtar Kelimeler: Disentanglement, representation learning, variational autoencoder
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

© 2022 IEEE.Learnt representations by Deep autoencoders is not capable of decomposing the complex information into simple notion. In other words, attributes of samples are entangled in the basis vectors spanning the learned space. This leads to significant errors in deep learning algorithms. In order to avoid these errors, it is necessary to separate the feature space according to the common features shared between classes and to define a simple subspace for each feature. This approach has led to the birth of a new paradigm in Machine Learning, called disentanglement.Roughly, disentangled models can be defined as models that can independently learn the different components of the probability density function that produces the dataset in the feature space. Unfortunately, it is not always possible to learn these models. For this reason, there is still no easily applicable mathematical definition of disentanglement in the literature. In this study, a mathematical definition of the concept of disentanglement will be made and methods and metrics related to this approach will be discussed.