Resampling approach for cluster model selection

Creative Commons License

Volkovich Z., Barzily Z., Weber G., Toledano-Kitai D., Avros R.

MACHINE LEARNING, cilt.85, ss.209-248, 2011 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 85
  • Basım Tarihi: 2011
  • Doi Numarası: 10.1007/s10994-011-5236-9
  • Dergi Adı: MACHINE LEARNING
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.209-248
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

In cluster analysis, selecting the number of clusters is an "ill-posed" problem of crucial importance. In this paper we propose a re-sampling method for assessing cluster stability. Our model suggests that samples' occurrences in clusters can be considered as realizations of the same random variable in the case of the "true" number of clusters. Thus, similarity between different cluster solutions is measured by means of compound and simple probability metrics. Compound criteria result in validation rules employing the stability content of clusters. Simple probability metrics, in particular those based on kernels, provide more flexible geometrical criteria. We analyze several applications of probability metrics combined with methods intended to simulate cluster occurrences. Numerical experiments are provided to demonstrate and compare the different metrics and simulation approaches.