Efficient Multiclass Boosting Classification with Active Learning


Huang J., Ertekin Ş., Song Y., Zha H., Giles C. L.

7th SIAM International Conference on Data Mining, Minnesota, Amerika Birleşik Devletleri, 26 - 28 Nisan 2007, ss.297-308 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Basıldığı Şehir: Minnesota
  • Basıldığı Ülke: Amerika Birleşik Devletleri
  • Sayfa Sayıları: ss.297-308
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

We propose a novel multiclass classification algorithm Gentle Adaptive Multiclass Boosting Learning (GAMBLE). The algorithm naturally extends the two class Gentle AdaBoost algorithm to multiclass classification by using the multiclass exponential loss and the multiclass response encoding scheme. Unlike other multiclass algorithms which reduce the K-class classification task to K binary classifications, GAMBLE handles the task directly and symmetrically, with only one committee classifier. We formally derive the GAM-BLE algorithm with the quasi-Newton method, and prove the structural equivalence of the two regression trees in each boosting step.