Learning with infinitely many kernels via semi-infinite programming


Oezoeguer-Akyuez S., Weber G. W.

20th International Conference/Euro Mini Conference on Continuous Optimization and Knowledge-Based Technologies (EurOPT 2008), Neringa, Litvanya, 20 - 23 Mayıs 2008, ss.342-348 identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Basıldığı Şehir: Neringa
  • Basıldığı Ülke: Litvanya
  • Sayfa Sayıları: ss.342-348
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

In recent years, learning methods are desirable because of their reliability and efficiency in real-world problems. We propose a novel method to find infinitely many kernel combinations for learning problems with the help of infinite and semi-infinite optimization regarding all elements in kernel space. This will provide to study variations of combinations of kernels when considering heterogeneous data in real-world applications. Looking at all infinitesimally fine convex combinations of the kernels from the infinite kernel set, the margin is maximized subject to an infinite number of constraints with a compact index set and an additional (Riemann-Stieltjes) integral constraint due to the combinations. After a parametrisation in the space of probability measures it becomes semi-infinite. We analyze the conditions which satisfy the Reduction Ansatz and discuss the type of distribution functions of the kernel coefficients within the structure of the constraints and our bilevel optimization problem.