Automatic multi-modal dialogue scene indexing

Alatan A.

International Conference on Image Processing (ICIP 2001), Thessaloniki, Yunanistan, 7 - 10 Ekim 2001, ss.374-377 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Basıldığı Şehir: Thessaloniki
  • Basıldığı Ülke: Yunanistan
  • Sayfa Sayıları: ss.374-377
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

An automatic algorithm for indexing dialogue scenes in multimedia content is proposed The content is segmented into dialogue scenes using the state transitions of a hidden Markov model (HMM) Each shot is classified using both audio and visual information to determine the state/scene transitions for this model Face detection and silence/speech/music classification are the basic tools which are utilized to index the scenes While face information is extracted after applying some heuristics to skin-colored regions, audio analysis is achieved by examining signal energy, periodicity and zero crossing rate (ZCR) of the audio waveform The simulation results show the possibility of automatically indexing the dialogues using the proposed algorithm.