KLOOS: KL Divergence-based Out-of-Scope Intent Detection in Human-to-Machine Conversations

Yilmaz E. H., Toraman Ç.

43rd International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR), ELECTR NETWORK, 25 - 30 Temmuz 2020, ss.2105-2108 identifier identifier

  • Yayın Türü: Bildiri / Tam Metin Bildiri
  • Doi Numarası: 10.1145/3397271.3401318
  • Basıldığı Ülke: ELECTR NETWORK
  • Sayfa Sayıları: ss.2105-2108
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

User intent is not restricted in human-to-machine conversations, and sometimes overshoots the scope of a designed system. Many tasks for understanding conversations require the elimination of such out-of-scope queries. We propose an out-of-scope intent detection method, called KLOOS, based on a novel feature extraction mechanism that incorporates the information accumulation of sequential word processing. Information is accumulated by KL divergence between the intent distributions of consecutive words. The performance of our approach is compared with the conventional classifiers and state-of-the-art language models fine-tuned for out-of-scope detection on three spoken query collections. The results show that KLOOS statistically significantly improves outof-scope sensitivity in all cases, while the overall performance is not deteriorated in most cases.