Incremental cluster-based retrieval using compressed cluster-skipping inverted files


Creative Commons License

Altingovde İ. S., Demir E., Can F., Ulusoy O.

ACM TRANSACTIONS ON INFORMATION SYSTEMS, cilt.26, sa.3, 2008 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 26 Sayı: 3
  • Basım Tarihi: 2008
  • Doi Numarası: 10.1145/1361684.1361688
  • Dergi Adı: ACM TRANSACTIONS ON INFORMATION SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Anahtar Kelimeler: experimentation, measurement, performance, best match, cluster-based retrieval (CBR), cluster-skipping inverted index structure (CS-IIS), full search (FS), index compression, inverted index structure (IIS), query processing, EFFICIENCY, RANKING
  • Orta Doğu Teknik Üniversitesi Adresli: Hayır

Özet

We propose a unique cluster-based retrieval (CBR) strategy using a new cluster-skipping inverted file for improving query processing efficiency. The new inverted file incorporates cluster membership and centroid information along with the usual document information into a single structure. In our incremental-CBR strategy, during query evaluation, both best(-matching) clusters and the best(-matching) documents of such clusters are computed together with a single posting-list access per query term. As we switch from term to term, the best clusters are recomputed and can dynamically change. During query-document matching, only relevant portions of the posting lists corresponding to the best clusters are considered and the rest are skipped. The proposed approach is essentially tailored for environments where inverted files are compressed, and provides substantial efficiency improvement while yielding comparable, or sometimes better, effectiveness figures. Our experiments with various collections show that the incremental- CBR strategy using a compressed cluster-skipping inverted file significantly improves CPU time efficiency, regardless of query length. The new compressed inverted file imposes an acceptable storage overhead in comparison to a typical inverted file. We also show that our approach scales well with the collection size.