Static Index Pruning in Web Search Engines: Combining Term and Document Popularities with Query Views


Creative Commons License

Altingovde İ. S., Ozcan R., Ulusoy O.

ACM TRANSACTIONS ON INFORMATION SYSTEMS, cilt.30, sa.1, 2012 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 30 Sayı: 1
  • Basım Tarihi: 2012
  • Doi Numarası: 10.1145/2094072.2094074
  • Dergi Adı: ACM TRANSACTIONS ON INFORMATION SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Anahtar Kelimeler: Algorithms, Experimentation, Performance, Query view, static inverted index pruning
  • Orta Doğu Teknik Üniversitesi Adresli: Evet

Özet

Static index pruning techniques permanently remove a presumably redundant part of an inverted file, to reduce the file size and query processing time. These techniques differ in deciding which parts of an index can be removed safely; that is, without changing the top-ranked query results. As defined in the literature, the query view of a document is the set of query terms that access to this particular document, that is, retrieves this document among its top results. In this paper, we first propose using query views to improve the quality of the top results compared against the original results. We incorporate query views in a number of static pruning strategies, namely term-centric, document-centric, term popularity based and document access popularity based approaches, and show that the new strategies considerably outperform their counterparts especially for the higher levels of pruning and for both disjunctive and conjunctive query processing. Additionally, we combine the notions of term and document access popularity to form new pruning strategies, and further extend these strategies with the query views. The new strategies improve the result quality especially for the conjunctive query processing, which is the default and most common search mode of a search engine.