Mining test oracles of web search engines

Wujie Zheng, Hao Ma, Michael R. Lyu, Tao Xie, Irwin King

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Web search engines have major impact in people's everyday life. It is of great importance to test the retrieval effectiveness of search engines. However, it is labor-intensive to judge the relevance of search results for a large number of queries, and these relevance judgments may not be reusable since the Web data change all the time. In this work, we propose to mine test oracles of Web search engines from existing search results. The main idea is to mine implicit relationships between queries and search results, e.g., some queries may have fixed top 1 result while some may not, and some Web domains may appear together in top 10 results. We define a set of items of queries and search results, and mine frequent association rules between these items as test oracles. Experiments on major search engines show that our approach mines many high-confidence rules that help understand search engines and detect suspicious search results.

Original languageEnglish (US)
Title of host publication2011 26th IEEE/ACM International Conference on Automated Software Engineering, ASE 2011, Proceedings
PublisherIEEE Computer Society
Pages408-411
Number of pages4
ISBN (Print)9781457716393
DOIs
StatePublished - Jan 1 2011
Externally publishedYes
Event2011 26th IEEE/ACM International Conference on Automated Software Engineering, ASE 2011 - Lawrence, KS, United States
Duration: Nov 6 2011Nov 10 2011

Publication series

Name2011 26th IEEE/ACM International Conference on Automated Software Engineering, ASE 2011, Proceedings

Other

Other2011 26th IEEE/ACM International Conference on Automated Software Engineering, ASE 2011
CountryUnited States
CityLawrence, KS
Period11/6/1111/10/11

ASJC Scopus subject areas

  • Software

Fingerprint Dive into the research topics of 'Mining test oracles of web search engines'. Together they form a unique fingerprint.

Cite this