Group-based interface for content-based image retrieval

In Content-based Image Retrieval (CBIR) systems, the Query-by-Example (QBE) approach is commonly used. However, because of inevitable "semantic gaps" between visual features and the user's concepts, trial-and-error query is essential for successful retrieval. Unfortunately, traditional user interfaces are not suitable for trying different combinations of query examples. This is because in these systems, query specification and result display are done on the same workspace. Once the user removes an image from the query examples, the image may disappear from the user interface. In addition, it is difficult to combine the result of different queries. In this paper, we propose a new interface for Content-based image retrieval. In our system, the users can interactively compare different combinations of query examples by dragging and grouping images on the workspace (Query-by-Group.) Because the query results are displayed on another pane, the user can quickly review the results. Combining different queries is also easy. Furthermore, the concept of "image groups" is also applied to annotating and organizing a large number of images. Because the gestural operations of our system is similar to file operations of modern window-based operation systems, users can easily learn to use the system.