Benchmarks for storage and retrieval in multimedia databases

Research output: Contribution to journalConference article

Abstract

There is a substantial body of research on computer methods for managing collections of images and videos. There is little evidence that this research has had important impact on an any community yet. I use an invitation to speak on a topic on which I am not expert to air some opinions about evaluating image retrieval research. In my opinion, there is little to be gained in measuring current solutions with reference collections, because these solutions differ so widely from user needs that the exercise becomes empty. The user studies literature is not well enough read by the image retrieval community. As a result, we tend to study somewhat artificial problems. A study of the user needs literature suggests that we will need to solve deep problems to produce useful solutions to image retrieval problems, but that there may be a need for a number of technologies that can be built in practice. I believe we should concentrate on these issues, rather than on measuring the performance of current systems.

Original languageEnglish (US)
Pages (from-to)240-247
Number of pages8
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume4676
DOIs
StatePublished - Jan 1 2002
Externally publishedYes
EventStorage and Retrieval for Media Databases 2002 - San Jose, CA, United States
Duration: Jan 23 2002Jan 25 2002

Fingerprint

Multimedia Databases
multimedia
Image retrieval
Image Retrieval
retrieval
Retrieval
Benchmark
User Studies
Exercise
physical exercise
Tend
Air
computer programs
air
Community

Keywords

  • Computer vision
  • Content based image retrieval
  • Image databases
  • Multimedia databases
  • Object recognition

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this

Benchmarks for storage and retrieval in multimedia databases. / Forsyth, D. A.

In: Proceedings of SPIE - The International Society for Optical Engineering, Vol. 4676, 01.01.2002, p. 240-247.

Research output: Contribution to journalConference article

@article{9a4af923de21434f96a4c7f5983fcfcd,
title = "Benchmarks for storage and retrieval in multimedia databases",
abstract = "There is a substantial body of research on computer methods for managing collections of images and videos. There is little evidence that this research has had important impact on an any community yet. I use an invitation to speak on a topic on which I am not expert to air some opinions about evaluating image retrieval research. In my opinion, there is little to be gained in measuring current solutions with reference collections, because these solutions differ so widely from user needs that the exercise becomes empty. The user studies literature is not well enough read by the image retrieval community. As a result, we tend to study somewhat artificial problems. A study of the user needs literature suggests that we will need to solve deep problems to produce useful solutions to image retrieval problems, but that there may be a need for a number of technologies that can be built in practice. I believe we should concentrate on these issues, rather than on measuring the performance of current systems.",
keywords = "Computer vision, Content based image retrieval, Image databases, Multimedia databases, Object recognition",
author = "Forsyth, {D. A.}",
year = "2002",
month = "1",
day = "1",
doi = "10.1117/12.451112",
language = "English (US)",
volume = "4676",
pages = "240--247",
journal = "Proceedings of SPIE - The International Society for Optical Engineering",
issn = "0277-786X",
publisher = "SPIE",

}

TY - JOUR

T1 - Benchmarks for storage and retrieval in multimedia databases

AU - Forsyth, D. A.

PY - 2002/1/1

Y1 - 2002/1/1

N2 - There is a substantial body of research on computer methods for managing collections of images and videos. There is little evidence that this research has had important impact on an any community yet. I use an invitation to speak on a topic on which I am not expert to air some opinions about evaluating image retrieval research. In my opinion, there is little to be gained in measuring current solutions with reference collections, because these solutions differ so widely from user needs that the exercise becomes empty. The user studies literature is not well enough read by the image retrieval community. As a result, we tend to study somewhat artificial problems. A study of the user needs literature suggests that we will need to solve deep problems to produce useful solutions to image retrieval problems, but that there may be a need for a number of technologies that can be built in practice. I believe we should concentrate on these issues, rather than on measuring the performance of current systems.

AB - There is a substantial body of research on computer methods for managing collections of images and videos. There is little evidence that this research has had important impact on an any community yet. I use an invitation to speak on a topic on which I am not expert to air some opinions about evaluating image retrieval research. In my opinion, there is little to be gained in measuring current solutions with reference collections, because these solutions differ so widely from user needs that the exercise becomes empty. The user studies literature is not well enough read by the image retrieval community. As a result, we tend to study somewhat artificial problems. A study of the user needs literature suggests that we will need to solve deep problems to produce useful solutions to image retrieval problems, but that there may be a need for a number of technologies that can be built in practice. I believe we should concentrate on these issues, rather than on measuring the performance of current systems.

KW - Computer vision

KW - Content based image retrieval

KW - Image databases

KW - Multimedia databases

KW - Object recognition

UR - http://www.scopus.com/inward/record.url?scp=0036028651&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0036028651&partnerID=8YFLogxK

U2 - 10.1117/12.451112

DO - 10.1117/12.451112

M3 - Conference article

AN - SCOPUS:0036028651

VL - 4676

SP - 240

EP - 247

JO - Proceedings of SPIE - The International Society for Optical Engineering

JF - Proceedings of SPIE - The International Society for Optical Engineering

SN - 0277-786X

ER -