Ontological random forests for image classification

Ning Xu, Jiangping Wang, Guojun Qi, Thomas Huang, Weiyao Lin

Research output: Chapter in Book/Report/Conference proceedingChapter


Previous image classification approaches mostly neglect semantics, which has two major limitations. First, categories are simply treated independently while in fact they have semantic overlaps. For example, “sedan” is a specific kind of “car”. Therefore, it’s unreasonable to train a classifier to distinguish between “sedan” and “car”. Second, image feature representations used for classifying different categories are the same. However, the human perception system is believed to use different features for different objects. In this paper, we leverage semantic ontologies to solve the aforementioned problems. The authors propose an ontological random forest algorithm where the splitting of decision trees are determined by semantic relations among categories. Then hierarchical features are automatically learned by multiple-instance learning to capture visual dissimilarities at different concept levels. Their approach is tested on two image classification datasets. Experimental results demonstrate that their approach not only outperforms state-of-the-art results but also identifies semantic visual features.

Original languageEnglish (US)
Title of host publicationComputer Vision
Subtitle of host publicationConcepts, Methodologies, Tools, and Applications
PublisherIGI Global
Number of pages16
ISBN (Electronic)9781522552055
ISBN (Print)9781522552048
StatePublished - Jan 1 2018

ASJC Scopus subject areas

  • General Computer Science


Dive into the research topics of 'Ontological random forests for image classification'. Together they form a unique fingerprint.

Cite this