Generative prior knowledge for discriminative classification

Arkady Epshteyn, Gerald DeJong

Research output: Contribution to journalArticlepeer-review


We present a novel framework for integrating prior knowledge into discriminative classifiers. Our framework allows discriminative classifiers such as Support Vector Machines (SVMs) to utilize prior knowledge specified in the generative setting. The dual objective of fitting the data and respecting prior knowledge is formulated as a bilevel program, which is solved (approximately) via iterative application of second-order cone programming. To test our approach, we consider the problem of using WordNet (a semantic database of English language) to improve low-sample classification accuracy of newsgroup categorization. WordNet is viewed as an approximate, but readily available source of background knowledge, and our framework is capable of utilizing it in a flexible way.

Original languageEnglish (US)
Pages (from-to)25-53
Number of pages29
JournalJournal of Artificial Intelligence Research
StatePublished - Sep 2006

ASJC Scopus subject areas

  • Artificial Intelligence

Fingerprint Dive into the research topics of 'Generative prior knowledge for discriminative classification'. Together they form a unique fingerprint.

Cite this