Coherent concepts, robust learning

Dan Roth, Dmitry Zelenko

Research output: Chapter in Book/Report/Conference proceedingConference contribution


We study learning scenarios in which multiple learners are involved and "nature" imposes some constraints that force the predictions of these learners to behave coherently. This is natural in cognitive learning situations, where multiple learning problems co-exist but their predictions are constrained to produce a valid sentence, image or any other domain representation. Our theory addresses two fundamental issues in computational learning: (1) The apparent ease at which cognitive systems seem to learn concepts, relative to what is predicted by the theoretical models, and (2) The robustness of learnable concepts to noise in their input. This type of robustness is very important in cognitive systems, where multiple concepts are learned and cascaded to produce more and more complex features. Existing models of concept learning are extended by requiring the target concept to cohere with other concepts from the concept class. The coherency is expressed via a (Boolean) constraint that the concepts have to satisfy. We show how coherency can lead to improvements in the complexity of learning and to increased robustness of the learned hypothesis.

Original languageEnglish (US)
Title of host publicationSOFSEM 1999
Subtitle of host publicationTheory and Practice of Informatics - 26th Conference on Current Trends in Theory and Practice of Informatics, Proceedings
EditorsJan Pavelka, Miroslav Bartošek, Gerard Tel
Number of pages13
ISBN (Print)354066694X, 9783540666943
StatePublished - 1999
Externally publishedYes
Event26th Conference on Current Trends in Theory and Practice of Informatics, SOFSEM 1999 - Milovy, Czech Republic
Duration: Nov 27 1999Dec 4 1999

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Other26th Conference on Current Trends in Theory and Practice of Informatics, SOFSEM 1999
Country/TerritoryCzech Republic

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)


Dive into the research topics of 'Coherent concepts, robust learning'. Together they form a unique fingerprint.

Cite this