Online learning and integration of complex action and word lexicons for language grounding

Logan Niehaus, Stephen E Levinson

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper presents a computational framework for the development and integration of action and language capabilities through symbol grounding. Our approach is based around the fundamental technique of building lexicons of perceptual "simulators" which link noisy sensory experiences to internal symbolic representations. These sensory representations are paired with a basic model of association, allowing for the grounding of linguistic symbols directly in action knowledge - a grounding which is then exploited to bootstrap the development of more advanced capabilities. The performance of this computational framework is tested in the context of online tutoring scenarios using the iCub robotic platform. Such an experimental environment requires development of techniques and algorithms suited for incremental learning and real-time processing.

Original languageEnglish (US)
Title of host publication2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012
DOIs
StatePublished - Dec 1 2012
Event2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012 - "San Diego,CA", United States
Duration: Nov 7 2012Nov 9 2012

Publication series

Name2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012

Other

Other2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012
CountryUnited States
City"San Diego,CA"
Period11/7/1211/9/12

    Fingerprint

ASJC Scopus subject areas

  • Artificial Intelligence
  • Human-Computer Interaction

Cite this

Niehaus, L., & Levinson, S. E. (2012). Online learning and integration of complex action and word lexicons for language grounding. In 2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012 [6400812] (2012 IEEE International Conference on Development and Learning and Epigenetic Robotics, ICDL 2012). https://doi.org/10.1109/DevLrn.2012.6400812