Automatic Language Acquisition by an Autonomous Robot

Stephen E Levinson, Weiyu Zhu, Danfeng Li, Kevin Squire, Ruei Sung Lin, Matthew Kleffner, Matthew McClain, Johnny Lee

Research output: Contribution to conferencePaper

Abstract

There is no such thing as a disembodied mind. We posit that cognitive development can only occur through interaction with the physical world. To this end, we are developing a robotic platform for the purpose of studying cognition. We suggest that the central component of cognition is a memory which is primarily associative, one where learning occurs as the correlation of events from diverse inputs. We also posit that human-like cognition requires a well-integrated sensory-motor system, to provide these diverse inputs. As implemented in our robot, this system includes binaural hearing, stereo vision, tactile sense, and basic proprioceptive control. On top of these abilities, we are implementing and studying various models of processing, learning and decision making. Our goal is to produce a robot that will learn to carry out simple tasks in response to natural language requests. The robot's understanding of language will be learned concurrently with its other cognitive abilities. We have already developed a robust system and conducted a number of experiments on the way to this goal, some details of which appear in this paper. This is a first progress report of what we believe will be a long term project with significant implications.

Original languageEnglish (US)
Pages2716-2721
Number of pages6
StatePublished - Sep 25 2003
EventInternational Joint Conference on Neural Networks 2003 - Portland, OR, United States
Duration: Jul 20 2003Jul 24 2003

Other

OtherInternational Joint Conference on Neural Networks 2003
CountryUnited States
CityPortland, OR
Period7/20/037/24/03

Fingerprint

Robots
Stereo vision
Audition
Robotics
Decision making
Data storage equipment
Processing
Experiments

ASJC Scopus subject areas

  • Software
  • Artificial Intelligence

Cite this

Levinson, S. E., Zhu, W., Li, D., Squire, K., Lin, R. S., Kleffner, M., ... Lee, J. (2003). Automatic Language Acquisition by an Autonomous Robot. 2716-2721. Paper presented at International Joint Conference on Neural Networks 2003, Portland, OR, United States.

Automatic Language Acquisition by an Autonomous Robot. / Levinson, Stephen E; Zhu, Weiyu; Li, Danfeng; Squire, Kevin; Lin, Ruei Sung; Kleffner, Matthew; McClain, Matthew; Lee, Johnny.

2003. 2716-2721 Paper presented at International Joint Conference on Neural Networks 2003, Portland, OR, United States.

Research output: Contribution to conferencePaper

Levinson, SE, Zhu, W, Li, D, Squire, K, Lin, RS, Kleffner, M, McClain, M & Lee, J 2003, 'Automatic Language Acquisition by an Autonomous Robot', Paper presented at International Joint Conference on Neural Networks 2003, Portland, OR, United States, 7/20/03 - 7/24/03 pp. 2716-2721.
Levinson SE, Zhu W, Li D, Squire K, Lin RS, Kleffner M et al. Automatic Language Acquisition by an Autonomous Robot. 2003. Paper presented at International Joint Conference on Neural Networks 2003, Portland, OR, United States.
Levinson, Stephen E ; Zhu, Weiyu ; Li, Danfeng ; Squire, Kevin ; Lin, Ruei Sung ; Kleffner, Matthew ; McClain, Matthew ; Lee, Johnny. / Automatic Language Acquisition by an Autonomous Robot. Paper presented at International Joint Conference on Neural Networks 2003, Portland, OR, United States.6 p.
@conference{7a077b834916411a91722a21e7ff91d6,
title = "Automatic Language Acquisition by an Autonomous Robot",
abstract = "There is no such thing as a disembodied mind. We posit that cognitive development can only occur through interaction with the physical world. To this end, we are developing a robotic platform for the purpose of studying cognition. We suggest that the central component of cognition is a memory which is primarily associative, one where learning occurs as the correlation of events from diverse inputs. We also posit that human-like cognition requires a well-integrated sensory-motor system, to provide these diverse inputs. As implemented in our robot, this system includes binaural hearing, stereo vision, tactile sense, and basic proprioceptive control. On top of these abilities, we are implementing and studying various models of processing, learning and decision making. Our goal is to produce a robot that will learn to carry out simple tasks in response to natural language requests. The robot's understanding of language will be learned concurrently with its other cognitive abilities. We have already developed a robust system and conducted a number of experiments on the way to this goal, some details of which appear in this paper. This is a first progress report of what we believe will be a long term project with significant implications.",
author = "Levinson, {Stephen E} and Weiyu Zhu and Danfeng Li and Kevin Squire and Lin, {Ruei Sung} and Matthew Kleffner and Matthew McClain and Johnny Lee",
year = "2003",
month = "9",
day = "25",
language = "English (US)",
pages = "2716--2721",
note = "International Joint Conference on Neural Networks 2003 ; Conference date: 20-07-2003 Through 24-07-2003",

}

TY - CONF

T1 - Automatic Language Acquisition by an Autonomous Robot

AU - Levinson, Stephen E

AU - Zhu, Weiyu

AU - Li, Danfeng

AU - Squire, Kevin

AU - Lin, Ruei Sung

AU - Kleffner, Matthew

AU - McClain, Matthew

AU - Lee, Johnny

PY - 2003/9/25

Y1 - 2003/9/25

N2 - There is no such thing as a disembodied mind. We posit that cognitive development can only occur through interaction with the physical world. To this end, we are developing a robotic platform for the purpose of studying cognition. We suggest that the central component of cognition is a memory which is primarily associative, one where learning occurs as the correlation of events from diverse inputs. We also posit that human-like cognition requires a well-integrated sensory-motor system, to provide these diverse inputs. As implemented in our robot, this system includes binaural hearing, stereo vision, tactile sense, and basic proprioceptive control. On top of these abilities, we are implementing and studying various models of processing, learning and decision making. Our goal is to produce a robot that will learn to carry out simple tasks in response to natural language requests. The robot's understanding of language will be learned concurrently with its other cognitive abilities. We have already developed a robust system and conducted a number of experiments on the way to this goal, some details of which appear in this paper. This is a first progress report of what we believe will be a long term project with significant implications.

AB - There is no such thing as a disembodied mind. We posit that cognitive development can only occur through interaction with the physical world. To this end, we are developing a robotic platform for the purpose of studying cognition. We suggest that the central component of cognition is a memory which is primarily associative, one where learning occurs as the correlation of events from diverse inputs. We also posit that human-like cognition requires a well-integrated sensory-motor system, to provide these diverse inputs. As implemented in our robot, this system includes binaural hearing, stereo vision, tactile sense, and basic proprioceptive control. On top of these abilities, we are implementing and studying various models of processing, learning and decision making. Our goal is to produce a robot that will learn to carry out simple tasks in response to natural language requests. The robot's understanding of language will be learned concurrently with its other cognitive abilities. We have already developed a robust system and conducted a number of experiments on the way to this goal, some details of which appear in this paper. This is a first progress report of what we believe will be a long term project with significant implications.

UR - http://www.scopus.com/inward/record.url?scp=0141592445&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0141592445&partnerID=8YFLogxK

M3 - Paper

AN - SCOPUS:0141592445

SP - 2716

EP - 2721

ER -