Abstract

Human developmental learning is capable of dealing with the dynamic visual world, speechbased dialogue, and their complex real-time association. However, the architecture that realizes this for robotic cognitive development has not been reported in the past. This paper takes up this challenge. The proposed architecture does not require a strict coupling between visual and auditory stimuli. Two major operations contribute to the “abstraction ” process: multiscale temporal priming and high-dimensional numeric abstraction through internal responses with reduced variance. As a basic principle of developmental learning, the programmer does not know the nature of the world events at the time of programming and, thus, hand-designed task-specific representation is not possible. We successfully tested the architecture on the SAIL robot under an unprecedented challenging multimodal interaction mode: use real-time speech dialogue as a teaching source for simultaneous and incremental visual learning and language acquisition, while the robot is viewing a dynamic world that contains a rotating object to which the dialogue is referring. 1.

Citations

182	Learning words from sights and sounds: a computational model - Roy, Pentland - 2002
123	Autonomous mental development by robots and animals - Weng, McClelland, et al. - 2001
115	The Body in the Mind. The Bodily Basis of Meaning, Imagination and Reason - Johnson - 1987
70	Situated grounded word semantics - Steels, Kaplan - 1999
38	Hierarchical Discriminant Regression - Hwang, Weng - 2000
27	The symbol grounding problem - Harnard - 1990
25	Understanding the link between joint attention and language - Baldwin - 1995
23	Developmental humanoids: humanoids that develop skills automatically - Weng, Hwang, et al. - 2000
22	Object permanance in 3.5 and 4.5-month-old infants - Baillargeon - 1987
19	A theory for mentally developing robots - Weng - 2002
18	Bimodal emotion recognition by man and machine - Huang, Chen, et al. - 1998
18	Grounded auditory development of a developmental robot - Zhang, Weng
15	Neuronal representation of disappearing and hidden objects in temporal cortex of the macaque - Baker, Keysers, et al. - 2001
12	Subsymbolic computation and the chinese room - Chalmers - 1992
7	Self-produced locomotion: an organizer of emotional, cognitive, and social development in infancy - Bertenthal, Campos, et al. - 1984
4	Modification of the distribution of receptive field orientation in cats by selective visual exposure during development,” Exp - Hirsch, Spinelli - 1971