creators_name: Oudeyer, P-Y.
type: journalp
datestamp: 2006-09-17
lastmod: 2011-03-11 08:56:36
metadata_visibility: show
title: Discovering Communication
ispublished: pub
subjects: comp-sci-lang
subjects: comp-sci-robot
full_text_status: public
keywords: development, robotics, communication, intrinsic motivation,
vocalizations, stages
abstract: What kind of motivation drives child language development? This
article presents a computational model and a robotic experiment to articulate
the hypothesis that children discover communication as a result
of exploring and playing with their environment. The considered
robotic agent is intrinsically motivated towards situations in which
it optimally progresses in learning. To experience optimal learning
progress, it must avoid situations already familiar but also situations
where nothing can be learnt. The robot is placed in an environment in
which both communicating and non-communicating objects are present.
As a consequence of its intrinsic motivation, the robot explores this environment
in an organized manner focusing first on non-communicative
activities and then discovering the learning potential of certain types of
interactive behaviour. In this experiment, the agent ends up being interested
by communication through vocal interactions without having
a specific drive for communication.
date: 2006
date_type: published
publication: Connection Science
volume: 18
number: 2
pagerange: 189-206
refereed: TRUE
referencetext: Baillie, J., 2004. Urbi: A universal language for robotic control. International Journal
of Humanoid Robotics.
Barto, A., Singh, S., Chentanez, N., 2004. Intrinsically motivated learning of hierarchical
collections of skills. In: Proceedings of the 3rd International Conference on
Development and Learning (ICDL 2004). Salk Institute, San Diego.
Cangelosi, A., Parisi, D., 2002. Simulating the Evolution of Language. Springer.
De Boer, B., 2001. The origins of vowel systems. Oxford University Press.
Deci, E., Ryan, R., 1985. Intrinsic Motivation and Self-Determination in Human Behavior.
Plenum Press.
Dessalles, J.-L., 1998. Altruism, status and the origin of relevance. In: Hurford, J.,
Knight, C., Studdert-Kennedy, M. (Eds.), Approaches to the Evolution of Language:
Social and Cognitive bases. Edinburgh University Press, Edinburgh.
Gintis, H., Smith, E., Bowles, S., 2001. Costly signaling and cooperation. Journal of
Theoretical Biology 213, 103–119.
Gold, E., 1967. Language identification in the limit. Information and Control 10, 447–
474.
Gold, K., Scassellati, B., 2006. Learning acceptable windows of contingency. Connection
Science 18 (2).
Hafner, V., Kaplan, F., 2005. Interpersonal maps and the body correspondence problem.
In: Demiris, Y., Dautenhahn, K., Nehaniv, C. (Eds.), Proceedings of the Third
International Symposium on Imitation in animals and artifacts. Herderfordshire, UK,
pp. 48–53.
Herrmann, J., Pawelzik, K., Geisel, T., 2000. Learning predicitve representations. Neurocomputing
32-33, 785–791.
Hutchins, E., Hazlehurst, B., 1995. How to invent a lexicon: the development of shared
symbols in interaction. In: Gilbert, N., Conte, R. (Eds.), Artificial Societies: The
Computer Simulation of Social Life. UCL Press, London, pp. 157–189.
Kaplan, F., 2005. Simple models of distribued coordination. Connection Science 17 (3).
Kaplan, F., Oudeyer, P.-Y., 2004. Maximizing learning progress: an internal reward
system for development. In: Iida, F., Pfeifer, R., Steels, L., Kuniyoshi, Y. (Eds.),
Embodied Artificial Intelligence. LNCS 3139. Springer-Verlag, London, UK, pp.
259–270.
Kaplan, F., Oudeyer, P.-Y., 2005. The progress-drive hypothesis: an interpretation of
early imitation. In: Dautenhahn, K., Nehaniv, C. (Eds.), Models and mechanisms of
imitation and social learning: Behavioural, social and communication dimensions.
Cambridge University Press, to appear.
Ke, J., Minett, J., Au, C.-P., Wang, W., 2002. Self-organization and selection in the emergence of vocabulary. Complexity 7 (3), 41–54.
Kirby, S., 2002. Natural language and artificial life. Artificial life 8, 185–215.
Kuipers, B., Beeson, P., Modayil, J., Provost, J., 2006. Bootstrap learning of foundational
representations. Connection Science 18 (2).
Marshall, J., Blank, D., Meeden, L., 2004. An emergent framework for self-motivation
in developmental robotics. In: Proceedings of the 3rd International Conference on
Development and Learning (ICDL 2004). Salk Institute, San Diego.
Meltzoff, A., Gopnick, A., 1993. The role of imitation in understanding persons and
developing a theory of mind. In: S. Baron-Cohen, H. T.-F., D.Cohen (Eds.), Understanding
other minds. Oxford University Press, Oxford, England, pp. 335–366.
Moore, C., Corkum, V., 1994. Social understanding at the end of the first year of life.
Developmental Review 14, 349–372.
Olsson, L., Nehaniv, C. L., Polani, D., 2006. From unknown sensors and actuators to
actions grounded in sensorimotor perceptions. Connection Science 18 (2).
Oudeyer, P.-Y., 2005. How phonological structures can be culturally selected for learnability.
Adaptive Behavior 13 (4).
Oudeyer, P.-Y., 2006. Self-Organization in the Evolution of Speech. Studies in the Evolution
of Language. Oxford University Press.
Oudeyer, P.-Y., Kaplan, F., 2004. Intelligent adaptive curiosity: a source of selfdevelopment.
In: Berthouze, L., Kozima, H., Prince, C. G., Sandini, G., Stojanov,
G., Metta, G., Balkenius, C. (Eds.), Proceedings of the 4th International Workshop
on Epigenetic Robotics. Vol. 117. Lund University Cognitive Studies, pp. 127–130.
Oudeyer, P.-Y., Kaplan, F., Hafner, V., 2005a. Intrinsic motivation systems for openended
development. Technical report 05-03, SONY CSL PARIS.
Oudeyer, P.-Y., Kaplan, F., Hafner, V. V., Whyte, A., 2005b. The playground experiment:
Task-independent development of a curious robot. In: Bank, D., Meeden, L.
(Eds.), Proceedings of the AAAI Spring Symposium on Developmental Robotics,
2005. Stanford, California, pp. 42–47.
Philipona, D., O Regan, J., Nadal, J.-P., 2003. Is there something out there? inferring
space from sensorimotor dependencies. Neural Computation 15 (9), 2029–2049.
Piaget, J., 1952. The origins of intelligence in children. Norton, New York, NY.
Pinker, S., Bloom, P., 1990. Natural language and natural selection. Behavioral and
Brain Sciences 13 (4), 707–784.
Provost, J., Kuipers, B. J., Miikkulainen, R., 2006. Developing navigation behavior
through self-organizing distinctive state abstraction. Connection Science 18 (2).
Rolls, E. T., 1999. The Brain and Emotion. Oxford UP.
Schaffer, H., 1977. Early interactive development in studies of mother-infant interaction.
In: Proceedings of Loch Lomonds Symposium. Academic Press, New York,
pp. 3–18.
Schlesinger, M., 2006. Decomposing infants’ object representations: A dual-route processing
account. Connection Science 18 (2).
Schmidhuber, J., 1991. Curious model-building control systems. In: Proceeding International
Joint Conference on Neural Networks. Vol. 2. IEEE, Singapore, pp. 1458–
1463.
Schmidhuber, J., 2006. Developmental robotics, optimal artificial curiosity, creativity,
music, and the fine arts. Connection Science 18 (2).
Shoham, Y., Tennenholtz, M., 1997. On the emergence of social conventions: modeling,
analysis, and simulations. Artificial Intelligence 94 (1–2), 139–166.
Smith, K., Kirby, S., Brighton, H., 2003. Iterated learning: a framework for the emergence
of language. Artificial Life 9 (4), 371–386.
Steels, L., J. D. B., Neubauer, N., 2005. Linking in fluid construction grammars. Submitted.
Steels, L., 1996. Emergent adaptive lexicons. In: Maes, P., Mataric, M., Meyer, J.-
A., Pollack, J., Wilson, S. (Eds.), From Animals to Animats 4: Proceedings of
the Fourth International Conference On Simulation of Adaptive Behavior. The MIT
Press, Cambridge, MA, pp. 562–567.
Steels, L., July 2003. Evolving grounded communication for robots. Trends in Cognitive
Science 7 (7), 308–312.
Steels, L., Kaplan, F., 1999. Collective learning and semiotic dynamics. In: Floreano,
D., Nicoud, J.-D., Mondada, F. (Eds.), Advances in Artificial Life: 5th European
Conference (ECAL 99). Lecture Notes in Artificial Intelligence 1674. Springer-
Verlag, Berlin, pp. 679–688.
Steels, L., Kaplan, F., 2000. Aibo’s first words: The social learning of language and
meaning. Evolution of Communication 4 (1), 3–32.
Stronger, D., Stone, P., 2006. Towards autonomous sensor and actuator model induction
on a mobile robot. Connection Science 18 (2).
Sutton, R., Barto, A., 1998. Reinforcement learning: an introduction. MIT Press, Cambridge,
MA.
Thrun, S., 1995. Exploration in active learning. In: Arbib, M. (Ed.), Handbook of Brain
Science and Neural Networks. MIT Press, Cambridge, MA.
Vygotsky, L., 1978. Mind in society. Harvard university press,
Weng, J., McClelland, J., Pentland, A., Sporns, O., Stockman, I., Sur, M., Thelen, E.,
2001. Autonomous mental development by robots and animals. Science 291, 599–
600.
White, R., 1959. Motivation reconsidered: The concept of competence. Psychological
review 66, 297–333.



citation:   Oudeyer, Dr. P-Y.  (2006) Discovering Communication.  [Journal (Paginated)]     
document_url: http://cogprints.org/5149/1/ConnectionScience.pdf