Cogprints

Binding tactile and visual sensations via unique association by cross-anchoring between double-touching and self-occlusion

Yoshikawa, Yuichiro and Hosoda, Koh and Asada, Minoru (2004) Binding tactile and visual sensations via unique association by cross-anchoring between double-touching and self-occlusion. [Conference Paper]

Full text available as:

[img]
Preview
PDF
321Kb

Abstract

Binding is one of the most fundamental cognitive functions, how to find the correspondence of sensations between different modalities such as vision and touch. Without a priori knowledge on this correspondence, binding is regarded to be a formidable issue for a robot since it often perceives multiple physical phenomena in its different modal sensors, therefore it should correctly match the foci of attention in different modalities that may have multiple correspondences each other. We suppose that learning the multimodal representation of the body should be the first step toward binding since the morphological constraints in self-body-observation would make the binding problem tractable. The multimodal sensations are expected to be constrained in perceiving own body so as to configurate the unique parts of the multiple correspondence reflecting its morphology. In this paper, we propose a method to match the foci of attention in vision and touch through the unique association by cross-anchoring different modalities. Simple experiments show the validity of the proposed method.

Item Type:Conference Paper
Keywords:multimodal binding, self-body observation, double-touching, self-occlusion, cross-anchoring Hebbian learning,
Subjects:Computer Science > Neural Nets
Computer Science > Artificial Intelligence
Computer Science > Robotics
ID Code:4150
Deposited By:Prince, Dr Christopher G.
Deposited On:14 Apr 2005
Last Modified:11 Mar 2011 08:55

Metadata

Repository Staff Only: item control page