http://cogprints.org/1579/
Categorical Perception and the Evolution of Supervised Learning in Neural Nets
Some of the features of animal and human categorical perception
(CP) for color, pitch and speech are exhibited by neural net simulations of CP with
one-dimensional inputs: When a backprop net is trained to discriminate and then
categorize a set of stimuli, the second task is accomplished by "warping" the
similarity space (compressing within-category distances and expanding
between-category distances). This natural side-effect also occurs in humans and
animals. Such CP categories, consisting of named, bounded regions of similarity
space, may be the ground level out of which higher-order categories are
constructed; nets are one possible candidate for the mechanism that learns the
sensorimotor invariants that connect arbitrary names (elementary symbols?) to the
nonarbitrary shapes of objects. This paper examines how and why such
compression/expansion effects occur in neural nets.
Harnad, Stevan
Hanson, S.J.
Lubin, J.
Neural Nets
Perceptual Cognitive Psychology
Stevan
Harnad
S.J.
Hanson
J.
Lubin