creators_name: Harnad, Stevan type: journalp datestamp: 2003-08-12 lastmod: 2011-03-11 08:55:19 metadata_visibility: show title: The Symbol Grounding Problem ispublished: pub subjects: comp-sci-mach-dynam-sys subjects: comp-neuro-sci subjects: ling-sem subjects: comp-sci-neural-nets subjects: percep-cog-psy subjects: comp-sci-robot subjects: bio-theory subjects: phil-lang subjects: cog-psy subjects: comp-sci-art-intel subjects: phil-epist full_text_status: public keywords: computation, cognition, semantics, robotics, Turing Test, Chinese Room Argument, symbol grounding, categorisation, consciousness, situatedness, embodiment, transduction, sensorimotor processes, artificial intelligence, hermeneutics, neural nets abstract: There has been much discussion recently about the scope and limits of purely symbolic models of the mind and about the proper role of connectionism in cognitive modeling. This paper describes the symbol grounding problem: How can the semantic interpretation of a formal symbol system be made intrinsic to the system, rather than just parasitic on the meanings in our heads? How can the meanings of the meaningless symbol tokens, manipulated solely on the basis of their (arbitrary) shapes, be grounded in anything but other meaningless symbols? The problem is analogous to trying to learn Chinese from a Chinese/Chinese dictionary alone. A candidate solution is sketched: Symbolic representations must be grounded bottom-up in nonsymbolic representations of two kinds: (1) iconic representations, which are analogs of the proximal sensory projections of distal objects and events, and (2) categorical representations, which are learned and innate feature-detectors that pick out the invariant features of object and event categories from their sensory projections. Elementary symbols are the names of these object and event categories, assigned on the basis of their (nonsymbolic) categorical representations. Higher-order (3) symbolic representations, grounded in these elementary symbols, consist of symbol strings describing category membership relations (e.g., An X is a Y that is Z). Connectionism is one natural candidate for the mechanism that learns the invariant features underlying categorical representations, thereby connecting names to the proximal projections of the distal objects they stand for. In this way connectionism can be seen as a complementary component in a hybrid nonsymbolic/symbolic model of the mind, rather than a rival to purely symbolic modeling. Such a hybrid model would not have an autonomous symbolic module, however; the symbolic functions would emerge as an intrinsically dedicated symbol system as a consequence of the bottom-up grounding of categories' names in their sensory representations. Symbol manipulation would be governed not just by the arbitrary shapes of the symbol tokens, but by the nonarbitrary shapes of the icons and category invariants in which they are grounded. date: 1990 date_type: published publication: Physica D volume: 42 pagerange: 335-346 refereed: TRUE referencetext: Catania, A. C. & Harnad, S. (eds.) (1988) The Selection of Behavior. The Operant Behaviorism of B. F. Skinner: Comments and Consequences. New York: Cambridge University Press. Chomsky, N. (1980) Rules and representations. Behavioral and Brain Sciences 3: 1-61. Davis, M. (1958) Computability and unsolvability. Manchester: McGraw-Hill. Davis, M. (1965) The undecidable. New York: Raven. Dennett, D. C. (1983) Intentional systems in cognitive ethology. Behavioral and Brain Sciences 6: 343 - 90. Fodor, J. A. (1975) The language of thought New York: Thomas Y. Crowell Fodor, J. A. (1980) Methodological solipsism considered as a research strategy in cognitive psychology. Behavioral and Brain Sciences 3: 63 - 109. Fodor, J. A. (1985) Pré of "The Modularity of Mind." Behavioral and Brain Sciences 8: 1 - 42. Fodor, J. A. (1987) Psychosemantics Cambridge MA: MIT/Bradford. Fodor, J. A. & Pylyshyn, Z. W. (1988) Connectionism and cognitive architecture: A critical appraisal. Cognition 28: 3 - 71. Gibson, J. J. (1979) An ecological approach to visual perception. Boston: Houghton Mifflin Harnad, S. (1982) Metaphor and mental duality. In T. Simon & R. Scholes, R. (Eds.) Language, mind and brain. Hillsdale, N. J.: Lawrence Erlbaum Associates Harnad, S. (1987a) Categorical perception: A critical overview. In S. Harnad (Ed.) Categorical perception: The groundwork of Cognition. New York: Cambridge University Press Harnad, S. (1987b) Category induction and representation. In S. Harnad (Ed.) Categorical perception: The groundwork of Cognition. New York: Cambridge University Press Harnad, S. (1989) Minds, Machines and Searle. Journal of Theoretical and Experimental Artificial Intelligence 1: 5-25. Harnad, S. (1990) Computational Hermeneutics. Social Epistemology in press. Haugeland, J. (1978) The nature and plausibility of cognitivism. Behavioral and Brain Sciences 1: 215-260. Kleene, S. C. (1969) Formalized recursive functionals and formalized realizability. Providence, R.: American Mathematical Society. Kripke, S.A. (1980) Naming and Necessity. Cambridge MA: Harvard University Press Liberman, A. M. (1982) On the finding that speech is special. American Psychologist 37: 148-167. Lucas, J. R. (1961) Minds, machines and G\*"odel. Philosophy 36: 112-117. McCarthy, J. & Hayes, P. (1969) Some philosophical problems from the standpoint of artificial intelligence. In: Meltzer B. & Michie, P. Machine Intelligence Volume 4. Edinburgh: Edinburgh University Press. McDermott, D. (1976) Artificial intelligence meets natural stupidity. SIGART Newsletter 57: 4 - 9. McClelland, J. L., Rumelhart, D. E., and the PDP Research Group (1986) Parallel distributed processing: Explorations in the microstructure of cognition, Volume 1. Cambridge MA: MIT/Bradford. Miller, G. A. (1956) The magical number seven, plus or minus two: Some limits on our capacity for processing information. Psychological Review 63: 81 - 97. Minsky, M. (1974) A framework for Representing knowledge. MIT Lab Memo # 306. Minsky, M. & Papert, S. (1969) Perceptrons: An introduction to computational geometry. Cambridge MA: MIT Press (Reissued in an Expanded Edition, 1988). Newell, A. (1980) Physical Symbol Systems. Cognitive Science 4: 135 - 83. Neisser, U. (1967) Cognitive Psychology NY: Appleton-Century-Crofts. Cognitive Psychology Paivio, A. (1986) Mental representation: A dual coding approach. New York: Oxford Penrose, R. (1989) The emperor's new mind. Oxford: Oxford University Press Pylyshyn, Z. W. (1980) Computation and cognition: Issues in the foundations of cognitive science. Behavioral and Brain Sciences 3: 111-169. Pylyshyn, Z. W. (1984) Computation and cognition. Cambridge MA: MIT/Bradford Pylyshyn, Z. W. (Ed.) (1987) The robot's dilemma: The frame problem in artificial intelligence. Norwood NJ: Ablex Rosch, E. & Lloyd, B. B. (1978) Cognition and categorization. Hillsdale NJ: Erlbaum Associates Rosenblatt, F. (1962) Principles of neurodynamics. NY: Spartan Searle, J. R. (1980) Minds, brains and programs. Behavioral and Brain Sciences 3: 417-457. Shepard, R. N. & Cooper, L. A. (1982) Mental images and their transformations. Cambridge: MIT Press/Bradford. Smolensky, P. (1988) On the proper treatment of connectionism. Behavioral and Brain Sciences 11: 1 - 74. Stabler, E. P. (1985) How are grammars represented? Behavioral and Brain Sciences 6: 391-421. Terrace, H. (1979) Nim. NY: Random House. Turkkan, J. (1989) Classical conditioning: The new hegemony. Behavioral and Brain Sciences 12: 121 - 79. Turing, A. M. (1964) Computing machinery and intelligence. In: Minds and machines, A. R. Anderson (ed.), Engelwood Cliffs NJ: Prentice Hall. Ullman, S. (1980) Against direct perception. Behavioral and Brain Sciences 3: 373 - 415. Wittgenstein, L. (1953) Philosophical investigations. New York: Macmillan citation: Harnad, Stevan (1990) The Symbol Grounding Problem. [Journal (Paginated)] document_url: http://cogprints.org/3106/1/sgproblem1.html