creators_name: Duch, Wlodzislaw editors_name: Wang, H-F, editors_name: Neace, M.B, editors_name: Zhu, Y, editors_name: Duch, Wlodzislaw type: bookchapter datestamp: 2010-01-30 03:40:45 lastmod: 2011-03-11 08:57:35 metadata_visibility: show title: Neurocognitive Informatics Manifesto. ispublished: pub subjects: comp-neuro-sci subjects: neuro-ling subjects: neuro-mod full_text_status: public keywords: Natural language processing; Semantic networks; Spreading activation networks; Medical ontologies; vector models in NLP; neurolinguistics; neurocognitive informatics abstract: Informatics studies all aspects of the structure of natural and artificial information systems. Theoretical and abstract approaches to information have made great advances, but human information processing is still unmatched in many areas, including information management, representation and understanding. Neurocognitive informatics is a new, emerging field that should help to improve the matching of artificial and natural systems, and inspire better computational algorithms to solve problems that are still beyond the reach of machines. In this position paper examples of neurocognitive inspirations and promising directions in this area are given. date: 2009-08 date_type: published publication: Series of Information and Management Sciences, publisher: California Polytechnic State University refereed: TRUE referencetext: [1] Doidge, N. The Brain That Changes Itself: Stories of Personal Triumph from the Frontiers of Brain Science. James H. Silberman Books, Penguin (2007) [2] Walker, S, A brief history of connectionism and its psychological implications. In Clark, A., Lutz, R., eds.: Connection-ism in Context. Springer-Verlag, Berlin (1992) 123-144 [3] Russell, S.J., Norvig, P, Artificial Intelligence. A Modern Approach. Prentice-Hall, Englewood Cliffs, NJ (1995) [4] Luger, G, Artificial Intelligence: Structures and Strategies for Complex Problem Solving. Addison Wesley 2008 (6th ed) [5] Pulvermuller, F. (2003), The Neuroscience of Language. On Brain Circuits of Words and Serial Order. Cambridge, UK: Cambridge University Press. [6] R. Brooks, Elephants Don’t Play Chess, Robotics and Autonomous Systems 6, 3–15, 2000. [7] R. Brooks, L.A. Stein, Building Brains for Bodies, Autonomous Robots 1, 7–25, 1994. [8] Varela, F.J. Thompson, E, Rosch, E, The embodied mind: Cognitive science and human experience. MIT Press, Cam-bridge, MA, USA. 1991. [9] Lakoff, G, Johnson, M. (1999) Philosophy In The Flesh: The Embodied Mind and Its Challenge to Western Thought. Basic Books. [10] Lakoff G, Nunez R, Where Mathematics Comes From? How the Embodied Mind Brings Mathematics into Being. Basic Books, New York (2000). [11] L. Steels and F. Kaplan. AIBO’s first words: The social learning of language and meaning. Evolution of Communica-tion, 4(1):3–32, 2001. [12] Steels, L. and De Beule, J. (2006) A (very) Brief Introduction to Fluid Construction Grammar. In Third International Workshop on Scalable Natural Language Understanding (2006). [13] Hutchens, J.L.; Alder, M.D. (1998), Introducing MegaHAL, NeMLaP3 / CoNLL98 Workshop on Human-Computer Conversation, ACL (271): 274 Pulvermuller, F. (2003), The Neuroscience of Language. On Brain Circuits of Words and Serial Order. Cambridge, UK: Cambridge University Press. [14] J.A. Feldman, From Molecule to Metaphor: A Neural Theory of Language. MIT Press 2006 [15] Gazzaniga, M. (ed.) The Cognitive Neurosciences. Cambridge, MIT Press (1995) [16] Duch, W. Towards comprehensive foundations of computational intelligence. In Duch, W., Mandziuk, J., eds.: Chal-lenges for Computational Intelligence. Vol. 63. Springer (2007) 261—316 [17] Fogel, L., Owens, A., Walsh, M., eds. Artificial Intelligence through Simulated Evolution. Wiley and Sons (1966) [18] Goldberg, D. Genetic Algorithms in Optimization and Machine Learning. Addison-Wesley (1989) [19] Bonabeau, E., Dorigo, M., Theraulaz, G. Swarm Intelligence: From Natural to Artificial Systems. Oxford University Press (1999) [20] Kennedy, J., Eberhart, R., Shi, Y. Swarm Intelligence. Morgan Kaufmann (2001) [21] de Castro, L., Timmis, J. Artificial Immune Systems: A New Computational Intelligence Approach. Springer (2002) [22] Anderson, J.A., Rosenfeld, E. Neurocomputing - foundations of research. MIT Press, Cambridge, MA (1988) [23] Anderson, J.A., Pellionisz, A., Rosenfeld, E. Neurocomputing 2. MIT Press, Cambridge, MA (1990) [24] Kohonen, T. Self-organizing maps. Springer-Verlag, Heidelberg Berlin (1995) [25] Powell, M.J.D. Radial basis functions for multivariable interpolation: A review. In Mason, J.C., Cox, M.G., eds.: Algo-rithms for Approximation of Functions and Data, Oxford, Oxford University Press (1987) 143--167 [26] Poggio, T., Girosi, F. Network for approximation and learning. Proceedings of the IEEE 78 (1990) 1481--1497 [27] Minsky, M., Papert, S. Perceptrons: An Introduction to Computational Geometry. MIT Press (1969) [28] Kunstman, N., Hillermeier, C., Rabus, B., Tavan, P. An associative memory that can form hypotheses: a phase-coded neural network. Biological Cybernetics 72 (1994) 119--132 [29] Wang, D. On connectedness: a solution based on oscillatory correlation. Neural Computation 12 (2000) 131—139 [30] Duch, W, Setiono, R, Zurada, J. Computational intelligence methods for understanding of data. Proceedings of the IEEE 92 (2004) 771—805 [31] Gerstner, W., Kistler, W. Spiking Neuron Models. Single Neurons, Populations, Plasticity. Cambridge University Press (2002) [32] Maass, W.C, M. Bishop, E. eds.: Pulsed Neural Networks. MIT Press, Cambridge, MA (1998) [33] O'Reilly, R., Munakata, Y. Computational Explorations in Cognitive Neuroscience. MIT-Press (2000) [34] Duch, W., Blachnik, M.: Fuzzy rule-based systems derived from similarity to prototypes. In Pal, N., Kasabov, N., Mudi, R., Pal, S., Parui, S., eds.: Lecture Notes in Computer Science. Volume 3316. (2004) 912--917 [35] Li, H., Chen, C., Huang, H.P. Fuzzy Neural Intelligent Systems: Mathematical Foundation and the Applications in En-gineering. CRC Press (2000) [36] Duch, W. Uncertainty of data, fuzzy membership functions, and multi-layer perceptrons. IEEE Transactions on Neural Networks 16 (2005) 10--23 [37] Nauck, D., Klawonn, F., Kruse, R., Klawonn, F. Foundations of Neuro-Fuzzy Systems. John Wiley & Sons, New York (1997) [38] Pal, S., Mitra, S. Neuro-fuzzy Pattern Recognition: Methods in Soft Computing Paradigm. J. Wiley & Sons, New York (1999) [39] Duch, W., Jankowski, N. Survey of neural transfer functions. Neural Computing Surveys 2 (1999) 163--213 [40] Duch, W., Jankowski, N. Taxonomy of neural transfer functions. In: International Joint Conference on Neural Networks. Vol 3, Como, Italy, IEEE Press (2000) 477--484 [41] Rumelhart, D.E. & McClelland, J.L. (eds), (1986). Parallel Distributed Processing: Explorations in the Microstructure of Cognition Vol. 1: Foundations, Vol. 2: Psychological and Biological Models. Cambridge, MA: MIT Press. [42] Sowa J.F. (ed), (1991). Principles of Semantic Networks: Explorations in the Representation of Knowledge. San Mateo, CA: Morgan Kaufmann Publishers. [43] Jordan, M., T.J. Sejnowski, E. Graphical Models. Foundations of Neural Computation. MIT Press (2001) [44] Zadeh, L., Kacprzyk, J. (eds) Computing with Words in Information/intelligent Systems: Foundations. Springer (1999) [45] Zadeh, L. A new direction in ai: Toward a computational theory of perceptions. AI Magazine 22(1) (2001) 73--84 [46] Schölkopf, B., Smola, A. Learning with Kernels. Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, MA (2001) [47] Hyvärinen, A., Karhunen, J., Oja, E. {Independent Component Analysis. Wiley & Sons, New York, NY (2001) [48] Fauconnier, G., Turner, M., 2002. The Way We Think: Conceptual Blending and the Mind's Hidden Complexities. Basic Books, New York. [49] Pereira F.C, Creativity and Artificial Intelligence: A Conceptual Blending Approach. Mouton De Gruyter, 2007. [50] Honavar, V., Uhr, L., eds. Artificial Intelligence and Neural Networks: Steps Toward Principled Integration. Academic Press, Boston (1994) [51] Winston, P. Artificial Intelligence. 3rd ed. Addison-Wesley, Reading, MA (1992) [52] Duch, W., Adamczak, R., Grabczewski, K. A new methodology of extraction, optimization and application of crisp and fuzzy logical rules. IEEE Transactions on Neural Networks 12 (2001) 277--306 [53] Jilk, D, Lebiere, C., O'Reilly, R, Anderson, J. SAL: An explicitly pluralistic cognitive architecture. Journal of Experimental and Theoretical Artificial Intelligence 20 (2008) 197-218 [54] Szymanski, J., Sarnatowicz, T., Duch, W. Towards avatars with artificial minds: Role of semantic memory. Journal of Ubiquitous Computing and Intelligence 2 (2008) 1-11 [55] Duch, W. Intuition, insight, imagination and creativity. IEEE Computational Intelligence Magazine 2(3) (2008) 40--52 [56] Lichtman, J., Livet, J., Sanes, J. A technicolour approach to the connectome. Nature Reviews Neuroscience 9 (2008) 417—422 [57] Feldman, J.A. From Molecule to Metaphor: A Neural Theory of Language. MIT Press (2006) [58] Fellbaum C. (ed) WordNet. An Electronic Lexical Database. MIT Press 1998 [59] Havasi, C., Speer, R. & Alonso, J. (2007) ConceptNet 3: a Flexible, Multilingual Semantic Network for Common Sense Knowledge. Proceedings of Recent Advances in Natural Languges Processing 2007 [60] Dong Z, Dong Q, Hownet And the Computation of Meaning, World Scientific 2006 [61] C.F. Baker, C.J. Fillmore and B. Cronin, The Structure of the Framenet Database, International Journal of Lexicography, Volume 16.3: 281-296, 2003. [62] Fillmore, C.J. (1976): Frame semantics and the nature of language. Annals of the New York Academy of Sciences: Conference on the Origin and Development of Language and Speech, Vol.280: 20-32 [63] Schmidt T, The Kicktionary – A Multilingual Lexical Resource of Football Language. In: Boas, H.C. (ed.): Multilingual Framenets. New York: de Gruyter, 2009 [64] Roger C. Schank (1972). Conceptual Dependency: A Theory of Natural Language Understanding, Cognitive Psycholo-gy, (3)4, 532-631 [65] Anderson, J.R, Learning and Memory. J. Wiley and Sons, NY 1995. [66] Manning, C.D, Schütze, H. (1999). Foundations of Statistical Natural Language Processing Cambridge, MA: MIT Press. [67] Crowell J, Zeng Q, Ngo L, Lacroix EM, A frequency-based technique to improve the spelling suggestion rank in medical queries. J. Am. Med. Inform. Assoc. 11(3):179-85, 2004. [68] Hecht-Nielsen, R. Confabulation Theory: The Mechanism of Thought. Springer, 2007 [69] Lehmann F. (Ed), (1992). Semantic Networks in Artificial Intelligence. Oxford, Pergamon. [70] Collins A.M, Loftus E.F, A spreading-activation theory of semantic processing. Psychological Reviews 82, 407-28, 1975. [71] McNamara T.P, Semantic Priming. Perspectives from Memory and Word Recognition, Psychology Press 2005 [72] McClelland, J.L, Rogers, T.T. The Parallel Distributed Processing Approach to Semantic Cognition. Nature Reviews Neuroscience, 4, 310-322, 2003 [73] McClelland, J. L., McNaughton, B. L., & O’Reilly, R. C. (1995) Why there are complementary learning systems in the hippocampus and neocortex: Insights from the successes and failures of connectionist models of learning and memory. Psychological Review, 102, 419-457 [74] Mitchell T.M, Shinkareva S.V, Carlson A, Chang K.M, Malave V.L, Mason R.A, Just M.A, Predicting Human Brain Activity Associated with the Meanings of Nouns, Science 320 (5880), 1191-1195, 2008. [75] Meeter, M, Murre, J.M.J. (2005) TraceLink: A model of consolidation and amnesia. Cognitive Neuropsychology 22(5), 559-587 [76] Meeter, M., Myers, C.E. & Gluck, M.A. (2005). Integrating incremental learning and episodic memory models of the hippocampal region. Psychological Review, 112, 560-585 [77] Gluck, M.A., Meeter, M. & Myers, C.E. (2003). Computational models of the hippocampal region: Linking incremental learning and episodic memory. Trends in Cognitive Sciences, 7, 269-276. [78] Shastri L, Episodic memory and cortico-hippocampal interactions. Trends in Cognitive Sciences, 6: 162-168, 2002. [79] Meeter, M., Jehee, J.F.M., & Murre, J.M.J. (2007). Neural models that convince: Model hierarchies and other strategies to bridge the gap between behavior and the brain. Philosophical Psychology, 20, 749-772 [80] Baddeley, A.D, Hitch, G. (1974). Working memory. In G.H. Bower (Ed.), The psychology of learning and motivation: Advances in research and theory (Vol. 8, pp. 47-89). New York: Academic Press. [81] Ericsson, K. A, Kintsch, W. Long-term working memory. Psychological Review 102, 211–245, 1995 [82] Collette, F, Van der Linden, M, Poncelet, M, Working memory, long-term memory, and language processing: issues and future directions. Brain and Language 71(1):46-51, 2000 [83] Duch, W. (2005). Brain-inspired conscious computing architecture. Journal of Mind and Behavior 26(1-2), 1-22. [84] Duch W, Oentaryo R.J, Pasquier M, Cognitive architectures: where do we go from here? In: Frontiers in Artificial Intel-ligence and Applications, Vol. 171 (Ed. by Pei Wang, Ben Goertzel, and Stan Franklin), IOS Press, pp. 122-136. [85] Jusczyk P.W. The Discovery of Spoken Language. MIT Press 2000. [86] Dehaene, S., Cohen, L. Sigman, M. & Vinckier, F. (2005) The neural code for written words: a proposal. Trends in Cognitive Science 9, 335-341. [87] Lin, L, Osan, R, Tsien, J.Z. (2006). Organizing principles of real-time memory encoding: neural clique assemblies and universal neural codes. Trends in Neuroscience 29(1), 48-57. [88] Dehaene, S., & Naccache, L. (2001). Towards a cognitive neuroscience of consciousness: Basic evidence and a work-space framework. Cognition 79, 1-37. [89] Gaillard, R, Naccache, L, Pinel, P, Clémenceau, S, Volle, E, Hasboun, D, Dupont, S, Baulac, M, Dehaene, S, Adam, C, & Cohen, L. Direct intracranial, FMRI, and lesion evidence for the causal role of left inferotemporal cortex in reading. Neuron 50, 191-204, 2006. [90] Lindell A.K, In Your Right Mind: Right Hemisphere Contributions to Language Processing and Production. Neuropsy-chology Review 16(3), 131-148, 2006. [91] Jung-Beeman, M, Bowden, E.M, Haberman, J, Frymiare, J.L, Arambel-Liu, S, Greenblatt, R, Reber, P.J, Kounios, J. (2004). Neural activity when people solve verbal problems with insight. PLoS Biology 2, 500-510. [92] Bowden, E.M., Jung-Beeman, M., Fleck, J. & Kounios, J. (2005). New approaches to demystifying insight. Trends in Cognitive Science 9, 322-328. [93] Libet B, Freeman A, and Sutherland J.K.B. (Eds), The volitional brain: Towards a neuroscience of free will. Imprint Academic, 1999 . [94] Just, M. A. & Varma S. (2007) The organization of thinking: What functional brain imaging reveals about the neuroar-chitecture of complex cognition. Cognitive, Affective, & Behavioral Neuroscience 7 (3), 153-191. [95] Matykiewicz, P, Duch, W, Pestian, J. (2006). Nonambiguous Concept Mapping in Medical Domain, Lecture Notes in Artificial Intelligence 4029, 941-950. [96] Yonelinas AP: The nature of recollection and familiarity: A review of 30 years of research. Journal of Memory and Language 46:441-517, 2002. [97] Yonelinas A.P, Otten L.J, Shaw K.N, Rugg M.D, Separating the Brain Regions Involved in Recollection and Familiarity in Recognition Memory. J. Neurosci. 25: 3002-3008, 2005 [98] Martindale, C, Hasenfus, N. EEG differences as a function of creativity, stage of the creative process, and effort to be original. Biological Psychology, 6(3), 157–167, 1978. [99] Haier R.J, Jung R.E. (2008). Brain Imaging Studies of Intelligence and Creativity: What is the Picture for Education? Roeper Review, 30(3): 171-180. [100] Mednick, S.A. (1962). The associative basis of the creative process. Psychological Review 69, 220–232. [101] Gruszka, A., & Nęcka, E. (2002). Priming and acceptance of close and remote associations by creative and less crea-tive people. Creativity Research Journal 14, 193-205. [102] T. Wellens, V. Shatokhin, and A. Buchleitner, Stochastic resonance. Reports on Progress in Physics Vol. 67, pp. 45-105, 2004. [103] Lamb, S. (1999). Pathways of the Brain: The Neurocognitive Basis of Language. Amsterdam & Philadelphia: J. Ben-jamins Publishing Co. [104] Miikkulainen R. (1993). Subsymbolic Natural Language Processing: An Integrated Model of Scripts, Lexicon, and Memory, Cambridge, MA: MIT Press. [105] Miikkulainen, R. (2002). Text and Discourse Understanding: The DISCERN System, In Dale R., Moisl H. and Somers H. (eds), A Handbook of Natural Language Processing: Techniques and Applications for the Processing of Language as Text, 905-919. New York: Marcel Dekker. [106] Crestani, F. (1997). Application of Spreading Activation Techniques in Information Retrieval. Artificial Intelligence Review 11, 453-482. [107] Crestani, F., & Lee, P.L. (2000). Searching the web by constrained spreading activation. Information Processing & Management 36, 585-605. [108] Tsatsaronis, G. Vazirgiannis, M., & Androutsopoulos, I. (2007) Word Sense Disambiguation with Spreading Activa-tion Networks Generated from Thesauri, in 20th Int. Joint Conf. in Artificial Intelligence (IJCAI 2007), Hyderabad, In-dia, pp. 1725-1730. [109] Duch W, & Pilichowski, M. (2007). Experiments with computational creativity. Neural Information Processing - Letters and Reviews 11, 123-133. [110] Duch, W. (2007) Creativity and the Brain. In: A Handbook of Creativity for Teachers. Ed. Ai-Girl Tan, Singapore: World Scientific Publishing, pp. 507-530. [111] Itert, L. Duch, W. & Pestian, J. (2007). Influence of a priori Knowledge on Medical Document Categorization, IEEE Symposium on Computational Intelligence in Data Mining, IEEE Press, pp. 163-170. [112] Landauer, T. K., & Dumais, S. T. (1997). A solution to Plato's problem: The Latent Semantic Analysis theory of the acquisition, induction, and representation of knowledge. Psychological Review, 104, 211-240. [113] Landauer, T. K. On the computational basis of learning and cognition: Arguments from LSA. In N. Ross (Ed.), The psychology of learning and motivation, 41, 43-84, 2002. [114] UMLS Knowledge Sources, 13th Edition – January Release. Available: http://www.nlm.nih.gov/research/umls [115] Medical subject headings, MeSH, National Library of Medicine, URL: http://www.nlm.nih.gov/mesh/. [116] MetaMap, available at http://mmtx.nlm.nih.gov [117] Duch W, Filter Methods. In: Feature extraction, foundations and applications. Eds: I. Guyon, S. Gunn, M. Nikravesh, L. Zadeh, Studies in Fuzziness and Soft Computing, Physica-Verlag, Springer, 2006, pp. 89-118 [118] Duch W, Matykiewicz P, and Pestian J, Neurolinguistic Approach to Natural Language Processing with Applications to Medical Text Analysis. Neural Networks 21(10), 1500-1510, 2008 [119] Matykiewicz P, Duch W, Zender P.M, Crutcher K.A, Pestian J.P, Neurocognitive approach to clustering of PubMed query results. In: Neural Information Proceesing, 15th Int. conference ICONIP 2008, Auckland, New Zealand, pp. 160-161, 2008. [120] Matykiewicz P, Duch W, Pestian J.P, Clustering semantic spaces of suicide notes and newsgroups posts. ACL Confe-rence 2009 (submitted). [121] Duch W, Matykiewicz P, Pestian J, Neurolinguistic Approach to Vector Representation of Medical Concepts. Pre-sented at the 20th Int. Joint Conference on Neural Networks (IJCNN), Orlando, IEEE Press, August 12-17, 2007, pp. 3110-3115 [122] Duch W, Matykiewicz P, Pestian J, Towards Understanding of Natural Language: Neurocognitive Inspirations. Springer Lecture Notes in Computer Science, Vol. 4668, 953–962, 2007. [123] Matykiewicz P, Duch W, Pestian J, Nonambiguous Concept Mapping in Medical Domain, Lecture Notes in Artificial Intelligence, Vol. 4029, 941-950, 2006 [124] Matykiewicz P, Pestian J, Duch W, and Johnson N, Unambiguous Concept Mapping in Radiology Reports: Graphs of Consistent Concepts, AMIA Annu Symp Proc. 2006; 2006: 1024. [125] Duch W, Szymański J, Semantic Web: Asking the Right Questions. Series of Information and Management Sciences, M. Gen, X. Zhao and J. Gao, Eds, California Polytechnic State University, CA, USA, pp. 456-463, 2008. [126] Szymanski J, Duch W, Knowledge representation and acquisition for large-scale semantic memory. Presented at the World Congress on Computational Intelligence (WCCI'08), Hong Kong, 1-6 June 2008, IEEE Press, pp. 3117-3124 [127] Szymanski J, Sarnatowicz T, Duch W, Towards Avatars with Artificial Minds: Role of Semantic Memory. Journal of Ubiquitous Computing and Intelligence, American Scientific Publishers, 2, 1-11, 2008. [128] Szymanski J, Duch W, Semantic Memory Knowledge Acquisition Through Active Dialogues. Presented at the 20th Int. Joint Conference on Neural Networks (IJCNN), Orlando, IEEE Press, August 2007, pp. 536-541 [129] Szymanski J, Duch W, Semantic Memory Architecture for Knowledge Acquisition and Management. Presented at the Sixth International Conference on Information and Management Sciences (IMS2007), July 1-6, 2007, California Poly-technic State University, CA, pp. 342-348 [130] Szymanski J, Sarnatowicz T, Duch W, Semantic memory for avatars in cyberspace. 2005 International Conference on Cyberworlds, Singapore 23-25 Nov. 2005, T.L. Kunii, S.H. Soon and A. Sourin (eds), IEEE Computer Society, pp. 165-171 [131] Duch W, Szymanski J, Sarnatowicz T, Concept description vectors and the 20 question game. Intelligent Information Processing and Web Mining, Advances in Soft Computing, Springer Verlag, ISBN 3-540-25056-5 (Eds. Klopotek, M.A., Wierzchon, S.T., Trojanowski, K.), pp. 41-50, 2005. [132] Antonie, M.-L. & Zaiane, O.R. (2002). Text document categorization by term association. Proc. of IEEE Int. Conf on Data Mining (ICDM), pp. 19- 26. citation: Duch, Wlodzislaw (2009) Neurocognitive Informatics Manifesto. [Book Chapter] document_url: http://cogprints.org/6776/1/09-NeuroCog-Manifesto.pdf