A Functional Architecture Approach to Neural Systems

coward, l andrew (2000) A Functional Architecture Approach to Neural Systems. [Journal (Paginated)]

Full text available as:



The technology for the design of systems to perform extremely complex combinations of real-time functionality has developed over a long period. This technology is based on the use of a hardware architecture with a physical separation into memory and processing, and a software architecture which divides functionality into a disciplined hierarchy of software components which exchange unambiguous information. This technology experiences difficulty in design of systems to perform parallel processing, and extreme difficulty in design of systems which can heuristically change their own functionality. These limitations derive from the approach to information exchange between functional components. A design approach in which functional components can exchange ambiguous information leads to systems with the recommendation architecture which are less subject to these limitations. Biological brains have been constrained by natural pressures to adopt functional architectures with this different information exchange approach. Neural networks have not made a complete shift to use of ambiguous information, and do not address adequate management of context for ambiguous information exchange between modules. As a result such networks cannot be scaled to complex functionality. Simulations of systems with the recommendation architecture demonstrate the capability to heuristically organize to perform complex functionality.

Item Type:Journal (Paginated)
Keywords:Cognitive architectures; Computational models; Information context; Functional modules; REM Sleep
Subjects:Neuroscience > Behavioral Neuroscience
Computer Science > Machine Learning
Neuroscience > Neuropsychology
Psychology > Physiological Psychology
ID Code:2302
Deposited By:coward, l andrew
Deposited On:29 Jun 2002
Last Modified:11 Mar 2011 08:54

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Andersen, J.A. and Sutton, J.P. (1997). If we compute faster, do we understand better? Behavior Research Methods, Instruments & Computers 29 (1), 67-77.

Avrunin, G.S., Corbett, J.C. and Dillon, L.K. (1998). Analysing Partially Implemented Real-Time Systems. IEEE Transactions on Software Engineering 24, 8, 602-614.

Bressler, S. L. (1994). Dynamic self-organization in the brain as observed by transient cortical coherence, in Pribam, K. (ed.) Origins: brain and self-organization, Hillsdale, NJ: Erlbaum.

Buschmann, F., Meunier, R., Rohnert, H. Sommerlad, P. and Stal, M. (1996). Pattern Oriented Software Architecture: A System of Patterns. New York: Wiley.

Card, H.C., Rosendahl, G.K., McNeill, D.K. and McLeod, R.D. (1998). Competitive Learning Algorithms and Neurocomputer Architecture. IEEE Transactions on Computers 47, 8, 847-858.

Carpenter, G.A. and Grossberg, S. (1988). The ART of Adaptive Pattern Recognition by a Self-Organizing Neural Network, IEEE Computer, 3, 77-88

Cauller, L. (1995). Layer I of primary sensory neocortex: Where top-down converges with bottom-up, Behavioural Brain Research 71: 163-170

Cauller, L. (1997a). NeuroInteractivism: Explaining Emergence without Representation, to be published.

Cauller, L. (1997b). Private communication.

Coward, L. A. (1990). Pattern Thinking, New York: Praeger.

Coward, L. A. (1997a). The Pattern Extraction Hierarchy Architecture: a Connectionist Alternative to the von Neumann Architecture, in Mira., J., Morenzo-Diaz, R., and Cabestanz, J. (eds.) Biological and Artificial Computation: from Neuroscience to Technology, 634-43, Berlin: Springer.

Coward, L.A. (1997b). Unguided Categorization, Direct and Symbolic Representation, and Evolution of Cognition in a Modified Connectionist Theory, in Riegler, A. and Peschl, M. (eds.), Proceedings of the International Conference New Trends in Cognitive Science, 139-146, Vienna: Austrian Society of Cognitive Science.

Coward, L.A. (1999a). The Application of Concepts from the Design of Extremely Complex Real-Time Electronic Systems to Cognitive Science, in Riegler, A. and Peschl, M. (eds.) New Trends in Cognitive Science , Plenum Press.

Coward, L.A. (1999b). A physiologically based theory of consciousness. To be published in Jordan, S. (ed.), A Multidisciplinary Approach to Consciousness.

De Felipe, J., (1997). Microcircuits in the Brain, in Mira., J., Morenzo-Diaz, R., and Cabestanz, J. (eds.) Biological and Artificial Computation: from Neuroscience to Technology, 195-206, Berlin: Springer.

Dijkstra, E.W. (1968). The Structure of the THE Multiprogramming System. Communications of the ACM 18, 8, 453-457.

Fernandez, J.L. (1993). A Taxonomy of Coordination Mechanisms Used in Real-Time Software Based on Domain Analysis. Carnegie-Mellon University Software Engineering Institute Technical Report 93-TR-34.

Garlan, D. and Shaw, M. (1993). An Introduction to Software Architecture. In Ambriola, V. and Tortora, G., eds., Advances in Software Engineering and Knowledge Engineering vol. 1. New Jersey: World Scientific Publishing Company.

Garlan, D., Allen, R. and Ockerbloom, J. (1995). Architectural Mismatch or Why it’s hard to build systems out of existing parts. IEEE Computer Society 17th International Conference on Software Engineering. New York: ACM.

Harlow, T. M. (1868). Recovery from passage of an iron bar through the head, New England Medical Society 2, 327-46

Hebb, D. C. (1949). The Organization of Behaviour, New York: Wiley

Honkela, T, Pulkki, V. and Kohonen, T. (1995). Contextual Relations of Words in Grimm Tales, Analyzed by Self-Organizing Map, in Fogelman-Soulie, F. and Gallinari, P. (eds.), ICANN-95 Proceedings of International Conference on Artificial Neural Networks, 2, 3-7. Paris: EC2 et Cie.

Keck, D.O. and Kuehn, P.J. (1998). The Feature and Service Interaction Problem in Telecommunications Systems: a Survey. IEEE Transactions on Software Engineering 24, 10, 779-796.

Kruchten 1995, Ng, T. and Patel, V. (1994). Timely Failure Detection in a Large Distributed Real-Time System. Proceedings of the International Workshop on Object Oriented Real-Time Dependable Systems, Daria Point, California.

Llinas, R., Ribary, U., Joliot, M., and Wang, X.-J. (1994). Content and Context in Temporal Thalamocortical Binding, in Buzsaki G. et alii (eds), Temporal Coding in the Brain, Berlin: Springer.

Marr, D. (1982). Vision, New York: W.H. Freeman.

Mira, J., Herrero, J.C., and Delgado A.E. (1997). A Generic Formulation of Neural Nets as a Model of Parallel and Self Programming Computation, in Mira., J., Morenzo-Diaz, R., and Cabestanz, J. (eds.) Biological and Artificial Computation: from Neuroscience to Technology, 195-206, Springer: Berlin.

Parnas, D.L., Clements, P.C. and Weiss, D.M. (1985). The Modular Structure of Complex Systems, IEEE Transactions on Software Engineering SE-11, 3, 259-266.

Paul, C.J., Holloway, L.E., Yan, D., Strosnider, J.K., and Krogh, B.H. (1992). An Intelligent Reactive Monitoring and Scheduling System, IEEE Control Systems 12, 3, 78-86.

Perry, D.E. and Wolf, A.L. (1992). Foundations for the Study of Software Architecture, ACM SIGSOFT Software Engineering Notes, 17, 4, 40-52.

Ramos-Thuel, S. and Strosnider, J.K. (1994). Scheduling Fault Recovery Operations for Time-Critical Applications. Proceedings of the Fourth IFIP Working Conference on Dependable Computing for Critical Applications, San Diego.

Rosenblatt, F. (1961) Principles of Neurodynamics: Perceptrons and the Theory of Brain Mechanisms, Washington D.C.: Spartan

Sabisch, T., Ferguson, A. and Bolouri, H. (1997). Automatic registration of complex images using a self organizing neural system. IEEE International Joint Conference on Neural Networks, Anchorage, Alaska.

Sabisch, T., Ferguson, A. and Bolouri, H. (1998). Rotation, translation and scaling tolerant recognition of complex shapes using a hierarchical self organizing neural network. Proceedings of International Conference on Neural Information Processing 2, 1174-78. Berlin: Springer.

Sha, L. and Sathaye, S.S. (1993). Distributed Real-Time System Design: Theoretical Concepts and Applications. Carnegie-Mellon University Software Engineering Institute Technical Report 93-TR-2.

Skaggs, W. E. and McNaughton, B. L. (1996). Replay of neuronal firing sequences in rat hippocampus during sleep following spatial experience, Science, 271:1870-1873.

Soni, D., Nord, R.L. and Hofmeister, C. (1995). Software Architecture in Industrial Applications. Proceedings of the 17th International Conference in Software Engineering, 196-207. New York: ACM.

Strosnider, J.K. and Setcliff, D.E. (1997). Supporting Embedded System Design Capture, Analysis and Navigation. Proceedings of the Australian Software Engineering Conference.

Tanaka, K., (1993). Neuronal Mechanisms of Object Recognition, Science, 262, 685-88.

Taylor, J.G. and Alavi, F.N., (1993). Mathematical Analysis of a Competitive Network for Attention, in Taylor, J.G. (ed.), Mathematical Approaches to Neural Networks, Elsevier.

Yu, W.D. (1998). A Software Fault Prevention Approach in Coding and Root Cause Analysis. Bell Labs Technical Journal April-June 1998, 3-21.


Repository Staff Only: item control page