Attentional and Semantic Anticipations

Lavigne, Frédéric and Denis, Sylvain (2001) Attentional and Semantic Anticipations. [Journal (Paginated)]

Full text available as:



Why are attentional processes important in the driving of anticipations? Anticipatory processes are fundamental cognitive abilities of living systems, in order to rapidly and accurately perceive new events in the environment, and to trigger adapted behaviors to the newly perceived events. To process anticipations adapted to sequences of various events in complex environments, the cognitive system must be able to run specific anticipations on the basis of selected relevant events. Then more attention must be given to events potentially relevant for the living system, compared to less important events. What are useful attentional factors in anticipatory processes? The relevance of events in the environment depend on the effects they can have on the survival of the living system. The cognitive system must then be able to detect relevant events to drive anticipations and to trigger adapted behaviors. The attention given to an event depends on i) its external physical relevance in the environment, such as time duration and visual quality, and ii) on its internal semantic relevance in memory, such as knowledge about the event (semantic field in memory) and anticipatory power (associative strength to anticipated associates). How can we model interactions between attentional and semantic anticipations? Specific types of distributed recurrent neural networks are able to code temporal sequences of events as associated attractors in memory. Particular learning protocol and spike rate transmission through synaptic associations allow the model presented to vary attentionally the amount of activation of anticipations (by activation or inhibition processes) as a function of the external and internal relevance of the perceived events. This type of model offers a unique opportunity to account for both anticipations and attention in unified terms of neural dynamics in a recurrent network.

Item Type:Journal (Paginated)
Keywords:Semantic processing - attention - context effects - neural networks
Subjects:Psychology > Behavioral Analysis
Biology > Behavioral Biology
Psychology > Cognitive Psychology
Computer Science > Dynamical Systems
Computer Science > Neural Nets
Psychology > Evolutionary Psychology
Linguistics > Pragmatics
Linguistics > Semantics
Neuroscience > Neural Modelling
Psychology > Psycholinguistics
ID Code:2249
Deposited By:Lavigne, Frédéric
Deposited On:10 Jun 2002
Last Modified:11 Mar 2011 08:54

References in Article

Select the SEEK icon to attempt to find the referenced article. If it does not appear to be in cogprints you will be forwarded to the paracite service. Poorly formated references will probably not work.

Amit, D. J. (1989). Modeling Brain Function: The world of attractor neural networks. Cambridge Univ. Press.

Amit, D. J. & Brunel, N. (1995). Learning internal representations in an attractor neural network, Network,6,359.

Amit, D. J., Brunel, N., & Tsodyks, M. V. (1994). Correlations of hebbian cortical reverberations: Experiment vs. theory. Journal of Neurosciences, 14, 6635.

Anderson, J. R. (1983). The architecture of cognition. Cambridge, MA: Harvard University Press.

Balota, D. A. (1983). Automatic semantic activation and episodic memory encoding. Journal of Verbal Learning and Verbal Behavior, 22, 88-104.

Balota, D. A., Black, S. R. & Cheney, M. (1992). Automatic and attentional priming in young and older adults: Reevaluation of the two-process model. Journal of Experimental Psychology: Human Perception and Performance, 18, 485-502.

Balota, D. A. & Paul, S. T. (1996). Summation of activation: Evidence from multiple primes that converge and diverge within semantic memory. Journal of Experimental Psychology: Learning, Memory and Cognition, 22, 4, 827-845.

Balota, D. & Rayner, K. (1991). Word recognition processes in foveal and parafoveal vision: the range of influence of lexical variables. In D. Besner & G. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 198-232). Hillsdale, Hove, London: Lawrence Erlbaum.

Becker, C. A. (1979). Semantic context and word frequency effect in visual word recognition. Journal of Experimental Psychology: Human Perception and Performance, 5, 252-259.

Berthoz, A. (1996). Les sens du mouvement. Paris, Odile Jacob.

Broadbent, D. E. (1971). Decision and Stress, New York, Academic Press.

Broadbent, D. E. (1982). Task combination and selective intake of information, Acta Psychologica, 50, 253-290.

Brodeur, D. A. & Lupker, S. J. (1994). Investigating the effects of multiple primes: An analysis of theoretical mechanisms. Psychological Research, 57, 1-14.

Brunel, N. (1996). Hebbian learning of context in recurrent neural networks. Neural Computation, 8, 1677-1710.

Brunel, N. (1994). Dynamics of an attractor neural network converting temporal into spatial correlations. Network, 5, 449.

Collins, A. M. & Loftus, E. F. (1975). A Spreading Activation Theory of Semantic Processing. Psychological Review, 82, 407-28.

Collins, A. M. & Quillian, M.R. (1969). Retrieval Time from Semantic Memory. Journal of Verbal Learning and Verbal Behaviour, 8, 240-247.

Conrad, C. 1972. Cognitive economy in semantic memory. Journal of Experimental Psychology, 92, 149-154.

Dubois, D. M. (1996). Hyperincursive stack memory in chaotic automata. In A. C. Ehresman, G. L. Farre & J.-P. Vanbremeersh (Eds.): Proceedings of the ECHOS Symposium, 77-82. Amiens – France, Université de Picardie Jules vernes.

Dubois, D. M. (1998a). Introduction to computing anticipatory systems. International Journal of Computing Anticipatory systems, 2, 3-14. D. Dubois (Ed.), CHAOS (Publisher).

Dubois, D. M. (1998b). Computing anticipatory systems with incursion and hyperincursion. Computing Anticipatory Systems: CASYS – first international conference, D. Dubois (Ed.), American Institute of Physics (Publisher), AIP conference proceedings 437, 3-29.

Freedman, J. L. & Loftus, E. F. (1971). Retrieval of words from long term memory. Journal of Verbal Learning and Verbal Behavior, 10, 107-115.

Fuentes, L. J., Carmona, E., Agis, I. F. & Catena, A. (1994). The role of the anterior attention system in semantic processing of both foveal and parafoveal words. Journal of Cognitive Neuroscience, 6, 17-25.

Fuentes, L. J. & Ortells, J. J. (1993). Facilitation and interference effects in a Stroop-like task: Evidence in favor of semantic processing of parafoveally-presented stimuli. Acta Psychologica, 84, 213-229.

Fuentes, L. J. & Tudela, P. (1992). Semantic processing of foveally and parafoveally presented words in a lexical decision task. Quarterly Journal of Experimental Psychology: Human Experimental Psychology, 45, 299-322.

Glenberg, A. M. (1997). What memory is for, Behavioral and Brain Sciences, 20 (1), 1-55.

Green, D. M. & Swets, J. A. (1966). Signal detection theory and psychophysics, New York, Wiley.

Greenwald, A. G., Draine, S. C. & Abrams, R. L. (1996). Three cognitive markers of unconscious semantic activation. Science, 273, 1699-1702.

Hollender, D. (1986). Semantic activation without conscious identification in dichotic listening, parafoveal vision, and visual masking: A survey and appraisal. Behavioral and Brain Sciences, 9, 1-66.

Jones, M. R. (1976). Time, our lost dimension: toxard a new theory of perception, attention and memory, Psychological Review, 83, 323-355.

Jones, M. R. & Boltz, M. (1989). Dynamic attending and response time, Psychological Review, 3, 459-491.

Jones, M. R. & Yee, W. (1993). Attending to auditory events: the role of temporal organization, in S. McAdams & E. Bignand (Eds.), Thinking in sound, Oxford, Clarendon Press.

Keefe, D. E. & Neely, J. H. (1990). Semantic priming in the pronunciation task: The role of prospective prime-generated expectancies. Memory & Cognition, 18, 289-298.

Laberge, D. (1995). Attentional Processing, Cambridge, Mass., Harvard University Press.

Landauer, T. K., Foltz, P. W. & Laham, D. (1998). An introduction to latent semantic analysis. Discourse Processes, 25, 259-284.

Lavigne, F. & Dubois, D. (2000). Context effects and associative anaphora in reading, Journal of Pragmatics, 31, 399-415.

Lavigne, F. & Vitu, F. (1997). Time course of facilitatory and inhibitory semantic priming effects in visual word recognition. International Journal of Psycholinguistics, 13, 311-349.

Lavigne, F., Vitu, F & d’Ydewalle. (2000). Context effects and parafoveal preview in sentence reading, Acta Psychologica, 104, 291-214.

Lavigne, F., Vitu, F & d’Ydewalle. (submitted). Time-course of facilitatory and inhibitory context effects in sentence reading.

Lecas, J. C. (1992). L’attention Visuelle, Bruxelles, Mardaga.

Levine, D. S., Leuven, S. J. & Prueitt, P. S. (1992). Integration, disintegration and the frontal lobes. In Levine, D. S. & Leven, S. J. (Eds), Motivation, emotion and goal direction in neural networks (pp 301-334), Lawrence Erlbaum Associates, Hillsdale, N.J.

Masson, M. E. J. (1991). A distributed memory model of context effects in word identification, In D. Besner and G. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 233-263) Hillsdale, Hove, London, Lawrence Erlbaum.

Masson, M. E. J. (1995). A distributed memory model of semantic priming. Journal of Experimental Psychology: Learning, Memory & Cognition, 21, 3-23.

McNamara, T. P. (1994). Theories of Priming: II. Types of primes. Journal of Experimental Psychology: Learning, Memory & Cognition, 3, 507-520.

Millis, M. L. and Button, S. B. (1989). The effect of polysemy on lexical decision time: Now you see it, now you don’t. Memory and Cognition, 17, 141-147.

Monsell, S. (1991). The nature and locus of word frequency effect in reading, In D. Besner and G. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 148-197). Hillsdale, Hove, London: Lawrence Erlbaum.

Neely, J.H. (1976). Semantic priming and retrieval from lexical memory: Evidence for facilitatory and inhibitory processes. Memory & Cognition, 4, 648-654.

Neely, J.H. (1977). Semantic priming and retrieval from lexical memory: Roles of inhibitionless spreading activation and limited-capacity attention. Journal of Experimental Psychology: General, 106, 226-254.

Neely, J.H. (1991). Semantic priming effects in visual word recognition: A selective review of currents findings and theories. In D. Besner & G. Humphreys (Eds.), Basic processes in reading: Visual word recognition (pp. 264-336). Hillsdale, Hove, London: Lawrence Erlbaum.

Neely, J.H. & Keefe, D.E. (1989). Semantic context effects on visual word processing: A hybrid prospective/retrospective processing theory. In G. H. Bower, (Ed.), The psychology of learning and motivation: Advances in research and theory, vol 24 (pp. 207-248). NewYork: Academic Press.

Neely, J.H., Keefe, D.E. & Ross, K. (1989). Semantic priming in the lexical decision task: Roles of prospective prime-generated expectancies and retrospective semantic matching. Journal of Experimental Psychology: Learning, Memory and Cognition, 15, 1003-1019.

Perlmutter, J., Sorce, P. & Myers, J. L. (1976). Retrieval processes in recall. Cognitive Psychology, 8, 32-63.

Posner, M. I. (1980). Orienting of attention, Quarterly Journal of Experimental Psychology, 32, 3-25.

Posner, M. I. & Cohen, Y. (1984). Components of visual orienting, in H. Bouma & D. Bouhuis (Eds.), Attention and Performance X, 531-556, London, Erlbaum.

Posner, M. I. & Snyder, C. R. R. (1975a). Facilitation and Inhibition in the processing of signals. In P. M. A. Rabitt & S. Dornic (Eds.), Attention and Performance V (pp. 669-698). New York: Academic Press.

Posner, M. I. and Snyder, C. R. R. (1975b). Attention and cognitive control. In R. L. Solso (Ed.), Information processing and cognition: The Loyola Symposium (pp. 55-85), Hillsdale, NJ: Erlbaum.

Rayner, K. &. Balota, D.A. (1989). Parafoveal preview and lexical access during eye fixations in reading. In W. Marslen-Wilson (Ed.), Lexical representation and process (pp. 261-290). Hillsdale, Hove, London: Lawrence Erlbaum.

Rosen, R. (1985). Anticipatory Systems – Philosophical, Mathematical and Methodological Foundations. Pergamon Press.

Rumelhart, D. E. & McClelland, J. L. (1981). An interactive activation model of context effects in letter perception : I. An account and basic findings, Psychological review, 88, 375-407.

Rumelhart, D. E. & McClelland, J. L. (1982). An interactive activation model of context effects in letter perception : II. The contextual enhencement effect and some tests and extensions of the model. Psychological review, 89, 60-94.

Shiffrin, R. M. (1988). Attention, in R. L. Atkinson, R. J. Merrenstein, G. Lindsey & R. D. Luce (Eds.), Steven’s Handbook of Experimental Psychology, Second edition (vol II) : Learning and Cognition, New York, Wiley & Son, 739-811.

Spence, D. P. & Kimberly, C. O. (1990). Lexical co-occurrence and association strength, Journal of Psycholinguistic Research, 19, 317-330.

Sperling, G. & Reeves, A. (1980). Measuring the reaction time of an unobserved response; a shift of visual attention, in R. Nickerson (Ed.), Attention and Performance VIII, Hillsdale, Lawrence Erlbaum.

Tanner, W. P. & Swets, J. A. (1954). A decision-making theory of visual detection, Psychological Review, 61,

Thompson-Schill, S., Kurtz, K.J. & Gabrieli, J.D.E. (1998). Effects of semantic and associative relatedness on automatic priming, Journal of Memory and Language, 38, 440-458.

Tipper, S.P., Bourque, T.A., Anderson, S.H. & Brehaut, J. (1989). Mechanisms of attention: a developmental study, Journal of Experimental Child Psychology, 48, 353-378.

VanVoorhis, B.A., & Dark, V. (1995). Semantic matching, response mode, and response mapping as contributors to retroactive and proactive priming, Journal of Experimental Psychology: Learning, Memory and Cognition, 21, 4, 913-932.

Vitu, F. (1991). The influence of parafoveal preprocessing and linguistic context on the optimal landing position effect. Perception & Psychophysics, 50, 58-75.

Weichselgartner, E. & Sperling, G. (1987). Dynamic of automatic and controlled visual attention, Science, 238, 778-780.


Repository Staff Only: item control page