Kolinsky, R. (2015). How learning to read influences language and cognition. In A. Pollatsek & R. Treiman (Eds.), The Oxford Handbook of Reading. New York: Oxford University Press (pp. 377-393). doi: 10.1093/oxfordhb/9780199324576.013.29.
As illustrated in this handbook, a substantial body of work now exists that examines which factors
and functions affect reading acquisition and reading pro ciency, and which brain areas are involved. The converse relationship—namely, which functions and brain areas are affected by literacy—has received
far less attention, probably because reading acquisition lags speech and vision by several years and because the crucial comparison of illiterate adults with people who learned to read as adults is difficult to undertake. However, this chapter illustrates that learning to read has profound influences on the processing of spoken language and beyond the domain of language, in particular on visual nonlinguistic perception. The chapter discusses research with literate adults in these areas, including the influence of spelling knowledge on speech perception. It also covers research with illiterate adults and on people who first learned to read as adults.
Kolinsky, R., Monteiro-Plantin, R. S., Mengarda, E. J., Grimm-Cabral, L., Scliar-Cabral, L., & Morais, J. (2014). How formal education and literacy impact on the content and structure of semantic categories. Trends in Neuroscience and Education, 3, 106-121. DOI: 10.1016/j.tine.2014.08.001
We examined the hypothesis that formal education and literacy impact the richness and precision of semantic knowledge but not the organization of semantic categories and basic mechanisms of access to them.
In Experiment 1, adults of varying levels of formal education were presented with semantic fluency tests and a superordinate naming task. Experiment 2 examined the impact of reading proficiency on adults of varying degrees of literacy. They were presented with simple semantic, alternating semantic and phonemic fluency tasks, as well as with literacy-related, reasoning and memory tests.
Fluency was analyzed in terms of overall performance, sequential order and speed of responses. Despite lower performance, illiterates and adults with null or limited formal education displayed taxonomic clustering and retrieval by semantic subcategory, as did participants with higher formal education levels. Yet, formal education and literacy slightly speed up access to categories, probably providing useful cues for generating category exemplars.
Kolinsky, R., & Fernandes, T. (2014). A cultural side effect: Learning to read interferes with object identity processing. Frontiers in Psychology. 5: 1224 doi: 10.3389/fpsyg.2014.01224
Based on the "neuronal recycling hypothesis" (Dehaene and Cohen, 2007), we examined whether reading acquisition has a cost for the recognition of non-linguistic visual materials. More specifically, we checked whether the ability to discriminate between mirror images, which develops through literacy acquisition, interferes with object identity judgments, and whether interference strength varies as a function of the nature of the non-linguistic material. To these aims we presented illiterate, late literate (who learned to read at adult age), and early literate adults with an orientation-independent, identity-based same-different comparison task in which they had to respond “same” to both physically identical and mirrored or plane-rotated images of pictures of familiar objects (Experiment 1) or of geometric shapes (Experiment 2). Interference from irrelevant orientation variations was stronger with plane rotations than with mirror images, and stronger with geometric shapes than with objects. Illiterates were the only participants almost immune to mirror variations, but only for familiar objects. Thus, the process of unlearning mirror-image generalization, necessary to acquire literacy in the Latin alphabet, has a cost for a basic function of the visual ventral object recognition stream, i.e., identification of familiar objects. This demonstrates that neural recycling is not just an adaptation to multi-use but a process of at least partial exaptation.
Kolinsky, R., Morais, J., Cohen, L., Dehaene-Lambertz, G. & Dehaene, S. (2014). L’influence de l’apprentissage du langage écrit sur les aires du langage/The impact of literacy on the language brain areas. Revue de Neuropsychologie, 6, 173-181.
L’acquisition de la lecture et de l’écriture, ou littératie,constitue vraisemblablement l’un des plus puissants instruments de transformation cognitive et cérébrale que nous acquérons au cours de notre vie. Dans cette revue, nous discutons du fait que, en plus de permettre l’acquisition de nouvelles connaissances (par l’intermédiaire de la lecture) et le stockage extérieur de l’information (via les notes manuscrites, les livres, les ordinateurs, etc.), la littéeatie entraîne trois grands types de changements dans les circuits cérébraux du langage. Nous illustrons le fait que l’apprentissage de l’écrit mène non seulement à une activation des aires du langage parlé par l’écrit, mais aussi à des modifications du traitement du langage parlé lui-même, et ce par deux mécanismes. En effet, la littératie améliore le codage phonologique (dans le planum temporale) et conduit, dans certaines situations d’écoute, à une activation « top-down » des représentations orthographiques (dans le cortex occipito-temporal gauche). En outre, l’acquisition de la littératie s’accompagne de changements anatomiques, notamment dans la connectivité intra- et inter-hémisphérique. Pour finir, nous discutons des implications théoriques et pratiques de ces découvertes pour les neuropsychologues.
Chambon*, V., Sidarus*, N., & Haggard, P. (2014). From action intentions to action effects: how does the sense of agency come about? Frontiers in Human Neuroscience, 8, 320. doi:10.3389/fnhum.2014.00320
Sense of agency refers to the feeling of controlling an external event through one’s own
action. On one influential view, agency depends on how predictable the consequences
of one’s action are, getting stronger as the match between predicted and actual effect
of an action gets closer. Thus, sense of agency arises when external events that follow
our action are consistent with predictions of action effects made by the motor system
while we perform or simply intend to perform an action. According to this view, agency
is inferred retrospectively, after an action has been performed and its consequences are
known. In contrast, little is known about whether and how internal processes involved
in the selection of actions may influence subjective sense of control, in advance of the
action itself, and irrespective of effect predictability. In this article, we review several
classes of behavioral and neuroimaging data suggesting that earlier processes, linked to
fluency of action selection, prospectively contribute to sense of agency. These findings
have important implications for better understanding human volition and abnormalities of
action experience.
Chetail, F., Drabs, V. & Content, A. The role of consonant/vowel organization in perceptual discrimination. Journal of Experimental Psychology: Learning, Memory and Cognition, 2014 Apr 21. [Epub ahead of print], doi: 10.1037/a0036166.
According to a recent hypothesis, the CV pattern (i.e., the arrangement of consonant and vowel letters) constrains the mental representation of letter strings, with each vowel or vowel cluster being the core of a unit.
Six experiments with the same/different task were conducted to test whether this structure is extracted prelexically. In the mismatching trials, the targets were pseudowords built by the transposition of 2 adjacent letters from base words. In one condition, the pseudowords had the same number of vowel clusters as the base word, whereas in another condition, the transposition modified the number of vowel clusters (e.g., poirver: 2 vowel clusters vs. povirer: 3 vowel clusters, from POIVRER: 2 vowel clusters). In Experiment 1, pseudowords with a different number of vowel clusters were more quickly processed than pseudowords preserving the CV structure of their base word. Experiment 2 further showed that this effect was not due to changes in syllabic structure. In Experiment 3, the pattern of results was also replicated when the category (consonant or vowel) of the transposed letters was strictly equated between conditions. Experiments 4 and 5 confirmed that the effects were not attributable to lexical processing, to differences in letter identity, or to the position of transpositions. The results suggest that the orthographic representation of letter strings is influenced by the CV pattern at an early, prelexical processing stage.
Cleeremans, A. (in press). Connecting conscious and unconscious processing. Cognitive Science.
Consciousness remains a mystery — “a phenomenon that people don’t know how to think about —yet” (Dennett, 1991, p. 21). Here, I consider how the connectionist perspective on information processing may help us progress towards the goal of understanding the computational principles through which conscious and unconscious processing differ. I begin by delineating the conceptual challenges associated with classical approaches to cognition insofar as understanding unconscious information processing is concerned, and to highlight several contrasting computational principles that are constitutive of the connectionist approach. This leads me to suggest that conscious and unconscious processing are fundamentally connected, that is, rooted in the very same computational principles. I further develop a perspective according to which the brain continuously and unconsciously learns to redescribe its own activity itself based on on constant interaction with itself, with the world, and with other minds. The outcome of such interactions is the emergence of internal models that are metacognitive in nature and that function so as it make it possible for an agent to develop a (limited, implicit, practical) understanding of itself. In this light, plasticity and learning are constitutive of what makes us conscious, for it is in virtue of our own experiences with ourselves and with other people that our mental life acquires its subjective character. The connectionist framework continues to be uniquely positioned in the Cognitive Sciences to address the challenge of identifying what one could call the “computational correlates of consciousness” (Mathis & Mozer, 1996) because it makes it possible to focus on the mechanisms through which information processing takes place.
Doyen, S., Klein, O., Simons, D.J., & Cleeremans, A. (in press). On the other side of the mirror: Priming in cognitive and social psychology. Social Cognition.
Over the past several years, two largely separate traditions have collided, leading to controversy over claims about priming. We describe and contrast the main accounts of priming effects in cognitive and social psychology, focusing especially on the role of awareness. In so doing, we consider one of the core points of contention, claims about the effects of subliminal priming. Whereas cognitive psychologists often are interested in exploring how priming operates with and without awareness, social psychologists more commonly assume subliminality in order to bolster claims about the automaticity of priming. We discuss the criteria necessary to claim that a stimulus was processed entirely without awareness, noting the challenges in meeting those criteria. Finally, we identify three sources of conflict between the fields: awareness, replicability, and the nature of the underlying processes. We close by proposing resolutions for each of them.
Windey, B., Vermeiren, A., Atas, A., & Cleeremans, A. (2014). The graded and dichotomous nature of visual awareness. Philosophical Transactions of the Royal Society B, 369: 20130282
Is our visual experience of the world graded or dichotomous? Opposite pre- theoretical intuitions apply in different cases. For instance, when looking at a scene, one has a distinct sense that our experience has a graded character: one cannot say that there is no experience of contents that fall outside the focus of attention, but one cannot say that there is full awareness of such contents either. By contrast, when performing a visual detection task, our sense of having perceived the stimulus or not exhibits a more dichoto- mous character. Such issues have recently been the object of intense debate because different theoretical frameworks make different predictions about the graded versus dichotomous character of consciousness. Here, we review both relevant empirical findings as well as the associated theories (i.e. local recurrent processing versus global neural workspace theory). Next, we attempt to reconcile such contradictory theories by suggesting that level of processing is an often-ignored but highly relevant dimension through which we can cast a novel look at existing empirical findings. Thus, using a range of different stimuli, tasks and subjective scales, we show that proces- sing low-level, non-semantic content results in graded visual experience, whereas processing high-level semantic content is experienced in a more dichotomous manner. We close by comparing our perspective with existing proposals, focusing in particular on the partial awareness hypothesis.
Stenner, M.-P., Bauer, M., Sidarus, N., Heinze, H.-J., Haggard, P., & Dolan, R.J. 2014 Subliminal action priming modulates the perceived intensity of sensory action consequences. Cognition, 30(2), 227–235.
The sense of control over the consequences of one’s actions depends on predictions about these consequences. According to an influential computational model, consistency between predicted and observed action consequences attenuates perceived stimulus intensity, which might provide a marker of agentic control. An important assumption of this model is that these predictions are generated within the motor system. However, previous studies of sensory attenuation have typically confounded motor-specific perceptual modulation with perceptual effects of stimulus predictability that are not specific to motor action. As a result, these studies cannot unambiguously attribute sensory attenuation to a motor locus. We present a psychophysical experiment on auditory attenuation that avoids this pitfall. Subliminal masked priming of motor actions with compatible prime– target pairs has previously been shown to modulate both reaction times and the explicit feeling of control over action consequences. Here, we demonstrate reduced perceived loudness of tones caused by compatibly primed actions. Importantly, this modulation results from a manipulation of motor processing and is not confounded by stimulus predictability. We discuss our results with respect to theoretical models of the mechanisms underlying sensory attenuation and subliminal motor priming.
Sidarus, N., Chambon, V. & Haggard, P. 2013 Priming of actions increases sense of control over unexpected outcomes. Consciousness and Cognition, 22, 1403–1411.
Sense of agency (SoA) refers to the feeling that we are in control of our own actions and, through them, events in the outside world. SoA depends partly on retrospectively matching outcomes to expectations, and partly on prospective processes occurring prior to action, notably action selection.
To assess the relative contribution of these processes, we factorially varied subliminal priming of action selection and expectation of action outcomes. Both factors affected SoA, and there was also a significant interaction. Compatible action primes increased SoA more strongly for unexpected than expected outcomes. Outcome expectation had strong effects on SoA following incompatible action priming, but only weak effects following compatible action priming. Prospective and retrospective SoA may have distinct and complementary functions.
Chetail, F. & Content, A. What Is the Difference Between OASIS and OPERA? Roughly Five Pixels: Orthographic Structure Biases the Perceived Length of Letter Strings. Psychological Science, 25 (1), 243-249.
A thorough understanding of monosyllabic-word-recognition processes, in contrast with multisyllabic-word processing, has accumulated over the past decades. One fundamental challenge regarding multisyllabic words concerns their parsing into smaller units and the nature of the cues determining the parsing. We propose that the organization of consonant and vowel letters provides powerful cues for parsing, and we present data from a new task showing that a word’s orthographic structure, as determined by the number of vowel-letter clusters, influences estimations of its length. Words were briefly presented on a computer screen, and participants had to estimate word length by drawing a line on the screen with the mouse. In three experiments, participants estimated words comprising fewer orthographic units as shorter than words comprising more units even though the words matched for number of letters. Further results demonstrated that the length bias was driven by orthographic information and not by phonological structure.