Cortico-striatal Function in Language and Cognitive Sequence Processing: Towards Cognitive Robotics
09/16/2009 - 10:30
09/16/2009 - 11:30
The peri-sylvian cortico-striatal language system, has been demonstrated by numerous techniques (including lesion, PET, fMRI) to play a fundamental role in sentence comprehension. We have explored this system in thematic role assignment (determining who did what to whom) in sentence processing, and developed a neural network model that explains a significant component of this human behaviour, based on neurophysiological functions that are not specific to language (Dominey et al. 2006, 2009). This modelling work has led to a number of predictions concerning a shared system for linguistic and non-linguistic sequence processing (Hoen et al. 2006). A major challenge was to determine if our language processing model could accommodate the “real world”. We thus embedded the neural network in a robotic system that could see, hear, and learn to describe physical events using the language learning network (Dominey & Boucher 2005). More recently we have extended this neuro-robotic approach to using high degree-of-freedom humanoid robots (Dominey et al. 2009b). We currently focus on neuro-robotic approaches to embodied representations of meaning (Madden et al. 2009). The talk will provide an overview of this research.
Dominey PF, Inui T, Hoen M. (2009) Neural network processing of natural language: II.
Towards a unified model of corticostriatal function in learning sentence
comprehension and non-linguistic sequencing. Brain Lang. May-Jun;109(2-3):80-92.
Dominey PF, Hoen M, Inui T. (2006)A neurolinguistic model of grammatical
construction processing. J Cogn Neurosci. Dec;18(12):2088-107
Hoen M, Pachot-Clouard M, Segebarth C, Dominey P.F. (2006) When Broca experiences the Janus syndrome. An er-fMRI study comparing sentence comprehension and cognitive sequence processing. Cortex, 42(4):605-23
Dominey PF, Boucher JD (2005) Learning To Talk About Events From Narrated Video in the Construction Grammar Framework, Artificial Intelligence, 167 (2005) 31–61
Dominey PF, Mallet A, Yoshida E (2009b) Real-Time Spoken-Language Programming
For Cooperative Interaction With a Humanoid Apprentice, Intl. J. Humanoid Robotics, In Press
Madden C, Hoen M, Dominey PF (2009) A Cognitive Neuroscience Perspective on Embodied Language for Human-Robot Cooperation, Brain and Language, In Press