7th Annual Meeting of the International Multisensory Research Forum
    Home > Papers > Vera Blau
Vera Blau

Visual influences on speech sound discrimination: A parametric fMRI study
Poster Presentation

Vera Blau
Dept. of Cogntive Neuroscience, Maastricht University, the Netherlands; Maastricht Brain Imaging Center (M-BIC), the Netherlands

Nienke Van Atteveldt
Department of Cogntive Neuroscience, Maastricht University, the Netherlands; Maastricht Brain Imaging Center (M-BIC), the Netherlands

Elia Formisano
Department of Cogntive Neuroscience, Maastricht University, the Netherlands; Maastricht Brain Imaging Center (M-BIC), the Netherlands

Rainer Goebel
Department of Cogntive Neuroscience, Maastricht University, the Netherlands; Maastricht Brain Imaging Center (M-BIC), the Netherlands

Leo Blomert
Department of Cogntive Neuroscience, Maastricht University, the Netherlands, Maastricht Brain Imaging Center (M-BIC), the Netherlands

     Abstract ID Number: 47
     Full text: Not available
     Last modified: March 15, 2006
     Presentation date: 06/20/2006 10:00 AM in Hamilton Building, Foyer
     (View Schedule)

Abstract
The superior temporal cortex is activated during integration of letters and speech sounds [1] and has recently been implicated in the visual enhancement of speech intelligibility in the presence of acoustic masking noise [2]. The present fMRI study [N=9] used degraded auditory and visual input to unravel the relative contributions of visual letters on speech sound discrimination.

Speech sounds were presented in isolation or with matching or non-matching letters (congruency factor). Speech sounds were degraded using pink noise enabling non-optimal identification; letters were degraded using a line mask corresponding to good, medium and low perceptibility of the visual letter (visual noise factor). Subject discriminated between speech sounds /a/ and /e/.

Simultaneous presentation of a congruent visual letter facilitated subjects’ speech sound discrimination performance compared to unimodal auditory conditions, whereas incongruent letters increased reaction time. Only well-perceivable visual letters in congruent presentations led to increased activation in superior temporal areas. In lateral occipito-temporal regions the difference between congruent and incongruent combinations of letters and speech sounds scaled parametrically with the levels of visual noise.

The present study reveals a systematic influence of audiovisual congruency on the auditory discrimination of speech sounds in superior temporal and in occipito-temporal areas.

References:
[1] Van Atteveldt et al. (2004), Neuron, 43, 271-282.
[2] Callan et al. (2003), NeuroReport, 14, 2213-2218.

Research
Support Tool
  For this 
refereed conference abstract
Capture Cite
View Metadata
Printer Friendly
Context
Author Bio
Define Terms
Related Studies
Media Reports
Google Search
Action
Email Author
Email Others
Add to Portfolio



    Learn more
    about this
    publishing
    project...


Public Knowledge

 
Open Access Research
home | overview | program
papers | organization | schedule | links
  Top