7th Annual Meeting of the International Multisensory Research Forum
    Home > Papers > Jung-Kyong Kim
Jung-Kyong Kim

Visual-to-auditory substitution learning: Behavioral findings and neural correlates
Poster Presentation

Jung-Kyong Kim
Montreal Neurological Institute, McGill University

Robert Zatorre
Montreal Neurological Institute, McGill University

     Abstract ID Number: 150
     Full text: Not available
     Last modified: March 19, 2006
     Presentation date: 06/19/2006 10:00 AM in Hamilton Building, Foyer
     (View Schedule)

Abstract
We investigated visual-to-auditory substitution learning in sighted subjects using the conversion algorithm developed by Meijer (1992). Over the course of approximately three weeks, eight sighted subjects participated in nine ~1.75-hour training sessions during which they learned the relationship of various visual images with their corresponding converted sounds. The visual images included abstract figures, pictures of real-life objects, and pictures of scenes. Subjects were evaluated with forced-choice recognition tasks at the end of every three training sessions using both the items encountered during training and new items designed to test for generalization. Significant improvement was observed over time in recognizing the corresponding converted sounds for novel visual images, with the biggest improvement found in identification of the abstract figures. Drawing tasks also demonstrated subjects’ abilities to extract overall shapes of the visual images from the corresponding converted sounds. Based on these findings, we are conducting an fMRI study using the same training protocol for a period of five consecutive days. We expect that the behavioral improvement in visual judgments of the converted sounds will be accompanied by changes in occipital cortex activity as a result of the structured training. Such findings would indicate that cross-modal cortical interactions underlie visual-to-auditory substitution learning.

Research
Support Tool
  For this 
refereed conference abstract
Capture Cite
View Metadata
Printer Friendly
Context
Author Bio
Define Terms
Related Studies
Media Reports
Google Search
Action
Email Author
Email Others
Add to Portfolio



    Learn more
    about this
    publishing
    project...


Public Knowledge

 
Open Access Research
home | overview | program
papers | organization | schedule | links
  Top