Benefit of visual cues to sustained auditory attention in realistic environments
* Präsentierender Autor
Zusammenfassung:Brain entrainment to attended speech is positively influenced by visual cues, such as facial expressions and lip movement, thus enhancing our ability to comprehend speakers in every-day life. This mechanism may have a significant impact on the amount of fatigue caused by casual listening, particularly in hearing-impaired individuals. In a controlled laboratory environment, we investigated neural bases of audiovisual benefit when listening to running speech. We recorded electroencephalogram (EEG) from 40 participants while they were listening to speech with and without a video of speaker's face. Participants were instructed to press a button when target word was presented.We found that target word detection significantly increased when video of the speaker was shown. On neural level, using attention tracking models, we observed enhancement of speech entrainment with additional visual cues. The amount of enhancement was correlated with subjective ratings of listening effort. These results speak for undisputable importance of visual cues in running speech perception.We will next focus on investigating neural underpinnings of audiovisual benefit in more realistic, ecologically valid situations using virtual environment and completely mobile, transparent EEG devices. Impact of specific visual cues on auditory attention will be addressed, shedding light on speech comprehension in real-life.