Deviance detection in congruent audiovisual speech

Evidence for implicit integrated audiovisual memory representations

I. Winkler, J. Horváth, Júlia Weisz, Leonard J. Trejo

Research output: Contribution to journalArticle

10 Citations (Scopus)

Abstract

Detection of deviant speech syllables embedded in continuous noise was investigated in an oddball paradigm. Behavioral results showed improvement of detecting and identifying the syllables when congruent visual speech accompanied the utterances. A centrally maximal negative ERP difference wave peaking at approximately 290 ms post-stimulus was elicited by audiovisual but not by auditory- or visual-only task-irrelevant deviant syllables. Whereas the circumstances of the elicitation of this ERP response are similar to those of the mismatch negativity component (MMN and its visual counterpart, vMMN), its scalp distribution differs from that of both unimodal MMNs. Elicitation of an MMN-like ERP response (termed here as the audiovisual MMN: avMMN) suggests that detection of the audiovisual deviants involved integrated audiovisual memory representations. The pattern of behavioral and ERP results suggest that the formation of such cross-modal memory representation does not require voluntary operations and may even proceed for stimuli outside the focus of attention.

Original languageEnglish
Pages (from-to)281-292
Number of pages12
JournalBiological Psychology
Volume82
Issue number3
DOIs
Publication statusPublished - Dec 2009

Fingerprint

Scalp
Noise

Keywords

  • Audiovisual integration
  • Deviance detection
  • Event-related brain potentials (ERP)
  • Implicit memory
  • Mismatch negativity (MMN)
  • Speech perception

ASJC Scopus subject areas

  • Neuroscience(all)
  • Neuropsychology and Physiological Psychology

Cite this

Deviance detection in congruent audiovisual speech : Evidence for implicit integrated audiovisual memory representations. / Winkler, I.; Horváth, J.; Weisz, Júlia; Trejo, Leonard J.

In: Biological Psychology, Vol. 82, No. 3, 12.2009, p. 281-292.

Research output: Contribution to journalArticle

@article{16e0cc55f32341669d7771763956764f,
title = "Deviance detection in congruent audiovisual speech: Evidence for implicit integrated audiovisual memory representations",
abstract = "Detection of deviant speech syllables embedded in continuous noise was investigated in an oddball paradigm. Behavioral results showed improvement of detecting and identifying the syllables when congruent visual speech accompanied the utterances. A centrally maximal negative ERP difference wave peaking at approximately 290 ms post-stimulus was elicited by audiovisual but not by auditory- or visual-only task-irrelevant deviant syllables. Whereas the circumstances of the elicitation of this ERP response are similar to those of the mismatch negativity component (MMN and its visual counterpart, vMMN), its scalp distribution differs from that of both unimodal MMNs. Elicitation of an MMN-like ERP response (termed here as the audiovisual MMN: avMMN) suggests that detection of the audiovisual deviants involved integrated audiovisual memory representations. The pattern of behavioral and ERP results suggest that the formation of such cross-modal memory representation does not require voluntary operations and may even proceed for stimuli outside the focus of attention.",
keywords = "Audiovisual integration, Deviance detection, Event-related brain potentials (ERP), Implicit memory, Mismatch negativity (MMN), Speech perception",
author = "I. Winkler and J. Horv{\'a}th and J{\'u}lia Weisz and Trejo, {Leonard J.}",
year = "2009",
month = "12",
doi = "10.1016/j.biopsycho.2009.08.011",
language = "English",
volume = "82",
pages = "281--292",
journal = "Biological Psychology",
issn = "0019-493X",
publisher = "Elsevier",
number = "3",

}

TY - JOUR

T1 - Deviance detection in congruent audiovisual speech

T2 - Evidence for implicit integrated audiovisual memory representations

AU - Winkler, I.

AU - Horváth, J.

AU - Weisz, Júlia

AU - Trejo, Leonard J.

PY - 2009/12

Y1 - 2009/12

N2 - Detection of deviant speech syllables embedded in continuous noise was investigated in an oddball paradigm. Behavioral results showed improvement of detecting and identifying the syllables when congruent visual speech accompanied the utterances. A centrally maximal negative ERP difference wave peaking at approximately 290 ms post-stimulus was elicited by audiovisual but not by auditory- or visual-only task-irrelevant deviant syllables. Whereas the circumstances of the elicitation of this ERP response are similar to those of the mismatch negativity component (MMN and its visual counterpart, vMMN), its scalp distribution differs from that of both unimodal MMNs. Elicitation of an MMN-like ERP response (termed here as the audiovisual MMN: avMMN) suggests that detection of the audiovisual deviants involved integrated audiovisual memory representations. The pattern of behavioral and ERP results suggest that the formation of such cross-modal memory representation does not require voluntary operations and may even proceed for stimuli outside the focus of attention.

AB - Detection of deviant speech syllables embedded in continuous noise was investigated in an oddball paradigm. Behavioral results showed improvement of detecting and identifying the syllables when congruent visual speech accompanied the utterances. A centrally maximal negative ERP difference wave peaking at approximately 290 ms post-stimulus was elicited by audiovisual but not by auditory- or visual-only task-irrelevant deviant syllables. Whereas the circumstances of the elicitation of this ERP response are similar to those of the mismatch negativity component (MMN and its visual counterpart, vMMN), its scalp distribution differs from that of both unimodal MMNs. Elicitation of an MMN-like ERP response (termed here as the audiovisual MMN: avMMN) suggests that detection of the audiovisual deviants involved integrated audiovisual memory representations. The pattern of behavioral and ERP results suggest that the formation of such cross-modal memory representation does not require voluntary operations and may even proceed for stimuli outside the focus of attention.

KW - Audiovisual integration

KW - Deviance detection

KW - Event-related brain potentials (ERP)

KW - Implicit memory

KW - Mismatch negativity (MMN)

KW - Speech perception

UR - http://www.scopus.com/inward/record.url?scp=70350126934&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350126934&partnerID=8YFLogxK

U2 - 10.1016/j.biopsycho.2009.08.011

DO - 10.1016/j.biopsycho.2009.08.011

M3 - Article

VL - 82

SP - 281

EP - 292

JO - Biological Psychology

JF - Biological Psychology

SN - 0019-493X

IS - 3

ER -