Do audio-visual motion cues promote segregation of auditory streams?

Lidia Shestopalova, Tamás M. Böhm, Alexandra Bendixen, Andreas G. Andreou, Julius Georgiou, Guillaume Garreau, Botond Hajdu, Susan L. Denham, I. Winkler

Research output: Contribution to journalArticle

3 Citations (Scopus)

Abstract

An audio-visual experiment using moving sound sources was designed to investigate whether the analysis of auditory scenes is modulated by synchronous presentation of visual information. Listeners were presented with an alternating sequence of two pure tones delivered by two separate sound sources. In different conditions, the two sound sources were either stationary or moving on random trajectories around the listener. Both the sounds and the movement trajectories were derived from recordings in which two humans were moving with loudspeakers attached to their heads. Visualized movement trajectories modeled by a computer animation were presented together with the sounds. In the main experiment, behavioral reports on sound organization were collected from young healthy volunteers. The proportion and stability of the different sound organizations were compared between the conditions in which the visualized trajectories matched the movement of the sound sources and when the two were independent of each other. The results corroborate earlier findings that separation of sound sources in space promotes segregation. However, no additional effect of auditory movement per se on the perceptual organization of sounds was obtained. Surprisingly, the presentation of movement-congruent visual cues did not strengthen the effects of spatial separation on segregating auditory streams. Our findings are consistent with the view that bistability in the auditory modality can occur independently from other modalities.

Original languageEnglish
Article numberArticle 64
JournalFrontiers in Neuroscience
Issue number8 APR
DOIs
Publication statusPublished - 2014

Fingerprint

Cues
Healthy Volunteers
Head

Keywords

  • Audio-visual integration
  • Auditory motion
  • Auditory stream segregation
  • Bistable perception

ASJC Scopus subject areas

  • Neuroscience(all)

Cite this

Shestopalova, L., Böhm, T. M., Bendixen, A., Andreou, A. G., Georgiou, J., Garreau, G., ... Winkler, I. (2014). Do audio-visual motion cues promote segregation of auditory streams? Frontiers in Neuroscience, (8 APR), [Article 64]. https://doi.org/10.3389/fnins.2014.00064

Do audio-visual motion cues promote segregation of auditory streams? / Shestopalova, Lidia; Böhm, Tamás M.; Bendixen, Alexandra; Andreou, Andreas G.; Georgiou, Julius; Garreau, Guillaume; Hajdu, Botond; Denham, Susan L.; Winkler, I.

In: Frontiers in Neuroscience, No. 8 APR, Article 64, 2014.

Research output: Contribution to journalArticle

Shestopalova, L, Böhm, TM, Bendixen, A, Andreou, AG, Georgiou, J, Garreau, G, Hajdu, B, Denham, SL & Winkler, I 2014, 'Do audio-visual motion cues promote segregation of auditory streams?', Frontiers in Neuroscience, no. 8 APR, Article 64. https://doi.org/10.3389/fnins.2014.00064
Shestopalova L, Böhm TM, Bendixen A, Andreou AG, Georgiou J, Garreau G et al. Do audio-visual motion cues promote segregation of auditory streams? Frontiers in Neuroscience. 2014;(8 APR). Article 64. https://doi.org/10.3389/fnins.2014.00064
Shestopalova, Lidia ; Böhm, Tamás M. ; Bendixen, Alexandra ; Andreou, Andreas G. ; Georgiou, Julius ; Garreau, Guillaume ; Hajdu, Botond ; Denham, Susan L. ; Winkler, I. / Do audio-visual motion cues promote segregation of auditory streams?. In: Frontiers in Neuroscience. 2014 ; No. 8 APR.
@article{61935e8742bf483aa0ee8f517682c3a0,
title = "Do audio-visual motion cues promote segregation of auditory streams?",
abstract = "An audio-visual experiment using moving sound sources was designed to investigate whether the analysis of auditory scenes is modulated by synchronous presentation of visual information. Listeners were presented with an alternating sequence of two pure tones delivered by two separate sound sources. In different conditions, the two sound sources were either stationary or moving on random trajectories around the listener. Both the sounds and the movement trajectories were derived from recordings in which two humans were moving with loudspeakers attached to their heads. Visualized movement trajectories modeled by a computer animation were presented together with the sounds. In the main experiment, behavioral reports on sound organization were collected from young healthy volunteers. The proportion and stability of the different sound organizations were compared between the conditions in which the visualized trajectories matched the movement of the sound sources and when the two were independent of each other. The results corroborate earlier findings that separation of sound sources in space promotes segregation. However, no additional effect of auditory movement per se on the perceptual organization of sounds was obtained. Surprisingly, the presentation of movement-congruent visual cues did not strengthen the effects of spatial separation on segregating auditory streams. Our findings are consistent with the view that bistability in the auditory modality can occur independently from other modalities.",
keywords = "Audio-visual integration, Auditory motion, Auditory stream segregation, Bistable perception",
author = "Lidia Shestopalova and B{\"o}hm, {Tam{\'a}s M.} and Alexandra Bendixen and Andreou, {Andreas G.} and Julius Georgiou and Guillaume Garreau and Botond Hajdu and Denham, {Susan L.} and I. Winkler",
year = "2014",
doi = "10.3389/fnins.2014.00064",
language = "English",
journal = "Frontiers in Neuroscience",
issn = "1662-4548",
publisher = "Frontiers Research Foundation",
number = "8 APR",

}

TY - JOUR

T1 - Do audio-visual motion cues promote segregation of auditory streams?

AU - Shestopalova, Lidia

AU - Böhm, Tamás M.

AU - Bendixen, Alexandra

AU - Andreou, Andreas G.

AU - Georgiou, Julius

AU - Garreau, Guillaume

AU - Hajdu, Botond

AU - Denham, Susan L.

AU - Winkler, I.

PY - 2014

Y1 - 2014

N2 - An audio-visual experiment using moving sound sources was designed to investigate whether the analysis of auditory scenes is modulated by synchronous presentation of visual information. Listeners were presented with an alternating sequence of two pure tones delivered by two separate sound sources. In different conditions, the two sound sources were either stationary or moving on random trajectories around the listener. Both the sounds and the movement trajectories were derived from recordings in which two humans were moving with loudspeakers attached to their heads. Visualized movement trajectories modeled by a computer animation were presented together with the sounds. In the main experiment, behavioral reports on sound organization were collected from young healthy volunteers. The proportion and stability of the different sound organizations were compared between the conditions in which the visualized trajectories matched the movement of the sound sources and when the two were independent of each other. The results corroborate earlier findings that separation of sound sources in space promotes segregation. However, no additional effect of auditory movement per se on the perceptual organization of sounds was obtained. Surprisingly, the presentation of movement-congruent visual cues did not strengthen the effects of spatial separation on segregating auditory streams. Our findings are consistent with the view that bistability in the auditory modality can occur independently from other modalities.

AB - An audio-visual experiment using moving sound sources was designed to investigate whether the analysis of auditory scenes is modulated by synchronous presentation of visual information. Listeners were presented with an alternating sequence of two pure tones delivered by two separate sound sources. In different conditions, the two sound sources were either stationary or moving on random trajectories around the listener. Both the sounds and the movement trajectories were derived from recordings in which two humans were moving with loudspeakers attached to their heads. Visualized movement trajectories modeled by a computer animation were presented together with the sounds. In the main experiment, behavioral reports on sound organization were collected from young healthy volunteers. The proportion and stability of the different sound organizations were compared between the conditions in which the visualized trajectories matched the movement of the sound sources and when the two were independent of each other. The results corroborate earlier findings that separation of sound sources in space promotes segregation. However, no additional effect of auditory movement per se on the perceptual organization of sounds was obtained. Surprisingly, the presentation of movement-congruent visual cues did not strengthen the effects of spatial separation on segregating auditory streams. Our findings are consistent with the view that bistability in the auditory modality can occur independently from other modalities.

KW - Audio-visual integration

KW - Auditory motion

KW - Auditory stream segregation

KW - Bistable perception

UR - http://www.scopus.com/inward/record.url?scp=84905049562&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84905049562&partnerID=8YFLogxK

U2 - 10.3389/fnins.2014.00064

DO - 10.3389/fnins.2014.00064

M3 - Article

JO - Frontiers in Neuroscience

JF - Frontiers in Neuroscience

SN - 1662-4548

IS - 8 APR

M1 - Article 64

ER -