A multimodal-corpus data collection system for cognitive acoustic scene analysis

Julius Georgiou, Philippe Pouliquen, Andrew Cassidy, Guillaume Garreau, Charalambos Andreou, Guillermo Stuarts, Cyrille D'Urbal, Andreas G. Andreou, Susan Denham, Thomas Wennekers, Robert Mill, István Winkler, Tamás Bohm, Orsolya Szalárdy, Georg M. Klump, Simon Jones, Alexandra Bendixen

Research output: Chapter in Book/Report/Conference proceedingConference contribution

9 Citations (Scopus)

Abstract

We report on the design and the collection of a multi-modal data corpus for cognitive acoustic scene analysis. Sounds are generated by stationary and moving sources (people), that is by omni-directional speakers mounted on people's heads. One or two subjects walk along predetermined systematic and random paths, in synchrony and out of sync. Sound is captured in multiple microphone systems, including a four MEMS microphone directional array, two electret microphones situated in the ears of a stuffed gerbil head, and a Head Acoustics, head-shoulder unit with ICP microphones. Three micro-Doppler units operating at different frequencies were employed to capture gait and the articulatory signatures as well as location of the people in the scene. Three ground vibration sensors were recording the footsteps of the walking people. A 3D MESA camera as well as a web-cam provided 2D and 3D visual data for system calibration and ground truth. Data were collected in three environments ranging from a well controlled environment (anechoic chamber), an indoor environment (large classroom) and the natural environment of an outside courtyard. A software tool has been developed for the browsing and visualization of the data.

Original languageEnglish
Title of host publication2011 45th Annual Conference on Information Sciences and Systems, CISS 2011
DOIs
Publication statusPublished - Jun 6 2011
Event2011 45th Annual Conference on Information Sciences and Systems, CISS 2011 - Baltimore, MD, United States
Duration: Mar 23 2011Mar 25 2011

Publication series

Name2011 45th Annual Conference on Information Sciences and Systems, CISS 2011

Other

Other2011 45th Annual Conference on Information Sciences and Systems, CISS 2011
CountryUnited States
CityBaltimore, MD
Period3/23/113/25/11

    Fingerprint

ASJC Scopus subject areas

  • Information Systems

Cite this

Georgiou, J., Pouliquen, P., Cassidy, A., Garreau, G., Andreou, C., Stuarts, G., D'Urbal, C., Andreou, A. G., Denham, S., Wennekers, T., Mill, R., Winkler, I., Bohm, T., Szalárdy, O., Klump, G. M., Jones, S., & Bendixen, A. (2011). A multimodal-corpus data collection system for cognitive acoustic scene analysis. In 2011 45th Annual Conference on Information Sciences and Systems, CISS 2011 [5766101] (2011 45th Annual Conference on Information Sciences and Systems, CISS 2011). https://doi.org/10.1109/CISS.2011.5766101