An integrated 4D vision and visualisation system

Csaba Benedek, Zsolt Jankó, Csaba Horváth, Dömötör Molnár, D. Chetverikov, T. Szirányi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

This paper reports on a pilot system for reconstruction and visualisation of complex spatio-temporal scenes by integrating two different types of data: outdoor 4D data measured by a rotating multi-beam LIDAR sensor, and 4D models of moving actors obtained in a 4D studio. A typical scenario is an outdoor scene with multiple walking pedestrians. The LIDAR monitors the scene from a fixed position and provides a dynamic point cloud. This information is processed to build a 3D model of the environment and detect and track the pedestrians. Each of them is represented by a point cluster and a trajectory. A moving cluster is then substituted by a detailed 4D model created in the studio. The output is a geometrically reconstructed and textured scene with avatars that follow in real time the trajectories of the pedestrians.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages21-30
Number of pages10
Volume7963 LNCS
DOIs
Publication statusPublished - 2013
Event9th International Conference on Computer Vision Systems, ICVS 2013 - St. Petersburg, Russian Federation
Duration: Jul 16 2013Jul 18 2013

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7963 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other9th International Conference on Computer Vision Systems, ICVS 2013
CountryRussian Federation
CitySt. Petersburg
Period7/16/137/18/13

Fingerprint

Visualization
Studios
Trajectory
Avatar
Point Cloud
Trajectories
3D Model
Rotating
Monitor
Sensor
Scenarios
Output
Model
Sensors
Vision
Actors

Keywords

  • 4D reconstruction
  • motion segmentation
  • MRF
  • rotating multi-beam LIDAR

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Benedek, C., Jankó, Z., Horváth, C., Molnár, D., Chetverikov, D., & Szirányi, T. (2013). An integrated 4D vision and visualisation system. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 7963 LNCS, pp. 21-30). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7963 LNCS). https://doi.org/10.1007/978-3-642-39402-7_3

An integrated 4D vision and visualisation system. / Benedek, Csaba; Jankó, Zsolt; Horváth, Csaba; Molnár, Dömötör; Chetverikov, D.; Szirányi, T.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7963 LNCS 2013. p. 21-30 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 7963 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Benedek, C, Jankó, Z, Horváth, C, Molnár, D, Chetverikov, D & Szirányi, T 2013, An integrated 4D vision and visualisation system. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 7963 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 7963 LNCS, pp. 21-30, 9th International Conference on Computer Vision Systems, ICVS 2013, St. Petersburg, Russian Federation, 7/16/13. https://doi.org/10.1007/978-3-642-39402-7_3
Benedek C, Jankó Z, Horváth C, Molnár D, Chetverikov D, Szirányi T. An integrated 4D vision and visualisation system. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7963 LNCS. 2013. p. 21-30. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-39402-7_3
Benedek, Csaba ; Jankó, Zsolt ; Horváth, Csaba ; Molnár, Dömötör ; Chetverikov, D. ; Szirányi, T. / An integrated 4D vision and visualisation system. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 7963 LNCS 2013. pp. 21-30 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{dca151db62f14ccf9fa526dbae8d7546,
title = "An integrated 4D vision and visualisation system",
abstract = "This paper reports on a pilot system for reconstruction and visualisation of complex spatio-temporal scenes by integrating two different types of data: outdoor 4D data measured by a rotating multi-beam LIDAR sensor, and 4D models of moving actors obtained in a 4D studio. A typical scenario is an outdoor scene with multiple walking pedestrians. The LIDAR monitors the scene from a fixed position and provides a dynamic point cloud. This information is processed to build a 3D model of the environment and detect and track the pedestrians. Each of them is represented by a point cluster and a trajectory. A moving cluster is then substituted by a detailed 4D model created in the studio. The output is a geometrically reconstructed and textured scene with avatars that follow in real time the trajectories of the pedestrians.",
keywords = "4D reconstruction, motion segmentation, MRF, rotating multi-beam LIDAR",
author = "Csaba Benedek and Zsolt Jank{\'o} and Csaba Horv{\'a}th and D{\"o}m{\"o}t{\"o}r Moln{\'a}r and D. Chetverikov and T. Szir{\'a}nyi",
year = "2013",
doi = "10.1007/978-3-642-39402-7_3",
language = "English",
isbn = "9783642394010",
volume = "7963 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "21--30",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - An integrated 4D vision and visualisation system

AU - Benedek, Csaba

AU - Jankó, Zsolt

AU - Horváth, Csaba

AU - Molnár, Dömötör

AU - Chetverikov, D.

AU - Szirányi, T.

PY - 2013

Y1 - 2013

N2 - This paper reports on a pilot system for reconstruction and visualisation of complex spatio-temporal scenes by integrating two different types of data: outdoor 4D data measured by a rotating multi-beam LIDAR sensor, and 4D models of moving actors obtained in a 4D studio. A typical scenario is an outdoor scene with multiple walking pedestrians. The LIDAR monitors the scene from a fixed position and provides a dynamic point cloud. This information is processed to build a 3D model of the environment and detect and track the pedestrians. Each of them is represented by a point cluster and a trajectory. A moving cluster is then substituted by a detailed 4D model created in the studio. The output is a geometrically reconstructed and textured scene with avatars that follow in real time the trajectories of the pedestrians.

AB - This paper reports on a pilot system for reconstruction and visualisation of complex spatio-temporal scenes by integrating two different types of data: outdoor 4D data measured by a rotating multi-beam LIDAR sensor, and 4D models of moving actors obtained in a 4D studio. A typical scenario is an outdoor scene with multiple walking pedestrians. The LIDAR monitors the scene from a fixed position and provides a dynamic point cloud. This information is processed to build a 3D model of the environment and detect and track the pedestrians. Each of them is represented by a point cluster and a trajectory. A moving cluster is then substituted by a detailed 4D model created in the studio. The output is a geometrically reconstructed and textured scene with avatars that follow in real time the trajectories of the pedestrians.

KW - 4D reconstruction

KW - motion segmentation

KW - MRF

KW - rotating multi-beam LIDAR

UR - http://www.scopus.com/inward/record.url?scp=84881235729&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84881235729&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-39402-7_3

DO - 10.1007/978-3-642-39402-7_3

M3 - Conference contribution

AN - SCOPUS:84881235729

SN - 9783642394010

VL - 7963 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 21

EP - 30

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -