Collaborative mobile 3D reconstruction of urban scenes

Attila Tanács, András Majdik, Levente Hajder, József Molnár, Zsolt Sánta, Z. Kato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

2 Citations (Scopus)

Abstract

Reconstruction of the surrounding 3D world is of particular interest either for mapping, civil applications or for entertainment. The wide availability of smartphones with cameras and wireless networking capabilities makes collecting 2D images of a particular scene easy. In contrast to the client-server architecture adopted by most mobile services, we propose an architecture where data, computations and results can be shared in a collaborative manner among the participating devices without centralization. Camera calibration and pose estimation parameters are determined using classical image-based methods. The reconstruction is based on interactively selected arbitrary planar regions which is especially suitable for objects having large (near) planar surfaces often found in urban scenes (e.g. building facades, windows, etc). The perspective distortion of a planar region in two views makes it possible to compute the normal and distance of the region w.r.t the world coordinate system. Thus a fairly precise 3D model can be built by reconstructing a set of planar regions with different orientation. We also show how visualization, data sharing and communication can be solved. The applicability of the method is demonstrated on reconstructing real urban scenes.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages486-501
Number of pages16
Volume9010
ISBN (Print)9783319166339
DOIs
Publication statusPublished - 2015
Event12th Asian Conference on Computer Vision, ACCV 2014 - Singapore, Singapore
Duration: Nov 1 2014Nov 2 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume9010
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other12th Asian Conference on Computer Vision, ACCV 2014
CountrySingapore
CitySingapore
Period11/1/1411/2/14

Fingerprint

3D Reconstruction
Cameras
Data visualization
Facades
Smartphones
Parameter estimation
Servers
Availability
Calibration
Camera Calibration
Mobile Services
Data Sharing
Pose Estimation
Data Communication
Client/server
Communication
Networking
3D Model
Visualization
Camera

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Tanács, A., Majdik, A., Hajder, L., Molnár, J., Sánta, Z., & Kato, Z. (2015). Collaborative mobile 3D reconstruction of urban scenes. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 9010, pp. 486-501). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9010). Springer Verlag. https://doi.org/10.1007/978-3-319-16634-6_36

Collaborative mobile 3D reconstruction of urban scenes. / Tanács, Attila; Majdik, András; Hajder, Levente; Molnár, József; Sánta, Zsolt; Kato, Z.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9010 Springer Verlag, 2015. p. 486-501 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 9010).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Tanács, A, Majdik, A, Hajder, L, Molnár, J, Sánta, Z & Kato, Z 2015, Collaborative mobile 3D reconstruction of urban scenes. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 9010, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 9010, Springer Verlag, pp. 486-501, 12th Asian Conference on Computer Vision, ACCV 2014, Singapore, Singapore, 11/1/14. https://doi.org/10.1007/978-3-319-16634-6_36
Tanács A, Majdik A, Hajder L, Molnár J, Sánta Z, Kato Z. Collaborative mobile 3D reconstruction of urban scenes. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9010. Springer Verlag. 2015. p. 486-501. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-16634-6_36
Tanács, Attila ; Majdik, András ; Hajder, Levente ; Molnár, József ; Sánta, Zsolt ; Kato, Z. / Collaborative mobile 3D reconstruction of urban scenes. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 9010 Springer Verlag, 2015. pp. 486-501 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{69f44eb29a774b168c5b13a14b3cc555,
title = "Collaborative mobile 3D reconstruction of urban scenes",
abstract = "Reconstruction of the surrounding 3D world is of particular interest either for mapping, civil applications or for entertainment. The wide availability of smartphones with cameras and wireless networking capabilities makes collecting 2D images of a particular scene easy. In contrast to the client-server architecture adopted by most mobile services, we propose an architecture where data, computations and results can be shared in a collaborative manner among the participating devices without centralization. Camera calibration and pose estimation parameters are determined using classical image-based methods. The reconstruction is based on interactively selected arbitrary planar regions which is especially suitable for objects having large (near) planar surfaces often found in urban scenes (e.g. building facades, windows, etc). The perspective distortion of a planar region in two views makes it possible to compute the normal and distance of the region w.r.t the world coordinate system. Thus a fairly precise 3D model can be built by reconstructing a set of planar regions with different orientation. We also show how visualization, data sharing and communication can be solved. The applicability of the method is demonstrated on reconstructing real urban scenes.",
author = "Attila Tan{\'a}cs and Andr{\'a}s Majdik and Levente Hajder and J{\'o}zsef Moln{\'a}r and Zsolt S{\'a}nta and Z. Kato",
year = "2015",
doi = "10.1007/978-3-319-16634-6_36",
language = "English",
isbn = "9783319166339",
volume = "9010",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "486--501",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Collaborative mobile 3D reconstruction of urban scenes

AU - Tanács, Attila

AU - Majdik, András

AU - Hajder, Levente

AU - Molnár, József

AU - Sánta, Zsolt

AU - Kato, Z.

PY - 2015

Y1 - 2015

N2 - Reconstruction of the surrounding 3D world is of particular interest either for mapping, civil applications or for entertainment. The wide availability of smartphones with cameras and wireless networking capabilities makes collecting 2D images of a particular scene easy. In contrast to the client-server architecture adopted by most mobile services, we propose an architecture where data, computations and results can be shared in a collaborative manner among the participating devices without centralization. Camera calibration and pose estimation parameters are determined using classical image-based methods. The reconstruction is based on interactively selected arbitrary planar regions which is especially suitable for objects having large (near) planar surfaces often found in urban scenes (e.g. building facades, windows, etc). The perspective distortion of a planar region in two views makes it possible to compute the normal and distance of the region w.r.t the world coordinate system. Thus a fairly precise 3D model can be built by reconstructing a set of planar regions with different orientation. We also show how visualization, data sharing and communication can be solved. The applicability of the method is demonstrated on reconstructing real urban scenes.

AB - Reconstruction of the surrounding 3D world is of particular interest either for mapping, civil applications or for entertainment. The wide availability of smartphones with cameras and wireless networking capabilities makes collecting 2D images of a particular scene easy. In contrast to the client-server architecture adopted by most mobile services, we propose an architecture where data, computations and results can be shared in a collaborative manner among the participating devices without centralization. Camera calibration and pose estimation parameters are determined using classical image-based methods. The reconstruction is based on interactively selected arbitrary planar regions which is especially suitable for objects having large (near) planar surfaces often found in urban scenes (e.g. building facades, windows, etc). The perspective distortion of a planar region in two views makes it possible to compute the normal and distance of the region w.r.t the world coordinate system. Thus a fairly precise 3D model can be built by reconstructing a set of planar regions with different orientation. We also show how visualization, data sharing and communication can be solved. The applicability of the method is demonstrated on reconstructing real urban scenes.

UR - http://www.scopus.com/inward/record.url?scp=84942543630&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84942543630&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-16634-6_36

DO - 10.1007/978-3-319-16634-6_36

M3 - Conference contribution

SN - 9783319166339

VL - 9010

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 486

EP - 501

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

ER -