Region based fusion of 3D and 2D visual data for Cultural Heritage objects

Robert Frohlich, Z. Kato, Alain Tremeau, Levente Tamas, Shadi Shabo, Yona Waksman

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

A workflow is proposed for Cultural Heritage applications in which the fusion of 3D and 2D visual data is required. Using data acquired by cheap, standard devices, like a 3D scanner having a low quality 2D camera in it, and a high resolution DSLR camera, one can produce high quality color calibrated 3D model for documenting purpose. The proposed processing workflow combines a novel region based calibration method with an ICP alignment used for refining the results. It works on 3D data, that do not necessarily contain intensity information in them, and 2D images of a calibrated camera. These can be acquired with commercial 3D scanners and color cameras without any special constraint. In contrast with the typical solutions, the proposed method is not using any calibration patterns or markers. The efficiency and robustness of the proposed calibration method has been confirmed on both synthetic and real data.

Original languageEnglish
Title of host publication2016 23rd International Conference on Pattern Recognition, ICPR 2016
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages2404-2409
Number of pages6
ISBN (Electronic)9781509048472
DOIs
Publication statusPublished - Apr 13 2017
Event23rd International Conference on Pattern Recognition, ICPR 2016 - Cancun, Mexico
Duration: Dec 4 2016Dec 8 2016

Other

Other23rd International Conference on Pattern Recognition, ICPR 2016
CountryMexico
CityCancun
Period12/4/1612/8/16

Fingerprint

Fusion reactions
Cameras
Calibration
Color
Refining
Processing

ASJC Scopus subject areas

  • Computer Vision and Pattern Recognition

Cite this

Frohlich, R., Kato, Z., Tremeau, A., Tamas, L., Shabo, S., & Waksman, Y. (2017). Region based fusion of 3D and 2D visual data for Cultural Heritage objects. In 2016 23rd International Conference on Pattern Recognition, ICPR 2016 (pp. 2404-2409). [7899996] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICPR.2016.7899996

Region based fusion of 3D and 2D visual data for Cultural Heritage objects. / Frohlich, Robert; Kato, Z.; Tremeau, Alain; Tamas, Levente; Shabo, Shadi; Waksman, Yona.

2016 23rd International Conference on Pattern Recognition, ICPR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. p. 2404-2409 7899996.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Frohlich, R, Kato, Z, Tremeau, A, Tamas, L, Shabo, S & Waksman, Y 2017, Region based fusion of 3D and 2D visual data for Cultural Heritage objects. in 2016 23rd International Conference on Pattern Recognition, ICPR 2016., 7899996, Institute of Electrical and Electronics Engineers Inc., pp. 2404-2409, 23rd International Conference on Pattern Recognition, ICPR 2016, Cancun, Mexico, 12/4/16. https://doi.org/10.1109/ICPR.2016.7899996
Frohlich R, Kato Z, Tremeau A, Tamas L, Shabo S, Waksman Y. Region based fusion of 3D and 2D visual data for Cultural Heritage objects. In 2016 23rd International Conference on Pattern Recognition, ICPR 2016. Institute of Electrical and Electronics Engineers Inc. 2017. p. 2404-2409. 7899996 https://doi.org/10.1109/ICPR.2016.7899996
Frohlich, Robert ; Kato, Z. ; Tremeau, Alain ; Tamas, Levente ; Shabo, Shadi ; Waksman, Yona. / Region based fusion of 3D and 2D visual data for Cultural Heritage objects. 2016 23rd International Conference on Pattern Recognition, ICPR 2016. Institute of Electrical and Electronics Engineers Inc., 2017. pp. 2404-2409
@inproceedings{50782254dee64e90b36ef7d07be93a5c,
title = "Region based fusion of 3D and 2D visual data for Cultural Heritage objects",
abstract = "A workflow is proposed for Cultural Heritage applications in which the fusion of 3D and 2D visual data is required. Using data acquired by cheap, standard devices, like a 3D scanner having a low quality 2D camera in it, and a high resolution DSLR camera, one can produce high quality color calibrated 3D model for documenting purpose. The proposed processing workflow combines a novel region based calibration method with an ICP alignment used for refining the results. It works on 3D data, that do not necessarily contain intensity information in them, and 2D images of a calibrated camera. These can be acquired with commercial 3D scanners and color cameras without any special constraint. In contrast with the typical solutions, the proposed method is not using any calibration patterns or markers. The efficiency and robustness of the proposed calibration method has been confirmed on both synthetic and real data.",
author = "Robert Frohlich and Z. Kato and Alain Tremeau and Levente Tamas and Shadi Shabo and Yona Waksman",
year = "2017",
month = "4",
day = "13",
doi = "10.1109/ICPR.2016.7899996",
language = "English",
pages = "2404--2409",
booktitle = "2016 23rd International Conference on Pattern Recognition, ICPR 2016",
publisher = "Institute of Electrical and Electronics Engineers Inc.",

}

TY - GEN

T1 - Region based fusion of 3D and 2D visual data for Cultural Heritage objects

AU - Frohlich, Robert

AU - Kato, Z.

AU - Tremeau, Alain

AU - Tamas, Levente

AU - Shabo, Shadi

AU - Waksman, Yona

PY - 2017/4/13

Y1 - 2017/4/13

N2 - A workflow is proposed for Cultural Heritage applications in which the fusion of 3D and 2D visual data is required. Using data acquired by cheap, standard devices, like a 3D scanner having a low quality 2D camera in it, and a high resolution DSLR camera, one can produce high quality color calibrated 3D model for documenting purpose. The proposed processing workflow combines a novel region based calibration method with an ICP alignment used for refining the results. It works on 3D data, that do not necessarily contain intensity information in them, and 2D images of a calibrated camera. These can be acquired with commercial 3D scanners and color cameras without any special constraint. In contrast with the typical solutions, the proposed method is not using any calibration patterns or markers. The efficiency and robustness of the proposed calibration method has been confirmed on both synthetic and real data.

AB - A workflow is proposed for Cultural Heritage applications in which the fusion of 3D and 2D visual data is required. Using data acquired by cheap, standard devices, like a 3D scanner having a low quality 2D camera in it, and a high resolution DSLR camera, one can produce high quality color calibrated 3D model for documenting purpose. The proposed processing workflow combines a novel region based calibration method with an ICP alignment used for refining the results. It works on 3D data, that do not necessarily contain intensity information in them, and 2D images of a calibrated camera. These can be acquired with commercial 3D scanners and color cameras without any special constraint. In contrast with the typical solutions, the proposed method is not using any calibration patterns or markers. The efficiency and robustness of the proposed calibration method has been confirmed on both synthetic and real data.

UR - http://www.scopus.com/inward/record.url?scp=85019153239&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85019153239&partnerID=8YFLogxK

U2 - 10.1109/ICPR.2016.7899996

DO - 10.1109/ICPR.2016.7899996

M3 - Conference contribution

AN - SCOPUS:85019153239

SP - 2404

EP - 2409

BT - 2016 23rd International Conference on Pattern Recognition, ICPR 2016

PB - Institute of Electrical and Electronics Engineers Inc.

ER -