Filling missing parts of a 3D mesh by fusion of incomplete 3D data

Laszlo Kormoczi, Z. Kato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper deals with the problem of fusing different (potentially partial) 3D meshes to fill in missing parts (holes) of an accurate reference 3D model using a less accurate but more complete moving 3D model. Typically, accurate 3D models can be produced by range devices (Lidar) which is often limited in setting viewpoints, while traditional Structure from Motion methods are using 2D images which are less restricted in viewpoints, but overall produce a less accurate 3D mesh. Combining the advantages of both modalities is an appealing solution to many real world problems. Herein we propose a novel method which detects holes in the accurate reference mesh and then each hole is filled from the less accurate 3D mesh by gradually estimating local affine transformations around the hole’s boundary and propagating it into the inner part. Experimental validation is done on a large real dataset, which confirms the accuracy and reliability of the proposed algorithm.

Original languageEnglish
Title of host publicationAdvanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings
PublisherSpringer Verlag
Pages711-722
Number of pages12
ISBN (Print)9783319703527
DOIs
Publication statusPublished - Jan 1 2017
Event18th International Conference on Advanced Concepts for Intelligent Vision Systems, ACIVS 2017 - Antwerp, Belgium
Duration: Sep 18 2017Sep 21 2017

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume10617 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other18th International Conference on Advanced Concepts for Intelligent Vision Systems, ACIVS 2017
CountryBelgium
CityAntwerp
Period9/18/179/21/17

Fingerprint

Fusion
Fusion reactions
3D Model
Mesh
Optical radar
Structure from Motion
Experimental Validation
Lidar
Reference Model
Modality
Affine transformation
Partial
Range of data

Keywords

  • 3D registration
  • Hole filling
  • Lidar
  • Mesh fusion
  • Photogrammetry

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Cite this

Kormoczi, L., & Kato, Z. (2017). Filling missing parts of a 3D mesh by fusion of incomplete 3D data. In Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings (pp. 711-722). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10617 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-70353-4_60

Filling missing parts of a 3D mesh by fusion of incomplete 3D data. / Kormoczi, Laszlo; Kato, Z.

Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings. Springer Verlag, 2017. p. 711-722 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 10617 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kormoczi, L & Kato, Z 2017, Filling missing parts of a 3D mesh by fusion of incomplete 3D data. in Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 10617 LNCS, Springer Verlag, pp. 711-722, 18th International Conference on Advanced Concepts for Intelligent Vision Systems, ACIVS 2017, Antwerp, Belgium, 9/18/17. https://doi.org/10.1007/978-3-319-70353-4_60
Kormoczi L, Kato Z. Filling missing parts of a 3D mesh by fusion of incomplete 3D data. In Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings. Springer Verlag. 2017. p. 711-722. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-70353-4_60
Kormoczi, Laszlo ; Kato, Z. / Filling missing parts of a 3D mesh by fusion of incomplete 3D data. Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings. Springer Verlag, 2017. pp. 711-722 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{d5a42c53ef544944b94cde1282d0dd95,
title = "Filling missing parts of a 3D mesh by fusion of incomplete 3D data",
abstract = "This paper deals with the problem of fusing different (potentially partial) 3D meshes to fill in missing parts (holes) of an accurate reference 3D model using a less accurate but more complete moving 3D model. Typically, accurate 3D models can be produced by range devices (Lidar) which is often limited in setting viewpoints, while traditional Structure from Motion methods are using 2D images which are less restricted in viewpoints, but overall produce a less accurate 3D mesh. Combining the advantages of both modalities is an appealing solution to many real world problems. Herein we propose a novel method which detects holes in the accurate reference mesh and then each hole is filled from the less accurate 3D mesh by gradually estimating local affine transformations around the hole’s boundary and propagating it into the inner part. Experimental validation is done on a large real dataset, which confirms the accuracy and reliability of the proposed algorithm.",
keywords = "3D registration, Hole filling, Lidar, Mesh fusion, Photogrammetry",
author = "Laszlo Kormoczi and Z. Kato",
year = "2017",
month = "1",
day = "1",
doi = "10.1007/978-3-319-70353-4_60",
language = "English",
isbn = "9783319703527",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "711--722",
booktitle = "Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings",

}

TY - GEN

T1 - Filling missing parts of a 3D mesh by fusion of incomplete 3D data

AU - Kormoczi, Laszlo

AU - Kato, Z.

PY - 2017/1/1

Y1 - 2017/1/1

N2 - This paper deals with the problem of fusing different (potentially partial) 3D meshes to fill in missing parts (holes) of an accurate reference 3D model using a less accurate but more complete moving 3D model. Typically, accurate 3D models can be produced by range devices (Lidar) which is often limited in setting viewpoints, while traditional Structure from Motion methods are using 2D images which are less restricted in viewpoints, but overall produce a less accurate 3D mesh. Combining the advantages of both modalities is an appealing solution to many real world problems. Herein we propose a novel method which detects holes in the accurate reference mesh and then each hole is filled from the less accurate 3D mesh by gradually estimating local affine transformations around the hole’s boundary and propagating it into the inner part. Experimental validation is done on a large real dataset, which confirms the accuracy and reliability of the proposed algorithm.

AB - This paper deals with the problem of fusing different (potentially partial) 3D meshes to fill in missing parts (holes) of an accurate reference 3D model using a less accurate but more complete moving 3D model. Typically, accurate 3D models can be produced by range devices (Lidar) which is often limited in setting viewpoints, while traditional Structure from Motion methods are using 2D images which are less restricted in viewpoints, but overall produce a less accurate 3D mesh. Combining the advantages of both modalities is an appealing solution to many real world problems. Herein we propose a novel method which detects holes in the accurate reference mesh and then each hole is filled from the less accurate 3D mesh by gradually estimating local affine transformations around the hole’s boundary and propagating it into the inner part. Experimental validation is done on a large real dataset, which confirms the accuracy and reliability of the proposed algorithm.

KW - 3D registration

KW - Hole filling

KW - Lidar

KW - Mesh fusion

KW - Photogrammetry

UR - http://www.scopus.com/inward/record.url?scp=85036637658&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85036637658&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-70353-4_60

DO - 10.1007/978-3-319-70353-4_60

M3 - Conference contribution

AN - SCOPUS:85036637658

SN - 9783319703527

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 711

EP - 722

BT - Advanced Concepts for Intelligent Vision Systems - 18th International Conference, ACIVS 2017, Proceedings

PB - Springer Verlag

ER -