Establishing correspondences between planar image patches

Attila Tanács, András Majdik, József Molnár, Atul Rai, Zoltan Kato

Research output: Chapter in Book/Report/Conference proceedingConference contribution

6 Citations (Scopus)

Abstract

Finding correspondences between image pairs is a fundamental task in computer vision. Herein, we focus on establishing matches between images of urban scenes which are typically composed of planar surface patches with highly repetitive structures. The latter property makes traditional point-based methods unreliable. The basic idea of our approach is to formulate the correspondence problem in terms of homography estimation between planar image regions: given a planar region in one image, we are simultaneously looking for its corresponding segmentation in the other image and the planar homography acting between the two regions. We will show, that due to the overlapping views the general 8 degree of freedom (DOF) of the homography mapping can be geometrically constrained to 3 DOF and the resulting segmentation/registration problem can be efficiently solved by finding the region's occurrence in the second image using pyramid representation and normalized mutual information as the intensity similarity measure. The method has been validated on a large database of building images taken by different mobile cameras and quantitative evaluation confirms robustness against intensity variations, occlusions or the presence of non-planar parts. We also show examples of 3D planar surface reconstruction as well as 2D mosaicking.

Original languageEnglish
Title of host publication2014 International Conference on Digital Image Computing
Subtitle of host publicationTechniques and Applications, DICTA 2014
EditorsAbdesselam Bouzerdoum, Lei Wang, Philip Ogunbona, Wanqing Li, Son Lam Phung
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781479954094
DOIs
Publication statusPublished - Jan 12 2015
Event2014 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2014 - Wollongong, Australia
Duration: Nov 25 2014Nov 27 2014

Publication series

Name2014 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2014

Other

Other2014 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2014
CountryAustralia
CityWollongong
Period11/25/1411/27/14

    Fingerprint

Keywords

  • Image correspondences
  • homography estimation
  • planar surface
  • registration

ASJC Scopus subject areas

  • Computer Graphics and Computer-Aided Design
  • Computer Science Applications

Cite this

Tanács, A., Majdik, A., Molnár, J., Rai, A., & Kato, Z. (2015). Establishing correspondences between planar image patches. In A. Bouzerdoum, L. Wang, P. Ogunbona, W. Li, & S. L. Phung (Eds.), 2014 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2014 [7008107] (2014 International Conference on Digital Image Computing: Techniques and Applications, DICTA 2014). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/DICTA.2014.7008107