Calibrationless sensor fusion using linear optimization for depth matching

László Havasi, Attila Kiss, László Spórás, Tamás Szirányi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently the observation of surveillanced areas scanned by multi-camera systems is getting more and more popular. The newly developed sensors give new opportunities for exploiting novel features. Using the information gained from a conventional camera we have data about the colours, the shape of objects and the micro-structures; and we have additional information while using thermal camera in the darkness. A camera with depth sensor can find the motion and the position of an object in space even in the case when conventional cameras are unusable. How can we register the corresponding elements on different pictures? There are numerous approaches to the solution of this problem. One of the most used solutions is that the registration is based on the motion. In this method it is not necessary to look for the main features on the pictures to register the related objects, since the features would be different because of the different properties of the cameras. It is easier and faster if the registration is based on the motion. But other problems will arise in this case: shadows or shiny specular surfaces cause problems at the motion. This paper is about how we can register the corresponding elements in a multi-camera system, and how we can find a homography between the image planes in real time, so that we can register a moving object in the images of different cameras based on the depth information.

Original languageEnglish
Title of host publicationCombinatorial Image Analysis - 16th International Workshop, IWCIA 2014, Proceedings
PublisherSpringer Verlag
Pages158-170
Number of pages13
ISBN (Print)9783319071473
DOIs
Publication statusPublished - Jan 1 2014
Event16th International Workshop on Combinatorial Image Analysis, IWCIA 2014 - Brno, Czech Republic
Duration: May 28 2014May 30 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8466 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other16th International Workshop on Combinatorial Image Analysis, IWCIA 2014
CountryCzech Republic
CityBrno
Period5/28/145/30/14

Keywords

  • Homography
  • Image matching
  • Motion detection
  • Multi-camera system

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Calibrationless sensor fusion using linear optimization for depth matching'. Together they form a unique fingerprint.

  • Cite this

    Havasi, L., Kiss, A., Spórás, L., & Szirányi, T. (2014). Calibrationless sensor fusion using linear optimization for depth matching. In Combinatorial Image Analysis - 16th International Workshop, IWCIA 2014, Proceedings (pp. 158-170). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8466 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-07148-0_15