Calibrationless sensor fusion using linear optimization for depth matching

László Havasi, Attila Kiss, László Spórás, T. Szirányi

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Recently the observation of surveillanced areas scanned by multi-camera systems is getting more and more popular. The newly developed sensors give new opportunities for exploiting novel features. Using the information gained from a conventional camera we have data about the colours, the shape of objects and the micro-structures; and we have additional information while using thermal camera in the darkness. A camera with depth sensor can find the motion and the position of an object in space even in the case when conventional cameras are unusable. How can we register the corresponding elements on different pictures? There are numerous approaches to the solution of this problem. One of the most used solutions is that the registration is based on the motion. In this method it is not necessary to look for the main features on the pictures to register the related objects, since the features would be different because of the different properties of the cameras. It is easier and faster if the registration is based on the motion. But other problems will arise in this case: shadows or shiny specular surfaces cause problems at the motion. This paper is about how we can register the corresponding elements in a multi-camera system, and how we can find a homography between the image planes in real time, so that we can register a moving object in the images of different cameras based on the depth information.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages158-170
Number of pages13
Volume8466 LNCS
ISBN (Print)9783319071473
DOIs
Publication statusPublished - 2014
Event16th International Workshop on Combinatorial Image Analysis, IWCIA 2014 - Brno, Czech Republic
Duration: May 28 2014May 30 2014

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume8466 LNCS
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other16th International Workshop on Combinatorial Image Analysis, IWCIA 2014
CountryCzech Republic
CityBrno
Period5/28/145/30/14

Fingerprint

Sensor Fusion
Linear Optimization
Fusion reactions
Camera
Cameras
Sensors
Motion
Registration
Homography
Sensor
Moving Objects
Microstructure
Color
Necessary

Keywords

  • Homography
  • Image matching
  • Motion detection
  • Multi-camera system

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Havasi, L., Kiss, A., Spórás, L., & Szirányi, T. (2014). Calibrationless sensor fusion using linear optimization for depth matching. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 8466 LNCS, pp. 158-170). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8466 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-319-07148-0_15

Calibrationless sensor fusion using linear optimization for depth matching. / Havasi, László; Kiss, Attila; Spórás, László; Szirányi, T.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8466 LNCS Springer Verlag, 2014. p. 158-170 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 8466 LNCS).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Havasi, L, Kiss, A, Spórás, L & Szirányi, T 2014, Calibrationless sensor fusion using linear optimization for depth matching. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 8466 LNCS, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 8466 LNCS, Springer Verlag, pp. 158-170, 16th International Workshop on Combinatorial Image Analysis, IWCIA 2014, Brno, Czech Republic, 5/28/14. https://doi.org/10.1007/978-3-319-07148-0_15
Havasi L, Kiss A, Spórás L, Szirányi T. Calibrationless sensor fusion using linear optimization for depth matching. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8466 LNCS. Springer Verlag. 2014. p. 158-170. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-319-07148-0_15
Havasi, László ; Kiss, Attila ; Spórás, László ; Szirányi, T. / Calibrationless sensor fusion using linear optimization for depth matching. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 8466 LNCS Springer Verlag, 2014. pp. 158-170 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{3c20cb7d47344fd0b62e530056da08cb,
title = "Calibrationless sensor fusion using linear optimization for depth matching",
abstract = "Recently the observation of surveillanced areas scanned by multi-camera systems is getting more and more popular. The newly developed sensors give new opportunities for exploiting novel features. Using the information gained from a conventional camera we have data about the colours, the shape of objects and the micro-structures; and we have additional information while using thermal camera in the darkness. A camera with depth sensor can find the motion and the position of an object in space even in the case when conventional cameras are unusable. How can we register the corresponding elements on different pictures? There are numerous approaches to the solution of this problem. One of the most used solutions is that the registration is based on the motion. In this method it is not necessary to look for the main features on the pictures to register the related objects, since the features would be different because of the different properties of the cameras. It is easier and faster if the registration is based on the motion. But other problems will arise in this case: shadows or shiny specular surfaces cause problems at the motion. This paper is about how we can register the corresponding elements in a multi-camera system, and how we can find a homography between the image planes in real time, so that we can register a moving object in the images of different cameras based on the depth information.",
keywords = "Homography, Image matching, Motion detection, Multi-camera system",
author = "L{\'a}szl{\'o} Havasi and Attila Kiss and L{\'a}szl{\'o} Sp{\'o}r{\'a}s and T. Szir{\'a}nyi",
year = "2014",
doi = "10.1007/978-3-319-07148-0_15",
language = "English",
isbn = "9783319071473",
volume = "8466 LNCS",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "158--170",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Calibrationless sensor fusion using linear optimization for depth matching

AU - Havasi, László

AU - Kiss, Attila

AU - Spórás, László

AU - Szirányi, T.

PY - 2014

Y1 - 2014

N2 - Recently the observation of surveillanced areas scanned by multi-camera systems is getting more and more popular. The newly developed sensors give new opportunities for exploiting novel features. Using the information gained from a conventional camera we have data about the colours, the shape of objects and the micro-structures; and we have additional information while using thermal camera in the darkness. A camera with depth sensor can find the motion and the position of an object in space even in the case when conventional cameras are unusable. How can we register the corresponding elements on different pictures? There are numerous approaches to the solution of this problem. One of the most used solutions is that the registration is based on the motion. In this method it is not necessary to look for the main features on the pictures to register the related objects, since the features would be different because of the different properties of the cameras. It is easier and faster if the registration is based on the motion. But other problems will arise in this case: shadows or shiny specular surfaces cause problems at the motion. This paper is about how we can register the corresponding elements in a multi-camera system, and how we can find a homography between the image planes in real time, so that we can register a moving object in the images of different cameras based on the depth information.

AB - Recently the observation of surveillanced areas scanned by multi-camera systems is getting more and more popular. The newly developed sensors give new opportunities for exploiting novel features. Using the information gained from a conventional camera we have data about the colours, the shape of objects and the micro-structures; and we have additional information while using thermal camera in the darkness. A camera with depth sensor can find the motion and the position of an object in space even in the case when conventional cameras are unusable. How can we register the corresponding elements on different pictures? There are numerous approaches to the solution of this problem. One of the most used solutions is that the registration is based on the motion. In this method it is not necessary to look for the main features on the pictures to register the related objects, since the features would be different because of the different properties of the cameras. It is easier and faster if the registration is based on the motion. But other problems will arise in this case: shadows or shiny specular surfaces cause problems at the motion. This paper is about how we can register the corresponding elements in a multi-camera system, and how we can find a homography between the image planes in real time, so that we can register a moving object in the images of different cameras based on the depth information.

KW - Homography

KW - Image matching

KW - Motion detection

KW - Multi-camera system

UR - http://www.scopus.com/inward/record.url?scp=84901659053&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84901659053&partnerID=8YFLogxK

U2 - 10.1007/978-3-319-07148-0_15

DO - 10.1007/978-3-319-07148-0_15

M3 - Conference contribution

AN - SCOPUS:84901659053

SN - 9783319071473

VL - 8466 LNCS

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 158

EP - 170

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

ER -