Multi-channel spatio-temporal topographic processing for visual search and navigation

István Szatmári, Dávid Bálya, Gergely Tímár, Csaba Rekeczky, Tomás Roska

Research output: Contribution to journalConference article

6 Citations (Scopus)

Abstract

In this paper a biologically motivated image flow processing mechanism is presented for visual exploration systems. The intention of this multi-channel topographic approach was to produce decision maps for salient feature localization and identification. As a unique biological study has recently confirmed, mammalian visual systems process the world through a set of separate parallel channels and these representations are embodied in a stack of strata in the retina. Beyond reflecting the biological motivations, our main goal was to create an efficient algorithmic framework for real-life visual search and navigation experiments. In the course of this design the retinotopic processing scheme is embedded in an analogic Cellular Neural Network (CNN) algorithm where image flow is analyzed by temporal, spatial and spatio-temporal filters. The output of these sub-channels is then combined in a programmable configuration to form the new channel responses. In the core of the algorithm crisp or fuzzy logic strategies define the global channel interaction and result in a unique binary image flow. This processing mechanism of the algorithmic framework and the hardware architecture of the system is presented along with experimental ACE4k CNN chip results for several video flows recorded in flying vehicles.

Original languageEnglish
Pages (from-to)297-306
Number of pages10
JournalProceedings of SPIE - The International Society for Optical Engineering
Volume5119
DOIs
Publication statusPublished - Sep 19 2003
EventBioengineered and Bioinspired Systems - Maspalomas, Gran Canaria, Spain
Duration: May 19 2003May 21 2003

    Fingerprint

Keywords

  • Cellular neural network
  • Optical navigation
  • Spatio-temporal filters
  • Topographic processing
  • Visual terrain exploration

ASJC Scopus subject areas

  • Electronic, Optical and Magnetic Materials
  • Condensed Matter Physics
  • Computer Science Applications
  • Applied Mathematics
  • Electrical and Electronic Engineering

Cite this