Motion segmentation and tracking with edge relaxation and optimization using fully parallel methods in the Cellular Nonlinear Network architecture

László Czúni, T. Szirányi

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

In this paper we outline a fully parallel and locally connected computation model for the segmentation of motion events in video sequences based on spatial and motion information. Extraction of motion information from video series is very time consuming. Most of the computing effort is devoted to the estimation of motion vector fields, defining objects and determining the exact boundaries of these objects. The split and merge segmentation of different small areas, those obtained by oversegmentation, needs an optimization process. In our proposed algorithm the process starts from an oversegmented image, then the segments are merged by applying the information coming from the spatial and temporal auxiliary data: motion fields and notion history, calculated from consecutive image frames. This grouping process is defined through a similarity measure of neighboring segments, which is based on intensity, speed and the time-depth of motion-history. There is also a feedback for checking the merging process, by this feedback we can accept or refuse the cancellation of a segment-border. Our parallel approach is independent of the number of segments and objects, since instead of graph representation of these components, image features are defined on the pixel level. We use simple VLSI implementable functions like arithmetic and logical operators, local memory transfers and convolution. These elementary instructions are used to build up the basic routines such as motion displacement field detection, disocclusion removal, anisotropic diffusion, grouping by stochastic optimization. This relaxation-based motion segmentation can be a basic step of the effective coding of image series and other automatic motion tracking systems. The proposed system is ready to be implemented in a Cellular Nonlinear Network chip-set architecture.

Original languageEnglish
Pages (from-to)77-95
Number of pages19
JournalReal-Time Imaging
Volume7
Issue number1
Publication statusPublished - Feb 2001

Fingerprint

Nonlinear networks
Network architecture
Feedback
Convolution
Merging
Mathematical operators
Pixels
Data storage equipment

ASJC Scopus subject areas

  • Engineering(all)

Cite this

@article{b61bc9138eb4417baccf01da6a75212b,
title = "Motion segmentation and tracking with edge relaxation and optimization using fully parallel methods in the Cellular Nonlinear Network architecture",
abstract = "In this paper we outline a fully parallel and locally connected computation model for the segmentation of motion events in video sequences based on spatial and motion information. Extraction of motion information from video series is very time consuming. Most of the computing effort is devoted to the estimation of motion vector fields, defining objects and determining the exact boundaries of these objects. The split and merge segmentation of different small areas, those obtained by oversegmentation, needs an optimization process. In our proposed algorithm the process starts from an oversegmented image, then the segments are merged by applying the information coming from the spatial and temporal auxiliary data: motion fields and notion history, calculated from consecutive image frames. This grouping process is defined through a similarity measure of neighboring segments, which is based on intensity, speed and the time-depth of motion-history. There is also a feedback for checking the merging process, by this feedback we can accept or refuse the cancellation of a segment-border. Our parallel approach is independent of the number of segments and objects, since instead of graph representation of these components, image features are defined on the pixel level. We use simple VLSI implementable functions like arithmetic and logical operators, local memory transfers and convolution. These elementary instructions are used to build up the basic routines such as motion displacement field detection, disocclusion removal, anisotropic diffusion, grouping by stochastic optimization. This relaxation-based motion segmentation can be a basic step of the effective coding of image series and other automatic motion tracking systems. The proposed system is ready to be implemented in a Cellular Nonlinear Network chip-set architecture.",
author = "L{\'a}szl{\'o} Cz{\'u}ni and T. Szir{\'a}nyi",
year = "2001",
month = "2",
language = "English",
volume = "7",
pages = "77--95",
journal = "Real-Time Imaging",
issn = "1007-2014",
number = "1",

}

TY - JOUR

T1 - Motion segmentation and tracking with edge relaxation and optimization using fully parallel methods in the Cellular Nonlinear Network architecture

AU - Czúni, László

AU - Szirányi, T.

PY - 2001/2

Y1 - 2001/2

N2 - In this paper we outline a fully parallel and locally connected computation model for the segmentation of motion events in video sequences based on spatial and motion information. Extraction of motion information from video series is very time consuming. Most of the computing effort is devoted to the estimation of motion vector fields, defining objects and determining the exact boundaries of these objects. The split and merge segmentation of different small areas, those obtained by oversegmentation, needs an optimization process. In our proposed algorithm the process starts from an oversegmented image, then the segments are merged by applying the information coming from the spatial and temporal auxiliary data: motion fields and notion history, calculated from consecutive image frames. This grouping process is defined through a similarity measure of neighboring segments, which is based on intensity, speed and the time-depth of motion-history. There is also a feedback for checking the merging process, by this feedback we can accept or refuse the cancellation of a segment-border. Our parallel approach is independent of the number of segments and objects, since instead of graph representation of these components, image features are defined on the pixel level. We use simple VLSI implementable functions like arithmetic and logical operators, local memory transfers and convolution. These elementary instructions are used to build up the basic routines such as motion displacement field detection, disocclusion removal, anisotropic diffusion, grouping by stochastic optimization. This relaxation-based motion segmentation can be a basic step of the effective coding of image series and other automatic motion tracking systems. The proposed system is ready to be implemented in a Cellular Nonlinear Network chip-set architecture.

AB - In this paper we outline a fully parallel and locally connected computation model for the segmentation of motion events in video sequences based on spatial and motion information. Extraction of motion information from video series is very time consuming. Most of the computing effort is devoted to the estimation of motion vector fields, defining objects and determining the exact boundaries of these objects. The split and merge segmentation of different small areas, those obtained by oversegmentation, needs an optimization process. In our proposed algorithm the process starts from an oversegmented image, then the segments are merged by applying the information coming from the spatial and temporal auxiliary data: motion fields and notion history, calculated from consecutive image frames. This grouping process is defined through a similarity measure of neighboring segments, which is based on intensity, speed and the time-depth of motion-history. There is also a feedback for checking the merging process, by this feedback we can accept or refuse the cancellation of a segment-border. Our parallel approach is independent of the number of segments and objects, since instead of graph representation of these components, image features are defined on the pixel level. We use simple VLSI implementable functions like arithmetic and logical operators, local memory transfers and convolution. These elementary instructions are used to build up the basic routines such as motion displacement field detection, disocclusion removal, anisotropic diffusion, grouping by stochastic optimization. This relaxation-based motion segmentation can be a basic step of the effective coding of image series and other automatic motion tracking systems. The proposed system is ready to be implemented in a Cellular Nonlinear Network chip-set architecture.

UR - http://www.scopus.com/inward/record.url?scp=0035251585&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0035251585&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0035251585

VL - 7

SP - 77

EP - 95

JO - Real-Time Imaging

JF - Real-Time Imaging

SN - 1007-2014

IS - 1

ER -