Motion compensated color video classification using markov random fields

Z. Kato, Ting Chuen Pong, John Chung Mong Lee

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

This paper deals with the classification of color video sequences using Markov Random Fields (MRF) taking into account motion information. The theoretical framework relies on Bayesian estimation associated with MRF modelization and combinatorial optimization (Simulated Annealing). In the MRF model, we use the CIE-luv color metric because it is close to human perception when computing color differences. In addition, intensity and chroma information is separated in this space. The sequence is regarded as a stack of frames and both intra- and inter-frame cliques are defined in the label field. Without motion compensation, an inter-frame clique would contain the corresponding pixel in the previous and next frame. In the motion compensated model, we add a displacement field and it is taken into account in inter-frame interactions. The displacement field is also a MRF but there are no inter-frame cliques. The Maximum A Posteriori (MAP) estimate of the label and displacement field is obtained through Simulated Annealing. Parameter estimation is also considered in the paper and results are shown on color video sequences using both the simple and motion compensated models.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
PublisherSpringer Verlag
Pages738-745
Number of pages8
Volume1351
ISBN (Print)3540639306, 9783540639305
DOIs
Publication statusPublished - 1997
Event3rd Asian Conference on Computer Vision, ACCV 1998 - Hong Kong, China
Duration: Jan 8 1998Jan 10 1998

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume1351
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other3rd Asian Conference on Computer Vision, ACCV 1998
CountryChina
CityHong Kong
Period1/8/981/10/98

Fingerprint

Random Field
Color
Motion
Simulated annealing
Labels
Clique
Motion compensation
Simulated Annealing
Combinatorial optimization
Parameter estimation
Pixels
A Posteriori Estimates
Motion Compensation
Human Perception
Maximum a Posteriori
Bayesian Estimation
Combinatorial Optimization
Parameter Estimation
Pixel
Model

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Kato, Z., Pong, T. C., & Lee, J. C. M. (1997). Motion compensated color video classification using markov random fields. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 1351, pp. 738-745). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1351). Springer Verlag. https://doi.org/10.1007/3-540-63930-6_189

Motion compensated color video classification using markov random fields. / Kato, Z.; Pong, Ting Chuen; Lee, John Chung Mong.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 1351 Springer Verlag, 1997. p. 738-745 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 1351).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Kato, Z, Pong, TC & Lee, JCM 1997, Motion compensated color video classification using markov random fields. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 1351, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 1351, Springer Verlag, pp. 738-745, 3rd Asian Conference on Computer Vision, ACCV 1998, Hong Kong, China, 1/8/98. https://doi.org/10.1007/3-540-63930-6_189
Kato Z, Pong TC, Lee JCM. Motion compensated color video classification using markov random fields. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 1351. Springer Verlag. 1997. p. 738-745. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/3-540-63930-6_189
Kato, Z. ; Pong, Ting Chuen ; Lee, John Chung Mong. / Motion compensated color video classification using markov random fields. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 1351 Springer Verlag, 1997. pp. 738-745 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{cc1e0645a82c4c19aada4ada4909d30b,
title = "Motion compensated color video classification using markov random fields",
abstract = "This paper deals with the classification of color video sequences using Markov Random Fields (MRF) taking into account motion information. The theoretical framework relies on Bayesian estimation associated with MRF modelization and combinatorial optimization (Simulated Annealing). In the MRF model, we use the CIE-luv color metric because it is close to human perception when computing color differences. In addition, intensity and chroma information is separated in this space. The sequence is regarded as a stack of frames and both intra- and inter-frame cliques are defined in the label field. Without motion compensation, an inter-frame clique would contain the corresponding pixel in the previous and next frame. In the motion compensated model, we add a displacement field and it is taken into account in inter-frame interactions. The displacement field is also a MRF but there are no inter-frame cliques. The Maximum A Posteriori (MAP) estimate of the label and displacement field is obtained through Simulated Annealing. Parameter estimation is also considered in the paper and results are shown on color video sequences using both the simple and motion compensated models.",
author = "Z. Kato and Pong, {Ting Chuen} and Lee, {John Chung Mong}",
year = "1997",
doi = "10.1007/3-540-63930-6_189",
language = "English",
isbn = "3540639306",
volume = "1351",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
publisher = "Springer Verlag",
pages = "738--745",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Motion compensated color video classification using markov random fields

AU - Kato, Z.

AU - Pong, Ting Chuen

AU - Lee, John Chung Mong

PY - 1997

Y1 - 1997

N2 - This paper deals with the classification of color video sequences using Markov Random Fields (MRF) taking into account motion information. The theoretical framework relies on Bayesian estimation associated with MRF modelization and combinatorial optimization (Simulated Annealing). In the MRF model, we use the CIE-luv color metric because it is close to human perception when computing color differences. In addition, intensity and chroma information is separated in this space. The sequence is regarded as a stack of frames and both intra- and inter-frame cliques are defined in the label field. Without motion compensation, an inter-frame clique would contain the corresponding pixel in the previous and next frame. In the motion compensated model, we add a displacement field and it is taken into account in inter-frame interactions. The displacement field is also a MRF but there are no inter-frame cliques. The Maximum A Posteriori (MAP) estimate of the label and displacement field is obtained through Simulated Annealing. Parameter estimation is also considered in the paper and results are shown on color video sequences using both the simple and motion compensated models.

AB - This paper deals with the classification of color video sequences using Markov Random Fields (MRF) taking into account motion information. The theoretical framework relies on Bayesian estimation associated with MRF modelization and combinatorial optimization (Simulated Annealing). In the MRF model, we use the CIE-luv color metric because it is close to human perception when computing color differences. In addition, intensity and chroma information is separated in this space. The sequence is regarded as a stack of frames and both intra- and inter-frame cliques are defined in the label field. Without motion compensation, an inter-frame clique would contain the corresponding pixel in the previous and next frame. In the motion compensated model, we add a displacement field and it is taken into account in inter-frame interactions. The displacement field is also a MRF but there are no inter-frame cliques. The Maximum A Posteriori (MAP) estimate of the label and displacement field is obtained through Simulated Annealing. Parameter estimation is also considered in the paper and results are shown on color video sequences using both the simple and motion compensated models.

UR - http://www.scopus.com/inward/record.url?scp=84957403378&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84957403378&partnerID=8YFLogxK

U2 - 10.1007/3-540-63930-6_189

DO - 10.1007/3-540-63930-6_189

M3 - Conference contribution

AN - SCOPUS:84957403378

SN - 3540639306

SN - 9783540639305

VL - 1351

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 738

EP - 745

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

PB - Springer Verlag

ER -