Bayesian foreground and shadow detection in uncertain frame rate surveillance videos

Csaba Benedek, Tamás Szirányi

Research output: Contribution to journalArticle

90 Citations (Scopus)


In in this paper, we propose a new model regarding foreground and shadow detection in video sequences. The model works without detailed a priori object-shape information, and it is also appropriate for low and unstable frame rate video sources. Contribution is presented in three key issues: 1) we propose a novel adaptive shadow model, and show the improvements versus previous approaches in scenes with difficult lighting and coloring effects; 2) we give a novel description for the foreground based on spatial statistics of the neighboring pixel values, which enhances the detection of background or shadow-colored object parts; 3) we show how microstructure analysis can be used in the proposed framework as additional feature components improving the results. Finally, a Markov random field model is used to enhance the accuracy of the separation. We validate our method on outdoor and indoor sequences including real surveillance videos and well-known benchmark test sets.

Original languageEnglish
Pages (from-to)608-621
Number of pages14
JournalIEEE Transactions on Image Processing
Issue number4
Publication statusPublished - Apr 1 2008



  • Foreground
  • Markov random field (MRF)
  • Shadow
  • Texture

ASJC Scopus subject areas

  • Software
  • Computer Graphics and Computer-Aided Design

Cite this