Nonparametric entropy estimation based on randomly censored data

A. Carbonez, L. Györfi, E. C. van der Meulen

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

The Shannon entropy of a random variable X with density function f(x) is defined as H(f) = - ∫ f(x)log f(x) dx. Based on randomly censored observations a nonparametric estimator for H(f) is proposed if H(f) is finite and is nonnegative. This entropy estimator is histogram-based in the sense that it involves a histogram-based density estimator fn constructed from the censored data. We prove the a. s. consistency of this estimator.

Original languageEnglish
Pages (from-to)441-451
Number of pages11
JournalProblems of control and information theory
Volume20
Issue number6
Publication statusPublished - 1991

Fingerprint

Entropy
Random variables
Probability density function

ASJC Scopus subject areas

  • Engineering(all)

Cite this

Nonparametric entropy estimation based on randomly censored data. / Carbonez, A.; Györfi, L.; van der Meulen, E. C.

In: Problems of control and information theory, Vol. 20, No. 6, 1991, p. 441-451.

Research output: Contribution to journalArticle

Carbonez, A. ; Györfi, L. ; van der Meulen, E. C. / Nonparametric entropy estimation based on randomly censored data. In: Problems of control and information theory. 1991 ; Vol. 20, No. 6. pp. 441-451.
@article{64b1858bf0364e77859d120c3daa2681,
title = "Nonparametric entropy estimation based on randomly censored data",
abstract = "The Shannon entropy of a random variable X with density function f(x) is defined as H(f) = - ∫ f(x)log f(x) dx. Based on randomly censored observations a nonparametric estimator for H(f) is proposed if H(f) is finite and is nonnegative. This entropy estimator is histogram-based in the sense that it involves a histogram-based density estimator fn constructed from the censored data. We prove the a. s. consistency of this estimator.",
author = "A. Carbonez and L. Gy{\"o}rfi and {van der Meulen}, {E. C.}",
year = "1991",
language = "English",
volume = "20",
pages = "441--451",
journal = "Problems of control and information theory",
issn = "0370-2529",
number = "6",

}

TY - JOUR

T1 - Nonparametric entropy estimation based on randomly censored data

AU - Carbonez, A.

AU - Györfi, L.

AU - van der Meulen, E. C.

PY - 1991

Y1 - 1991

N2 - The Shannon entropy of a random variable X with density function f(x) is defined as H(f) = - ∫ f(x)log f(x) dx. Based on randomly censored observations a nonparametric estimator for H(f) is proposed if H(f) is finite and is nonnegative. This entropy estimator is histogram-based in the sense that it involves a histogram-based density estimator fn constructed from the censored data. We prove the a. s. consistency of this estimator.

AB - The Shannon entropy of a random variable X with density function f(x) is defined as H(f) = - ∫ f(x)log f(x) dx. Based on randomly censored observations a nonparametric estimator for H(f) is proposed if H(f) is finite and is nonnegative. This entropy estimator is histogram-based in the sense that it involves a histogram-based density estimator fn constructed from the censored data. We prove the a. s. consistency of this estimator.

UR - http://www.scopus.com/inward/record.url?scp=0026289394&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=0026289394&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:0026289394

VL - 20

SP - 441

EP - 451

JO - Problems of control and information theory

JF - Problems of control and information theory

SN - 0370-2529

IS - 6

ER -