There is no Universal Source Code for an Infinite Source Alphabet

L. Györfi, István Páli

Research output: Contribution to journalArticle

31 Citations (Scopus)

Abstract

We show that a discrete infinite distribution with finite entropy cannot be estimated consistently in information divergence. As a corollary we get that there is no universal source code for an infinite source alphabet over the class of all discrete memoryless sources with finite entropy.

Original languageEnglish
Pages (from-to)267-271
Number of pages5
JournalIEEE Transactions on Information Theory
Volume40
Issue number1
DOIs
Publication statusPublished - Jan 1994

    Fingerprint

Keywords

  • Universal source coding
  • consistency in information divergence
  • discrete infinite alphabet
  • distribution estimation

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Cite this