There is no Universal Source Code for an Infinite Source Alphabet

L. Györfi, István Páli

Research output: Contribution to journalArticle

31 Citations (Scopus)


We show that a discrete infinite distribution with finite entropy cannot be estimated consistently in information divergence. As a corollary we get that there is no universal source code for an infinite source alphabet over the class of all discrete memoryless sources with finite entropy.

Original languageEnglish
Pages (from-to)267-271
Number of pages5
JournalIEEE Transactions on Information Theory
Issue number1
Publication statusPublished - Jan 1994



  • Universal source coding
  • consistency in information divergence
  • discrete infinite alphabet
  • distribution estimation

ASJC Scopus subject areas

  • Information Systems
  • Computer Science Applications
  • Library and Information Sciences

Cite this