Four Limits in Probability for Use in Information Theory

DOI Web Site
  • KOGA Hiroki
    Faculty of Engineering, Information and Systems, University of Tsukuba

Bibliographic Information

Other Title
  • 情報理論における4つの確率的極限
  • - A Brief Introduction to Information-Spectrum Methods with Four Limits -
  • ー4つの量の情報スペクトル理論超入門ー

Abstract

In the information-spectrum methods proposed by Han and Verd´u, quantities defined using the ordinary limits superior/inferior in probability correspond to the optimal achievable rates in basic information-theoretic problems such as source coding and channel coding. In this paper, we introduce two more nonconventional limits in probability and apply all four limits to the fixed-length coding of a general source. In this paper, we first define four quantities for a source using the four limits in probability. It is shown that the four quantities satisfy a natural inequality if and only if the source is canonical. Next, we give operational meanings for the four quantities in fixed-length source coding. As one of the by-products, we can formulate nonconventional strong converse properties and obtain necessary and sufficient conditions. Finally, we explain a result for the achievable rate region in the optimistic sense of separately coding two correlated general sources. These results suggest the importance of the four quantities as new terminology for characterizing the performance of coding in more detail.

Journal

  • IEICE ESS Fundamentals Review

    IEICE ESS Fundamentals Review 8 (1), 4-14, 2014

    The Institute of Electronics, Information and Communication Engineers

Keywords

Details

Report a problem

Back to top