Properties of a Wore-Valued Source with a Non-prefix-free Word Set

1 Citations 17 References
  • ISHIDA Takashi
    Department of the Industrial and Management Systems Engineering, School of Science and Engineering, Waseda University
  • GOTO Masayuki
    Faculty of Environmental and Information Studies, Musashi Institute of Technology
  • MATSUSHIMA Toshiyasu
    Department of the Industrial and Management Systems Engineering, School of Science and Engineering, Waseda University
  • HIRASAWA Shigeichi
    Department of the Industrial and Management Systems Engineering, School of Science and Engineering, Waseda University

Search this article

Abstract

Recently, a word-valued source has been proposed as a new class of information source models. A word-valued source is regarded as a source with a probability distribution over a word set. Although a word-valued source is a nonstationary source in general, it has been proved that an entropy rate of the source exists and the Asymptotic Equipartition Property (AEP) holds when the word set of the source is prefix-free. However, when the word set is not prefix-free (non-prefix-free), only an upper bound on the entropy density rate for an i.i.d. word-valued source has been derived so far. In this paper, we newly derive a lower bound on the entropy density rate for an i.i.d. word-valued source with a finite non-prefix-free word set. Then some numerical examples are given in order to investigate the behavior of the bounds.

Journal

  • IEICE Trans. on Fundamentals

    IEICE Trans. on Fundamentals 89 (12), 3710-3723, 2006-12-01

    The Institute of Electronics, Information and Communication Engineers

Citations (1)*help

See more

References(17)*help

See more

Keywords

Details 詳細情報について

  • CRID
    1570009752661495552
  • NII Article ID
    110007537878
  • NII Book ID
    AA10826239
  • ISSN
    09168508
  • Text Lang
    en
  • Data Source
    • CiNii Articles

Report a problem

Back to top