Finite-Length Analyses for Source and Channel Coding on Markov Chains

Autor: Masahito Hayashi, Shun Watanabe
Jazyk: angličtina
Rok vydání: 2020
Předmět:
Zdroj: Entropy, Vol 22, Iss 4, p 460 (2020)
Druh dokumentu: article
ISSN: 1099-4300
DOI: 10.3390/e22040460
Popis: We derive finite-length bounds for two problems with Markov chains: source coding with side-information where the source and side-information are a joint Markov chain and channel coding for channels with Markovian conditional additive noise. For this purpose, we point out two important aspects of finite-length analysis that must be argued when finite-length bounds are proposed. The first is the asymptotic tightness, and the other is the efficient computability of the bound. Then, we derive finite-length upper and lower bounds for the coding length in both settings such that their computational complexity is low. We argue the first of the above-mentioned aspects by deriving the large deviation bounds, the moderate deviation bounds, and second-order bounds for these two topics and show that these finite-length bounds achieve the asymptotic optimality in these senses. Several kinds of information measures for transition matrices are introduced for the purpose of this discussion.
Databáze: Directory of Open Access Journals
Nepřihlášeným uživatelům se plný text nezobrazuje