Robust coding for a class of sources: Applications in control and reliable communication over limited capacity channels

Autor: Farhadi, A., Charalambous, Charalambos D.
Přispěvatelé: Charalambous, Charalambos D. [0000-0002-2168-0231]
Rok vydání: 2008
Předmět:
Mathematical optimization
Kullback–Leibler divergence
Information theory
General Computer Science
Relative entropy
Entropy
Data_CODINGANDINFORMATIONTHEORY
Explicit solutions
Trajectories
Rényi entropy
Limited capacity constraint
System stability
Shannon lower bound
Limited capacity
Robust coding
Dynamical systems
Shannon entropies
Entropy (information theory)
Electrical and Electronic Engineering
Rate distortions
Mathematics
Communication channels
Data reconstruction
Shannon's source coding theorem
Mechanical Engineering
Principle of maximum entropy
Source density
Channel capacity
Finite capacity
Schrodinger equation
Reliable communication
Rhenium
Control and Systems Engineering
Maximum entropy
Restoration
Maximum entropy probability distribution
Transfer entropy
Mini-max
Shannon information
Robust stability and observability
In-control
Zdroj: Systems and Control Letters
Syst Control Lett
Popis: This paper is concerned with the control of a class of dynamical systems over finite capacity communication channels. Necessary conditions for reliable data reconstruction and stability of a class of dynamical systems are derived. The methodology is information theoretic. It introduces the notion of entropy for a class of sources, which is defined as a maximization of the Shannon entropy over a class of sources. It also introduces the Shannon information transmission theorem for a class of sources, which states that channel capacity should be greater or equal to the mini-max rate distortion (maximization is over the class of sources) for reliable communication. When the class of sources is described by a relative entropy constraint between a class of source densities, and a given nominal source density, the explicit solution to the maximum entropy, is given, and its connection to Rényi entropy is illustrated. Furthermore, this solution is applied to a class of controlled dynamical systems to address necessary conditions for reliable data reconstruction and stability of such systems. Crown Copyright © 2008. 57 12 1005 1012
Databáze: OpenAIRE
Externí odkaz: