On the equivalence of double maxima and KL-means for information bottleneck-based source coding
| Autor: | Shayan Hassanpour, Dirk Wubben, Armin Dekorsy |
|---|---|
| Rok vydání: | 2018 |
| Předmět: |
Source code
Noise measurement Computer science media_common.quotation_subject 05 social sciences 050801 communication & media studies 020206 networking & telecommunications Information bottleneck method Context (language use) 02 engineering and technology Set (abstract data type) 0508 media and communications 0202 electrical engineering electronic engineering information engineering Heuristics Maxima Algorithm Equivalence (measure theory) media_common |
| Zdroj: | WCNC |
| DOI: | 10.1109/wcnc.2018.8377199 |
| Popis: | In the context of noisy source coding, contrary to the conventional Rate-Distortion theory, the so-called Information Bottleneck method formulates the existent fundamental complexity-precision trade-off in a symmetric and purely information-theoretic fashion. Since the pertinent optimization task to design the quantizer is quite demanding, a number of heuristics have been developed to provide practically feasible procedures at the expense of yielding suboptimal solutions. In this paper, we consider two pertinent routines originally appeared in totally different applications and set out to precisely prove their algorithmic equivalence by conducting a thorough analysis over the corresponding algorithmic steps. We further corroborate our theoretical investigation employing computer-based simulations. |
| Databáze: | OpenAIRE |
| Externí odkaz: |
|