Rate-distortion function for finite block codes: Analysis of symmetric binary hamming problem

Avasarala, S and Jana, Soumya and Akella, P (2015) Rate-distortion function for finite block codes: Analysis of symmetric binary hamming problem. In: 21st National Conference on Communications, 27 February 2015 - 1 March 2015, IIT Bombay Mumbai; India.

1529_raiith_07084928.pdf - Published Version

Download (214kB) | Preview


Shannon's rate-distortion theory provides an asymptotic analysis, where delays are allowed to grow unbounded. In practice, real-time applications, such as video streaming and network storage, are subject to certain maximum delay. Accordingly, it is imperative to develop a finite-delay framework for analyzing the rate-distortion limit. In this backdrop, we propose an intuitive generalization of Shannon's asymptotic operational framework to finite block codes. In view of the extreme complexity of such framework, we obtain insight by specializing to the symmetric binary hamming problem. Even upon such specialization, the proposed framework is computationally so intensive that accurate evaluation of the finite-delay rate-distortion function is practical only upto a block length of three. In order to obtain further insight, we then propose a lower-complexity lower bound, based on the partition function of natural numbers, whose computation is practical upto a block length of six. Finally, using a simple combinatorial argument, we propose an upper bound to localize the desired rate-distortion function between our lower and upper bounds.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Item Type: Conference or Workshop Item (Paper)
Additional Information: We are grateful to N. R. Aravind for useful discussion.
Uncontrolled Keywords: Binary source; Finite block codes; Hamming distortion; Huffman coding; Rate-Distortion function
Subjects: Others > Electricity
Divisions: Department of Electrical Engineering
Depositing User: Team Library
Date Deposited: 25 May 2015 09:06
Last Modified: 12 Sep 2017 10:36
URI: http://raiith.iith.ac.in/id/eprint/1529
Publisher URL: https://doi.org/10.1109/NCC.2015.7084928
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 1529 Statistics for this ePrint Item