Abstract
Traditional Slepian-Wolf coding assumes known statistics and relies on asymptotically long sequences. However, in practice the statistics are unknown, and the input sequences are of finite length. In this finite regime, we must allow a non-zero probability of codeword error e and also pay a penalty by adding redundant bits in the encoding process. In this paper, we develop a universal scheme for Slepian-Wolf coding that allows encoding at variable rates close to the Slepian-Wolf limit. We illustrate our scheme in a setup where we encode a uniform Bernoulli source sequence and the second sequence, which is correlated to the first via a binary symmetric correlation channel, is available as side information at the decoder. This specific setup is easily extended to more general settings. For length n source sequences and a fixed ε, we show that the redundancy of our scheme is O(√n -1(ε)) bits over the Slepian-Wolf limit. The prior art for Slepian-Wolf coding with known statistics shows that the redundancy is (√/n -1(ε)). Therefore, we infer that for Slepian-Wolf coding, the penalty needed to accommodate universality is (√/n -1(ε)).
Original language | English (US) |
---|---|
Title of host publication | Conference Record of The Thirty-Ninth Asilomar Conference on Signals, Systems and Computers |
Pages | 8-12 |
Number of pages | 5 |
Volume | 2005 |
State | Published - Dec 1 2005 |
Event | 39th Asilomar Conference on Signals, Systems and Computers - Pacific Grove, CA, United States Duration: Oct 28 2005 → Nov 1 2005 |
Other
Other | 39th Asilomar Conference on Signals, Systems and Computers |
---|---|
Country | United States |
City | Pacific Grove, CA |
Period | 10/28/05 → 11/1/05 |
ASJC Scopus subject areas
- Signal Processing
- Computer Networks and Communications