Lossy Polar Coding for a Symmetric Discrete Memoryless Source with a Time-Varying Distortion Measure

Jan 14, 2025ยท
Qiyi Yao
Qiyi Yao
,
Weiming Zhang
,
Kejiang Chen
,
Nenghai Yu
ยท 1 min read
Abstract
We consider using polar codes for lossy source coding of a symmetric Discrete Memoryless Source (DMS) with a time-varying distortion measure instead of the conventional fixed single-letter distortion measure in this paper. First, the specific lossy source coding problem is formally stated and the rate-distortion bound is developed. Second, with the theoretical pursuit, a polar codes-based scheme is proposed. The code construction step of the scheme takes in the non-stationary sequence of test channels corresponding to the test channel model between the source sequence and the recovered sequence of the lossy source coding problem. Then, a Successive Cancellation (SC) encoder is employed to perform the actual encoding of the source sequence. We develop the optimal characterizations of the test channels, with which the proposed method shows near-optimal performance very close to the rate-distortion bound. We further prove that given the sufficient condition of fast source polarization, the proposed method under a randomized SC encoder achieves the rate-distortion bound for the given source settings when the source length N tends to infinity.
Type
Publication
In Preparation
This work is driven by the results in my [previous paper](/publication/conference-paper/) on LLMs.
Create your slides in Markdown - click the Slides button to check out the example.

Add the publication’s full text or supplementary notes here. You can use rich formatting such as including code, math, and images.