Title:Entropies of weighted sums in cyclic groups and applications to polar codes

Abstract:In this note, we give some specific examples of i.i.d. random variables $X, Y$ taking values in $\mZ/n\mZ$ such that the entropy of their sum is larger than the entropy of their difference; however, we also show that this cannot happen for $n=3$. Furthermore, we show that there exist i.i.d. $\mZ$-valued random variables $X, Y$ with finite entropy such that $H(X+Y)$ can exceed $H(X-Y)$ by an arbitrarily large amount, complementing a result of Lapidoth and Pete (2008); this statement is also true for differential entropies of real-valued random variables. These results are closely related to the study of MSTD (more sums than differences) sets in additive number theory. Finally we investigate polar codes for $q$-ary input channels using non-canonical kernels to construct the generator matrix, and present applications of our results to constructing polar codes with significantly improved error probability compared to the canonical construction.