论文标题

关于高斯流程的信息瓶颈

On Information Bottleneck for Gaussian Processes

论文作者

Dikshtein, Michael, Weinberger, Nir, Shamai, Shlomo

论文摘要

考虑了共同固定的高斯来源的信息瓶颈问题(IB)。 IB速率的填充解决方案是根据其SNR频谱给出的,并且通过频域测试通道实现实现速率。还提出了基于线性预测的IB速率的时间域实现,这也可以有效地实现相应的远程源编码问题。解决了该问题的复合版本,其中未精确指定源的联合分布,而是根据保证的互信息的下限。事实证明,白色SNR光谱对于此设置是最佳的。

The information bottleneck problem (IB) of jointly stationary Gaussian sources is considered. A water-filling solution for the IB rate is given in terms of its SNR spectrum and whose rate is attained via frequency domain test-channel realization. A time-domain realization of the IB rate, based on linear prediction, is also proposed, which lends itself to an efficient implementation of the corresponding remote source-coding problem. A compound version of the problem is addressed, in which the joint distribution of the source is not precisely specified but rather in terms of a lower bound on the guaranteed mutual information. It is proved that a white SNR spectrum is optimal for this setting.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源