论文标题
关于高斯流程的信息瓶颈
On Information Bottleneck for Gaussian Processes
论文作者
论文摘要
考虑了共同固定的高斯来源的信息瓶颈问题(IB)。 IB速率的填充解决方案是根据其SNR频谱给出的,并且通过频域测试通道实现实现速率。还提出了基于线性预测的IB速率的时间域实现,这也可以有效地实现相应的远程源编码问题。解决了该问题的复合版本,其中未精确指定源的联合分布,而是根据保证的互信息的下限。事实证明,白色SNR光谱对于此设置是最佳的。
The information bottleneck problem (IB) of jointly stationary Gaussian sources is considered. A water-filling solution for the IB rate is given in terms of its SNR spectrum and whose rate is attained via frequency domain test-channel realization. A time-domain realization of the IB rate, based on linear prediction, is also proposed, which lends itself to an efficient implementation of the corresponding remote source-coding problem. A compound version of the problem is addressed, in which the joint distribution of the source is not precisely specified but rather in terms of a lower bound on the guaranteed mutual information. It is proved that a white SNR spectrum is optimal for this setting.