论文标题

具有未知动力学的马尔可夫链的集中主动跟踪

Centralized active tracking of a Markov chain with unknown dynamics

论文作者

Raman, Mrigank, Kumar, Ojal, Chattopadhyay, Arpan

论文摘要

在本文中,考虑了用于跟踪离散时间的活动传感器子集,考虑到具有未知过渡概率矩阵(TPM)的有限状态马尔可夫链。总共可用于观察马尔可夫链,其中每次都会激活一部分传感器,以便对过程进行可靠的估计。权衡是激活更多的传感器以收集更多的远程估计观察结果,以及限制传感器使用以节省能量和带宽消耗。该问题被称为一个约束最小化问题,其中目标是估计中的长期平均于点误差(MSE),并且约束是在传感器激活率上。通过两种工具的巧妙混合来解决该问题的拉格朗日放松:吉布斯采样以最小化和在线期望最大化(EM)以估计未知的TPM。最后,使用较慢的时间尺度随机近似来更新Lagrange乘数,以满足传感器激活率约束。在线EM算法虽然根据文献进行了改编,但即使在传感器观测的时差尺寸下,也可以估计矢量值参数。数值结果表明,与完整的传感器观察相比,与均匀传感器采样和可比的误差性能(在2 dB结合)中,大约1 dB的误差性能更好。这使得提出的算法适合实际实施。

In this paper, selection of an active sensor subset for tracking a discrete time, finite state Markov chain having an unknown transition probability matrix (TPM) is considered. A total of N sensors are available for making observations of the Markov chain, out of which a subset of sensors are activated each time in order to perform reliable estimation of the process. The trade-off is between activating more sensors to gather more observations for the remote estimation, and restricting sensor usage in order to save energy and bandwidth consumption. The problem is formulated as a constrained minimization problem, where the objective is the long-run averaged mean-squared error (MSE) in estimation, and the constraint is on sensor activation rate. A Lagrangian relaxation of the problem is solved by an artful blending of two tools: Gibbs sampling for MSE minimization and an on-line version of expectation maximization (EM) to estimate the unknown TPM. Finally, the Lagrange multiplier is updated using slower timescale stochastic approximation in order to satisfy the sensor activation rate constraint. The on-line EM algorithm, though adapted from literature, can estimate vector-valued parameters even under time-varying dimension of the sensor observations. Numerical results demonstrate approximately 1 dB better error performance than uniform sensor sampling and comparable error performance (within 2 dB bound) against complete sensor observation. This makes the proposed algorithm amenable to practical implementation.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源