论文标题
聊天交接的因果推论
Causal Inference for Chatting Handoff
论文作者
论文摘要
旨在通过预测聊天机器人失败并实现人类代理协作来确保聊天机器人质量,机器人聊天式(MHCH)在近年来引起了行业和学术界的广泛关注。但是,大多数现有方法主要集中于对话环境或基于多任务学习的全球满意度预测,该预测忽略了因果变量之间的基础关系,例如用户状态和人工成本。这些变量与移交决策显着相关,从而导致预测偏差和成本增加。因此,我们通过基于这两个变量建立MHCH的因果图来提出因果关系模块(CEM),这是一个简单而有效的模块,很容易插入现有的MHCH方法中。对于用户的影响,我们使用用户状态根据多任务的因果关系来纠正预测偏差。对于人工成本,我们培训辅助成本模拟器,通过反事实学习来计算公正的人工成本,以使模型变得具有成本感。在四个现实世界基准上进行的广泛实验表明,CEM通常在没有任何详细模型制作的情况下改善现有MHCH方法的性能。
Aiming to ensure chatbot quality by predicting chatbot failure and enabling human-agent collaboration, Machine-Human Chatting Handoff (MHCH) has attracted lots of attention from both industry and academia in recent years. However, most existing methods mainly focus on the dialogue context or assist with global satisfaction prediction based on multi-task learning, which ignore the grounded relationships among the causal variables, like the user state and labor cost. These variables are significantly associated with handoff decisions, resulting in prediction bias and cost increasement. Therefore, we propose Causal-Enhance Module (CEM) by establishing the causal graph of MHCH based on these two variables, which is a simple yet effective module and can be easy to plug into the existing MHCH methods. For the impact of users, we use the user state to correct the prediction bias according to the causal relationship of multi-task. For the labor cost, we train an auxiliary cost simulator to calculate unbiased labor cost through counterfactual learning so that a model becomes cost-aware. Extensive experiments conducted on four real-world benchmarks demonstrate the effectiveness of CEM in generally improving the performance of existing MHCH methods without any elaborated model crafting.