论文标题

使用功能工程的客户支持票证升级预测

Customer Support Ticket Escalation Prediction using Feature Engineering

论文作者

Montgomery, Lloyd, Damian, Daniela, Bulmer, Tyson, Quader, Shaikh

论文摘要

了解和保持客户满意是需求工程的核心宗旨。收集,分析和谈判要求的策略是通过部署产品后管理客户投入的努力来补充的。对于后者,支持门票是允许客户提交问题,错误报告和功能请求的关键。但是,如果对支持问题的关注不足,那么他们对管理的升级就会耗时且昂贵,尤其是对于管理数百个客户和数千张支持票的大型组织而言。我们的工作为简化支持分析师和经理的工作提供了一步,尤其是在预测支持票升级的风险方面。在我们大型工业合作伙伴IBM的一项现场研究中,我们使用了设计科学研究方法来表征IBM分析师在管理升级方面可用的支持过程和数据。然后,我们将这些功能实施到机器学习模型中,以预测支票升级。我们培训并评估了我们的机器学习模型,以超过250万支支持门票和10,000次升级,召回了87.36%的召回,工作量减少了88.23%,以供支持分析师,以识别有升级风险的支持门票。最后,除了这些研究评估活动外,我们还将支持票证票的性能与没有功能工程的模型的表现进行了比较。支持票证型模型的表现优于非工程模型。这项研究中创建的工件旨在成为有兴趣预测支持票证升级的组织的起点,以及未来的研究人员在进行升级预测方面的研究。

Understanding and keeping the customer happy is a central tenet of requirements engineering. Strategies to gather, analyze, and negotiate requirements are complemented by efforts to manage customer input after products have been deployed. For the latter, support tickets are key in allowing customers to submit their issues, bug reports, and feature requests. If insufficient attention is given to support issues, however, their escalation to management becomes time-consuming and expensive, especially for large organizations managing hundreds of customers and thousands of support tickets. Our work provides a step towards simplifying the job of support analysts and managers, particularly in predicting the risk of escalating support tickets. In a field study at our large industrial partner, IBM, we used a design science research methodology to characterize the support process and data available to IBM analysts in managing escalations. We then implemented these features into a machine learning model to predict support ticket escalations. We trained and evaluated our machine learning model on over 2.5 million support tickets and 10,000 escalations, obtaining a recall of 87.36% and an 88.23% reduction in the workload for support analysts looking to identify support tickets at risk of escalation. Finally, in addition to these research evaluation activities, we compared the performance of our support ticket model with that of a model developed with no feature engineering; the support ticket model features outperformed the non-engineered model. The artifacts created in this research are designed to serve as a starting place for organizations interested in predicting support ticket escalations, and for future researchers to build on to advance research in escalation prediction.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源