论文标题
提交意见的审阅者分析审查员推荐系统
Submission-Aware Reviewer Profiling for Reviewer Recommender System
论文作者
论文摘要
将合格,公正和感兴趣的审稿人分配给纸质提交对于维持学术出版系统的完整性和质量和为作者提供宝贵的评论至关重要。但是,对于会议计划委员会而言,在有限的时间内将成千上万的意见与成千上万的潜在审阅者匹配是一个艰巨的挑战。基于主题建模的先前努力损失了有助于在出版物或提交摘要中定义主题的特定环境。而且,在某些情况下,发现的主题很难解释。我们提出了一种方法,该方法从潜在的审稿人所研究的主题以及审阅者研究主题的明确背景下的每个摘要中学习。此外,我们为评估审阅者匹配系统的新数据集提供了贡献。与现有方法相比,我们的实验表明精度有显着,一致的改善。我们还使用示例来说明为什么我们的建议更能解释。在过去的两年中,新方法已在顶级会议上成功部署。
Assigning qualified, unbiased and interested reviewers to paper submissions is vital for maintaining the integrity and quality of the academic publishing system and providing valuable reviews to authors. However, matching thousands of submissions with thousands of potential reviewers within a limited time is a daunting challenge for a conference program committee. Prior efforts based on topic modeling have suffered from losing the specific context that help define the topics in a publication or submission abstract. Moreover, in some cases, topics identified are difficult to interpret. We propose an approach that learns from each abstract published by a potential reviewer the topics studied and the explicit context in which the reviewer studied the topics. Furthermore, we contribute a new dataset for evaluating reviewer matching systems. Our experiments show a significant, consistent improvement in precision when compared with the existing methods. We also use examples to demonstrate why our recommendations are more explainable. The new approach has been deployed successfully at top-tier conferences in the last two years.