论文标题
大规模订阅大数据
Subscribing to Big Data at Scale
论文作者
论文摘要
如今,数据正在由各种设备,服务和应用程序积极生成。此类数据不仅对于它包含的信息,而且对于与其他数据和感兴趣的用户的关系也很重要。大多数现有的大数据系统都集中在被动地回答用户的查询,而不是主动收集数据,处理数据并将其服务给用户。为了满足被动和主动要求,用户需要大量自定义现有的被动大数据系统或将多个系统粘合在一起。任何一种选择都需要用户的巨大努力,并产生额外的开销。在本文中,我们介绍了不良(大活动数据)系统,该系统旨在保留被动大数据系统的优点,并引入新功能,以便在大规模上向用户积极服务大数据。我们显示了不良系统的设计和实现,证明了如何促进被动和主动数据服务,调查不良系统的大规模绩效,并说明由“胶合”系统提供类似不良的服务而产生的复杂性。
Today, data is being actively generated by a variety of devices, services, and applications. Such data is important not only for the information that it contains, but also for its relationships to other data and to interested users. Most existing Big Data systems focus on passively answering queries from users, rather than actively collecting data, processing it, and serving it to users. To satisfy both passive and active requests at scale, users need either to heavily customize an existing passive Big Data system or to glue multiple systems together. Either choice would require significant effort from users and incur additional overhead. In this paper, we present the BAD (Big Active Data) system, which is designed to preserve the merits of passive Big Data systems and introduce new features for actively serving Big Data to users at scale. We show the design and implementation of the BAD system, demonstrate how BAD facilitates providing both passive and active data services, investigate the BAD system's performance at scale, and illustrate the complexities that would result from instead providing BAD-like services with a "glued" system.