论文标题
迈向智能数据传递服务
Towards an Intelligent Data Delivery Service
论文作者
论文摘要
LHC上的Atlas事件流媒体服务(ESS)是一种预处理和交付事件服务数据(ES)的方法,该方法已实施了ATLAS事件处理的细粒度方法。 ESS允许不同步提供ES处理所需的输入事件,目的是减少WAN的数据流量并改善整体数据处理吞吐量。开发了ESS的原型,以提供流媒体事件来获得精细的ES工作。基于此,正在开发智能数据传递服务(IDD),以使“冷格式”和数据的处理格式与数据的处理格式解散,这也为包括其他HEP实验的生产系统提供了机会。首先,我们将在这里介绍ESS模型视图及其对IDDS系统的动机。然后,我们还将介绍IDD架构,体系结构和IDD的应用。
The ATLAS Event Streaming Service (ESS) at the LHC is an approach to preprocess and deliver data for Event Service (ES) that has implemented a fine-grained approach for ATLAS event processing. The ESS allows one to asynchronously deliver only the input events required by ES processing, with the aim to decrease data traffic over WAN and improve overall data processing throughput. A prototype of ESS was developed to deliver streaming events to fine-grained ES jobs. Based on it, an intelligent Data Delivery Service (iDDS) is under development to decouple the "cold format" and the processing format of the data, which also opens the opportunity to include the production systems of other HEP experiments. Here we will at first present the ESS model view and its motivations for iDDS system. Then we will also present the iDDS schema, architecture and the applications of iDDS.