Data Processing at the Linac Coherent Light Source

Jana Thayer,Clemens Weninger, Seshu Yamajala,Sioan Zohar,Daniel Damiani, Mikhail Dubrovin, Christopher Ford,Wilko Kroeger, Christopher Paul O'Grady,Amedeo Perazzo,Murali Shankar,Matt Weaver

2019 IEEE/ACM 1st Annual Workshop on Large-scale Experiment-in-the-Loop Computing (XLOOP)(2019)

引用 3|浏览10
暂无评分
摘要
The increase in velocity, volume, and complexity of the data generated by the upcoming LCLS-II upgrade presents a considerable challenge for data acquisition, data processing, and data management. These systems face formidable challenges due to the extremely high data throughput, hundreds of GB/s to multi-TB/s, generated by the detectors at the experimental facilities and to the intensive computational demand for data processing and scientific interpretation. The LCLS-II Data System offers a fast, powerful, and flexible architecture that includes a feature extraction layer designed to reduce the data volumes by at least one order of magnitude while preserving the science content of the data. Innovative architectures are required to implement this reduction with a configurable approach that can adapt to the multiple science areas served by LCLS. In order to increase the likelihood of experiment success and improve the quality of recorded data, a real-time analysis framework provides visualization and graphically-configurable analysis of a selectable subset of the data on the timescale of seconds. A fast feedback layer offers dedicated processing resources to the running experiment in order to provide experimenters feedback about the quality of acquired data within minutes. We will present an overview of the LCLS-II Data System architecture with an emphasis on the Data Reduction Pipeline (DRP) and online monitoring framework.
更多
查看译文
关键词
data processing,data volumes,LCLS-II Data System architecture,online monitoring framework,linac coherent light source,LCLS-II upgrade,data acquisition,data management,detectors,real-time analysis framework,feedback layer,feature extraction layer
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要