A Survey on Error-Bounded Lossy Compression for Scientific Datasets
arxiv(2024)
摘要
Error-bounded lossy compression has been effective in significantly reducing
the data storage/transfer burden while preserving the reconstructed data
fidelity very well. Many error-bounded lossy compressors have been developed
for a wide range of parallel and distributed use cases for years. These lossy
compressors are designed with distinct compression models and design
principles, such that each of them features particular pros and cons. In this
paper we provide a comprehensive survey of emerging error-bounded lossy
compression techniques for different use cases each involving big data to
process. The key contribution is fourfold. (1) We summarize an insightful
taxonomy of lossy compression into 6 classic compression models. (2) We provide
a comprehensive survey of 10+ commonly used compression components/modules used
in error-bounded lossy compressors. (3) We provide a comprehensive survey of
10+ state-of-the-art error-bounded lossy compressors as well as how they
combine the various compression modules in their designs. (4) We provide a
comprehensive survey of the lossy compression for 10+ modern scientific
applications and use-cases. We believe this survey is useful to multiple
communities including scientific applications, high-performance computing,
lossy compression, and big data.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要