Leveraging Apache Arrow for Zero-copy, Zero-serialization Cluster Shared Memory
arxiv(2024)
摘要
This paper describes a distributed implementation of Apache Arrow that can
leverage cluster-shared load-store addressable memory that is hardware-coherent
only within each node. The implementation is built on the ThymesisFlow
prototype that leverages the OpenCAPI interface to create a shared address
space across a cluster. While Apache Arrow structures are immutable,
simplifying their use in a cluster shared memory, this paper creates
distributed Apache Arrow tables and makes them accessible in each node.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要