On Decentralized Linearly Separable Computation With the Minimum Computation Cost
CoRR(2024)
摘要
The distributed linearly separable computation problem finds extensive
applications across domains such as distributed gradient coding, distributed
linear transform, real-time rendering, etc. In this paper, we investigate this
problem in a fully decentralized scenario, where 𝖭 workers
collaboratively perform the computation task without a central master. Each
worker aims to compute a linearly separable computation that can be manifested
as 𝖪_c linear combinations of 𝖪 messages,
where each message is a function of a distinct dataset. We require that each
worker successfully fulfill the task based on the transmissions from any
𝖭_r workers, such that the system can tolerate any
𝖭-𝖭_r stragglers. We focus on the scenario where
the computation cost (the number of uncoded datasets assigned to each worker)
is minimum, and aim to minimize the communication cost (the number of symbols
the fastest 𝖭_r workers transmit). We propose a novel
distributed computing scheme that is optimal under the widely used cyclic data
assignment. Interestingly, we demonstrate that the side information at each
worker is ineffective in reducing the communication cost when
𝖪_c≤𝖪𝖭_r/𝖭,
while it helps reduce the communication cost as 𝖪_c
increases.
更多查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要