Watch out for the bully!: job interference study on dragonfly network.

SC(2016)

引用 105|浏览153
暂无评分
摘要
High-radix, low-diameter dragonfly networks will be a common choice in next-generation supercomputers. Preliminary studies show that random job placement with adaptive routing should be the rule of thumb to utilize such networks, since it uniformly distributes traffic and alleviates congestion. Nevertheless, in this work we find that while random job placement coupled with adaptive routing is good at load balancing network traffic, it cannot guarantee the best performance for every job. The performance improvement of communication-intensive applications comes at the expense of performance degradation of less intensive ones. We identify this bully behavior and validate its underlying causes with the help of detailed network simulation and real application traces. We further investigate a hybrid contiguous-noncontiguous job placement policy as an alternative. Initial experimentation shows that hybrid job placement aids in reducing the worst-case performance degradation for less communication-intensive applications while retaining the performance of communication-intensive ones.
更多
查看译文
关键词
job interference study,high-radix dragonfly networks,low-diameter dragonfly networks,next-generation supercomputers,random job placement,adaptive routing,load balancing network traffic,communication-intensive applications,network simulation,hybrid contiguous-noncontiguous job placement policy,hybrid job placement,worst-case performance degradation reduction
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要