Node Performance Load Balancing Algorithm For Hadoop Cluster

PROCEEDINGS OF THE 2019 INTERNATIONAL CONFERENCE ON INTELLIGENT SUSTAINABLE SYSTEMS (ICISS 2019)(2019)

引用 0|浏览0
暂无评分
摘要
Hadoop is an implementation of MapReduce algorithm[1]. It operates on Distributed, parallel systems. During the execution of MapReduce applications default hash Partitioning algorithm leads to uneven distribution of load among the reducer tasks. Because of this total execution time gets affected. Hence the algorithm is modified in which it collects the local information, combines them and distributes the data in order to avoid skew. Node performance Load Balancing algorithm is used to reduce the imbalance of the load among the reducers. Due to this the execution time taken to complete the task is reduced.
更多
查看译文
关键词
Load Balancing, Cluster, Hadoop
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要