DMCA
Dynamic Energy Efficient Data Placement and Cluster Reconfiguration Algorithm for MapReduce Framework
| Citations: | 6 - 1 self |
BibTeX
@MISC{Maheshwari_dynamicenergy,
author = {Nitesh Maheshwari and Radheshyam N and Vasudeva Varma},
title = {Dynamic Energy Efficient Data Placement and Cluster Reconfiguration Algorithm for MapReduce Framework},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
With the recent emergence of cloud computing based services on the Inter-net, MapReduce and distributed file systems like HDFS have emerged as the paradigm of choice for developing large scale data intensive applications. Given the scale at which these applications are deployed, minimizing power consumption of these clusters can significantly cut down operational costs and reduce their carbon footprint- thereby increasing the utility from a provider’s point of view. This paper addresses energy conservation for clus-ters of nodes that run MapReduce jobs. The algorithm dynamically recon-figures the cluster based on the current workload and turns cluster nodes on or off when the average cluster utilization rises above or falls below adminis-trator specified thresholds, respectively. We evaluate our algorithm using the GridSim toolkit and our results show that the proposed algorithm achieves an energy reduction of 33 % under average workloads and up to 54 % under low workloads. Keywords:
Keyphrases
cluster reconfiguration algorithm mapreduce framework dynamic energy efficient data placement mapreduce job carbon footprint average workload low workload current workload energy conservation cluster node provider point large scale data intensive application operational cost file system power consumption average cluster utilization rise gridsim toolkit recent emergence energy reduction
