DMCA
Optimizing deadline-driven bulk data transfers in overlay networks
| Citations: | 2 - 0 self |
BibTeX
@MISC{Agapi_optimizingdeadline-driven,
author = {Andrei Agapi and Sebastien Soudan and Marcelo Pasin and Pascale Vicat-blanc Primet and Thilo Kielmann},
title = {Optimizing deadline-driven bulk data transfers in overlay networks},
year = {}
}
Share
 |
 |
 |
 |
||
OpenURL
Abstract
Abstract—Deadline-driven bulk data transfers frequently occur in overlay networks running data-intensive, distributed workflow applications, such as grid and cloud environments. What distinguishes such transfers from other Internet traffic is that overlay nodes should cooperate towards the common goal of delivering all inter-dependent data timely, rather than follow individual, selfish goals. For such scenarios, we propose scheduling transfers in overlays in a globally optimal manner with respect to minimizing overall network congestion. Our optimization jointly addresses routing of transfers within the overlay and the time-domain scheduling of transfer bandwidths. We formally define and address the associated problem, the Bulk Data Routing and Transfer(BDRT) and present a linear programming-based solution to it, optimal in both routing and time domains. We additionally explore alternative approaches based on heuristic routing strategies, both oblivious and time-domain optimized. We evaluate these solutions via both PlanetLab trace-driven simulations and Internet transfer experiments, on the Intrigger wide-area grid and PlanetLab. Evaluation shows that our approach finds optimal solutions, based on estimations of job arrival times, deadlines and transfer volumes. Index Terms—congestion minimization, deadline-driven transfers, routing overlays, Internet
Keyphrases
overlay network deadline-driven bulk data transfer associated problem optimal solution overlay node time-domain scheduling job arrival time internet traffic index term congestion minimization overall network congestion common goal abstract deadline-driven bulk data transfer intrigger wide-area grid bulk data routing heuristic routing strategy inter-dependent data selfish goal planetlab trace-driven simulation workflow application internet transfer experiment deadline-driven transfer cloud environment linear programming-based solution transfer bandwidth alternative approach optimal manner time domain
