On the dynamic resource availability in grids

A. Iosup, M. Jan, O.O. Sonmez, D.H.J. Epema

    Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

    73 Citations (Scopus)
    69 Downloads (Pure)

    Abstract

    Currently deployed grids gather together thousands of computational and storage resources for the benefit of a large community of scientists. However, the large scale, the wide geographical spread, and at times the decision of the rightful resource owners to commit the capacity elsewhere, raises serious resource availability issues. Little is known about the characteristics of the grid resource availability, and of the impact of resource unavailability on the performance of grids. In this work, we make first steps in addressing this twofold lack of information. First, we analyze a long-term availability trace and assess the resource availability characteristics of Grid'5000, an experimental grid environment of over 2,500 processors. The average utilization for the studied trace is increased by almost 5%, when availability is considered. Based on the results of the analysis, we further propose a model for grid resource availability. Our analysis and modeling results show that grid computational resources become unavailable at a high rate, negatively affecting the ability of grids to execute long jobs. Second, through trace-based simulation, we show evidence that resource availability can have a severe impact on the performance of the grid systems. The results of this step show evidence that the performance of a grid system can rise when availability is taken into consideration, and that human administration of availability change information results in 10-15 times more job failures than for an automated monitoring solution, even for a lowly utilized system.
    Original languageEnglish
    Title of host publicationProceedings of the 8th IEEE/ACM International Conference on Grid Computing (GRID 2007, Austin TX, USA, September 19-21, 2007)
    PublisherInstitute of Electrical and Electronics Engineers
    Pages26-33
    ISBN (Print)1-4244-1560-8
    DOIs
    Publication statusPublished - 2007

    Fingerprint Dive into the research topics of 'On the dynamic resource availability in grids'. Together they form a unique fingerprint.

  • Cite this

    Iosup, A., Jan, M., Sonmez, O. O., & Epema, D. H. J. (2007). On the dynamic resource availability in grids. In Proceedings of the 8th IEEE/ACM International Conference on Grid Computing (GRID 2007, Austin TX, USA, September 19-21, 2007) (pp. 26-33). Institute of Electrical and Electronics Engineers. https://doi.org/10.1109/GRID.2007.4354112