A worldwide flock of Condors : load sharing among workstation clusters

D.H.J. Epema, M. Livny, R. Dantzig, van, X. Evers, J. Pruyne

    Onderzoeksoutput: Bijdrage aan tijdschriftTijdschriftartikelAcademicpeer review

    184 Citaten (Scopus)

    Samenvatting

    Condor is a distributed batch system for sharing the workload of compute-intensive jobs in a pool of unix workstations connected by a network. In such a Condor pool, idle machines are spotted by Condor and allocated to queued jobs, thus putting otherwise unutilized capacity to efficient use. When institutions owning Condor pools cooperate, they may wish to exploit the joint capacity of their pools in a similar way. So the need arises to extend the Condor load-sharing and protection mechanisms beyond the boundaries of Condor pools, or in other words, to create a flock of Condors. Such a flock may include Condor pools connected by local-area networks as well as by wide-area networks. In this paper we describe the design and implementation of a distributed, layered Condor flocking mechanism. The main concept in this design is the Gateway Machine that represents in each pool idle machines from other pools in the flock and allows job transfers across pool boundaries. Our flocking design is transparent to the workstation owners, to the users, and to Condor itself. We also discuss our experiences with an intercontinental Condor flock.
    Originele taal-2Engels
    Pagina's (van-tot)53-65
    TijdschriftFuture Generation Computer Systems
    Volume12
    Nummer van het tijdschrift1
    DOI's
    StatusGepubliceerd - 1996

    Vingerafdruk

    Duik in de onderzoeksthema's van 'A worldwide flock of Condors : load sharing among workstation clusters'. Samen vormen ze een unieke vingerafdruk.

    Citeer dit