TY - JOUR
T1 - A lower bound on the queueing delay in resource constrained load balancing
AU - Gamarnik, David
AU - Tsitsiklis, John N.
AU - Zubeldia, Martin
PY - 2020/4/1
Y1 - 2020/4/1
N2 - We consider the following distributed service model: jobs with unit mean, general distribution, and independent processing times arrive as a renewal process of rate λn, with 0<λ<1, and are immediately dispatched to one of several queues associated with n identical servers with unit processing rate. We assume that the dispatching decisions are made by a central dispatcher endowed with a finite memory, and with the ability to exchange messages with the servers.
We study the fundamental resource requirements (memory bits and message exchange rate), in order to drive the expected queueing delay in steady-state of a typical job to zero, as n increases. We develop a novel approach to show that, within a certain broad class of “symmetric” policies, every dispatching policy with a message rate of the order of n, and with a memory of the order of logn bits, results in an expected queueing delay which is bounded away from zero, uniformly as n→∞. This complements existing results which show that, in the absence of such limitations on the memory or the message rate, there exist policies with vanishing queueing delay (at least with Poisson arrivals and exponential service times).
AB - We consider the following distributed service model: jobs with unit mean, general distribution, and independent processing times arrive as a renewal process of rate λn, with 0<λ<1, and are immediately dispatched to one of several queues associated with n identical servers with unit processing rate. We assume that the dispatching decisions are made by a central dispatcher endowed with a finite memory, and with the ability to exchange messages with the servers.
We study the fundamental resource requirements (memory bits and message exchange rate), in order to drive the expected queueing delay in steady-state of a typical job to zero, as n increases. We develop a novel approach to show that, within a certain broad class of “symmetric” policies, every dispatching policy with a message rate of the order of n, and with a memory of the order of logn bits, results in an expected queueing delay which is bounded away from zero, uniformly as n→∞. This complements existing results which show that, in the absence of such limitations on the memory or the message rate, there exist policies with vanishing queueing delay (at least with Poisson arrivals and exponential service times).
KW - Load balancing
KW - Queueing delay
KW - Resource constraints
UR - http://www.scopus.com/inward/record.url?scp=85091367603&partnerID=8YFLogxK
U2 - 10.1214/19-AAP1519
DO - 10.1214/19-AAP1519
M3 - Article
VL - 30
SP - 870
EP - 901
JO - The Annals of Applied Probability
JF - The Annals of Applied Probability
SN - 1050-5164
IS - 2
ER -