Dynamic server assignment in an extended machine-repair model

J.L. Dorsman, S. Bhulai, M. Vlasiou

Research output: Book/ReportReportAcademic

66 Downloads (Pure)

Abstract

We consider an extension of the classical machine-repair problem. The machines, apart from receiving service from a single repairman, now also supply service themselves to queues of products. The extended model can be viewed as a two-layered queueing network, in which the queues of products in the ¿rst layer are generally correlated, due to the fact that the machines have to share the repairman’s capacity in the second layer. We are concerned with the dynamic control problem how the repairman should allocate his capacity to the machines at any point in time so that the long-term average (weighted) sum of the queue lengths of the ¿rst-layer queues is minimised. Since the optimal policy for the repairman cannot be found analytically due to the correlations in the queue lengths, we propose a near-optimal policy. We do this by combining intuition and results from queueing theory with techniques from Markov decision theory. Speci¿cally, we study the relative value functions for several policies for which the model can be decomposed in less complicated subsystems, and we combine the results with the classical one-step policy improvement algorithm. The resulting policy is easy to apply, scalable in the number of machines and is shown to be highly accurate over a wide range of parameter settings.
Original languageEnglish
Place of PublicationEindhoven
PublisherEurandom
Number of pages24
Publication statusPublished - 2012

Publication series

NameReport Eurandom
Volume2012020
ISSN (Print)1389-2355

Fingerprint

Queue
Repair
Assignment
Optimal policy
Queueing theory
Value function
Subsystem
Intuition
Queueing networks
Decision theory

Cite this

Dorsman, J. L., Bhulai, S., & Vlasiou, M. (2012). Dynamic server assignment in an extended machine-repair model. (Report Eurandom; Vol. 2012020). Eindhoven: Eurandom.
Dorsman, J.L. ; Bhulai, S. ; Vlasiou, M. / Dynamic server assignment in an extended machine-repair model. Eindhoven : Eurandom, 2012. 24 p. (Report Eurandom).
@book{4a94c9e4879f4c238414a02eb17f3678,
title = "Dynamic server assignment in an extended machine-repair model",
abstract = "We consider an extension of the classical machine-repair problem. The machines, apart from receiving service from a single repairman, now also supply service themselves to queues of products. The extended model can be viewed as a two-layered queueing network, in which the queues of products in the ¿rst layer are generally correlated, due to the fact that the machines have to share the repairman’s capacity in the second layer. We are concerned with the dynamic control problem how the repairman should allocate his capacity to the machines at any point in time so that the long-term average (weighted) sum of the queue lengths of the ¿rst-layer queues is minimised. Since the optimal policy for the repairman cannot be found analytically due to the correlations in the queue lengths, we propose a near-optimal policy. We do this by combining intuition and results from queueing theory with techniques from Markov decision theory. Speci¿cally, we study the relative value functions for several policies for which the model can be decomposed in less complicated subsystems, and we combine the results with the classical one-step policy improvement algorithm. The resulting policy is easy to apply, scalable in the number of machines and is shown to be highly accurate over a wide range of parameter settings.",
author = "J.L. Dorsman and S. Bhulai and M. Vlasiou",
year = "2012",
language = "English",
series = "Report Eurandom",
publisher = "Eurandom",

}

Dorsman, JL, Bhulai, S & Vlasiou, M 2012, Dynamic server assignment in an extended machine-repair model. Report Eurandom, vol. 2012020, Eurandom, Eindhoven.

Dynamic server assignment in an extended machine-repair model. / Dorsman, J.L.; Bhulai, S.; Vlasiou, M.

Eindhoven : Eurandom, 2012. 24 p. (Report Eurandom; Vol. 2012020).

Research output: Book/ReportReportAcademic

TY - BOOK

T1 - Dynamic server assignment in an extended machine-repair model

AU - Dorsman, J.L.

AU - Bhulai, S.

AU - Vlasiou, M.

PY - 2012

Y1 - 2012

N2 - We consider an extension of the classical machine-repair problem. The machines, apart from receiving service from a single repairman, now also supply service themselves to queues of products. The extended model can be viewed as a two-layered queueing network, in which the queues of products in the ¿rst layer are generally correlated, due to the fact that the machines have to share the repairman’s capacity in the second layer. We are concerned with the dynamic control problem how the repairman should allocate his capacity to the machines at any point in time so that the long-term average (weighted) sum of the queue lengths of the ¿rst-layer queues is minimised. Since the optimal policy for the repairman cannot be found analytically due to the correlations in the queue lengths, we propose a near-optimal policy. We do this by combining intuition and results from queueing theory with techniques from Markov decision theory. Speci¿cally, we study the relative value functions for several policies for which the model can be decomposed in less complicated subsystems, and we combine the results with the classical one-step policy improvement algorithm. The resulting policy is easy to apply, scalable in the number of machines and is shown to be highly accurate over a wide range of parameter settings.

AB - We consider an extension of the classical machine-repair problem. The machines, apart from receiving service from a single repairman, now also supply service themselves to queues of products. The extended model can be viewed as a two-layered queueing network, in which the queues of products in the ¿rst layer are generally correlated, due to the fact that the machines have to share the repairman’s capacity in the second layer. We are concerned with the dynamic control problem how the repairman should allocate his capacity to the machines at any point in time so that the long-term average (weighted) sum of the queue lengths of the ¿rst-layer queues is minimised. Since the optimal policy for the repairman cannot be found analytically due to the correlations in the queue lengths, we propose a near-optimal policy. We do this by combining intuition and results from queueing theory with techniques from Markov decision theory. Speci¿cally, we study the relative value functions for several policies for which the model can be decomposed in less complicated subsystems, and we combine the results with the classical one-step policy improvement algorithm. The resulting policy is easy to apply, scalable in the number of machines and is shown to be highly accurate over a wide range of parameter settings.

M3 - Report

T3 - Report Eurandom

BT - Dynamic server assignment in an extended machine-repair model

PB - Eurandom

CY - Eindhoven

ER -

Dorsman JL, Bhulai S, Vlasiou M. Dynamic server assignment in an extended machine-repair model. Eindhoven: Eurandom, 2012. 24 p. (Report Eurandom).