Abstract
We study the problem of inspection and maintenance planning of capital goods based on observations of the capital good’s degradation state. However, the observations are imprecise, and their quality depends on the environment. For example, when performing maintenance for Heating, Ventilation, and Air-Conditioning units (HVACs) in trains, the health of the cooling component of an HVAC can be assessed from temperature readouts of the car in which the HVAC is mounted. Temperature information is useful in the summer when high car temperatures can indicate a failed cooling component, but this information has limited value during the winter. We model the problem as a partially observable Markov decision process with a fully observed environment. We analytically show that an environment-dependent monotonic at-most-4-region policy is optimal. Furthermore, we numerically analyze an example motivated by HVAC maintenance at Dutch Railways. This analysis shows that, in many cases, including the environment in the model can lead to cost savings of more than 10%. In a broad numerical experiment, we show that a simple policy cannot always substitute an optimal policy.
Original language | English |
---|---|
Pages (from-to) | 1146-1161 |
Number of pages | 16 |
Journal | IISE Transactions |
Volume | 56 |
Issue number | 11 |
Early online date | 11 Sept 2023 |
DOIs | |
Publication status | Published - 2024 |
Bibliographical note
Publisher Copyright:© Copyright © 2023 The Author(s). Published with license by Taylor & Francis Group, LLC.
Funding
This research has been funded by NWO under the grant PrimaVera NWA.1160.18.238. We thank Nick Oosterhof and Ton Hamberg of Dutch Railways for introducing us to the HVAC maintenance scheduling problem and sharing their insights with regard to this. The support of Roshan Kotian and Han Verbiesen, of the high performance computing lab of Eindhoven University of Technology, was invaluable for setting up the online environment for the numerical experiments. We wish to thank the Department Editor, the Associate Editor, and the two reviewers whose comments and feedback have helped improve this paper.
Keywords
- environment-dependent information
- incomplete information
- inspection planning
- maintenance optimization
- Partially observable Markov decision process
- random environment