The Train Unit Shunting Problem (TUSP) is a difficult sequential decision making problem faced by Dutch Railways (NS). Current heuristic solutions under study at NS fall short in accounting for uncertainty during plan execution and do not efficiently support replanning. Furthermore, the resulting plans lack consistency. We approach the TUSP by formulating it as a Markov Decision Process and develop an image-like state space representation that allows us to develop a Deep Reinforcement Learning (DRL) solution. The Deep Q-Network efficiently reduces the state space and develops an on-line strategy for the TUSP capable of dealing with uncertainty and delivering significantly more consistent solutions compared to approaches currently being developed by NS.
|Title of host publication||2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC)|
|Number of pages||6|
|Publication status||Published - 2018|
|Event||2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC2018) - Miyazaki, Japan|
Duration: 7 Oct 2018 → 10 Oct 2018
|Conference||2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC2018)|
|Period||7/10/18 → 10/10/18|