Abstract
In this paper we propose a Deep Reinforcement Learning approach to solve a multimodal transportation planning problem, in which containers must be assigned to a truck or to trains that will transport them to their destination. While traditional planning methods work "offline" (i.e., they take decisions for a batch of containers before the transportation starts), the proposed approach is "online", in that it can take decisions for individual containers, while transportation is being executed. Planning transportation online helps to effectively respond to unforeseen events that may affect the original transportation plan, thus supporting companies in lowering transportation costs. We implemented different container selection heuristics within the proposed Deep Reinforcement Learning algorithm and we evaluated its performance for each heuristic using data that simulate a realistic scenario, designed on the basis of a real case study at a logistics company. The experimental results revealed that the proposed method was able to learn effective patterns of container assignment. It out-performed tested competitors in terms of total transportation costs and utilization of train capacity by 20.48% to 55.32% for the cost and by 7.51% to 20.54% for the capacity. Furthermore, it obtained results within 2.7% for the cost and 0.72% for the capacity of the optimal solution generated by an Integer Linear Programming solver in an offline setting.
Original language | English |
---|---|
Title of host publication | 2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021 |
Publisher | Institute of Electrical and Electronics Engineers |
Pages | 1691-1698 |
Number of pages | 8 |
ISBN (Electronic) | 978-1-6654-4207-7 |
ISBN (Print) | 978-1-6654-4208-4 |
DOIs | |
Publication status | Published - 6 Jan 2022 |
Event | 2021 IEEE International Conference on Systems, Man and Cybernetics, IEEE SMC 2021 - Virtual, Melbourne, Australia Duration: 17 Oct 2021 → 20 Oct 2021 http://ieeesmc2021.org/ |
Conference
Conference | 2021 IEEE International Conference on Systems, Man and Cybernetics, IEEE SMC 2021 |
---|---|
Abbreviated title | IEEE SMC 2021 |
Country/Territory | Australia |
City | Melbourne |
Period | 17/10/21 → 20/10/21 |
Internet address |
Keywords
- Optimization
- Deep Reinforcement Learning
- Multimodal Transportation
- Online Planning