Online Multimodal Transportation Planning using Deep Reinforcement Learning

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

6 Citations (Scopus)
4 Downloads (Pure)

Abstract

In this paper we propose a Deep Reinforcement Learning approach to solve a multimodal transportation planning problem, in which containers must be assigned to a truck or to trains that will transport them to their destination. While traditional planning methods work "offline" (i.e., they take decisions for a batch of containers before the transportation starts), the proposed approach is "online", in that it can take decisions for individual containers, while transportation is being executed. Planning transportation online helps to effectively respond to unforeseen events that may affect the original transportation plan, thus supporting companies in lowering transportation costs. We implemented different container selection heuristics within the proposed Deep Reinforcement Learning algorithm and we evaluated its performance for each heuristic using data that simulate a realistic scenario, designed on the basis of a real case study at a logistics company. The experimental results revealed that the proposed method was able to learn effective patterns of container assignment. It out-performed tested competitors in terms of total transportation costs and utilization of train capacity by 20.48% to 55.32% for the cost and by 7.51% to 20.54% for the capacity. Furthermore, it obtained results within 2.7% for the cost and 0.72% for the capacity of the optimal solution generated by an Integer Linear Programming solver in an offline setting.
Original languageEnglish
Title of host publication2021 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2021
PublisherInstitute of Electrical and Electronics Engineers
Pages1691-1698
Number of pages8
ISBN (Electronic)978-1-6654-4207-7
ISBN (Print)978-1-6654-4208-4
DOIs
Publication statusPublished - 6 Jan 2022
Event2021 IEEE International Conference on Systems, Man and Cybernetics, IEEE SMC 2021 - Virtual, Melbourne, Australia
Duration: 17 Oct 202120 Oct 2021
http://ieeesmc2021.org/

Conference

Conference2021 IEEE International Conference on Systems, Man and Cybernetics, IEEE SMC 2021
Abbreviated titleIEEE SMC 2021
Country/TerritoryAustralia
CityMelbourne
Period17/10/2120/10/21
Internet address

Keywords

  • Optimization
  • Deep Reinforcement Learning
  • Multimodal Transportation
  • Online Planning

Fingerprint

Dive into the research topics of 'Online Multimodal Transportation Planning using Deep Reinforcement Learning'. Together they form a unique fingerprint.

Cite this