On the Role of Models in Learning Control: Actor-Critic Iterative Learning Control

Research output: Contribution to conferencePaperAcademic

Abstract

Learning from data of past tasks can substantially improve the accuracy of mechatronic systems. Often, for fast and safe learning a model of the system is required. The aim of this paper is to develop a model-free approach for fast and safe learning for mechatronic systems. The developed actor-critic iterative learning control (ACILC) framework uses a feedforward parameterization with basis functions. These basis functions encode implicit model knowledge and the actor-critic algorithm learns the feedforward parameters without explicitly using a model. Experimental results on a printer setup demonstrate that the developed ACILC framework is capable of achieving the same feedforward signal as preexisting model-based methods without using explicit model knowledge.
Original languageEnglish
Publication statusAccepted/In press - 2020
Event21st IFAC World Congress 2020 - Berlin, Germany
Duration: 12 Jul 202017 Jul 2020
https://www.ifac2020.org/

Conference

Conference21st IFAC World Congress 2020
CountryGermany
CityBerlin
Period12/07/2017/07/20
Internet address

Keywords

  • Feedforward control
  • Iterative learning control
  • Learning control
  • Reinforcement learning
  • Function approximation
  • Model-free control
  • Model-based control
  • Markov decision problems

Fingerprint Dive into the research topics of 'On the Role of Models in Learning Control: Actor-Critic Iterative Learning Control'. Together they form a unique fingerprint.

Cite this