TY - JOUR
T1 - Invariant-Based World Models for Robust Robotic Systems Demonstrated on an Autonomous Football Table
AU - Senden, Jordy
AU - Jebbink, Kevin
AU - Bruyninckx, Herman
AU - van de Molengraft, René
PY - 2022/7/1
Y1 - 2022/7/1
N2 - This work explains the use of invariants in robotic perception and control skills. An 'invariant' is a mathematical constraint that remains unchanged under a particular transformation in a system. This property makes robotic functionalities more robust against 'disturbances' that cause these transformation. These invariants are stored in a world model (WM), which has a central role in the information architecture of the robot to share information between components. A 'robotic' football table serves as an example to illustrate the effectiveness of invariants. Despite looking different, all standard football tables satisfy the same set of invariants; the common layout of the field, line markings and puppets, which are not identical but satisfy the same set of constraints, such as parallelism, partial ordering, and relative colour and intensity differences between objects. During initialization, the invariants are actively identified and saved to the world model. During game play this world model is used by the perception and action skills and is updated when necessary. This work shows how the use of invariants creates robustness against variation in placement of the perception system and against variation in table dimensions and colours. When the camera is misaligned or moved mid-play, the world model is updated to ensure a smooth continuation of the game. The approach is tested on three standard football tables, with different dimensions and colours, showing that the approach is robust on standard tables that adhere to the invariants.
AB - This work explains the use of invariants in robotic perception and control skills. An 'invariant' is a mathematical constraint that remains unchanged under a particular transformation in a system. This property makes robotic functionalities more robust against 'disturbances' that cause these transformation. These invariants are stored in a world model (WM), which has a central role in the information architecture of the robot to share information between components. A 'robotic' football table serves as an example to illustrate the effectiveness of invariants. Despite looking different, all standard football tables satisfy the same set of invariants; the common layout of the field, line markings and puppets, which are not identical but satisfy the same set of constraints, such as parallelism, partial ordering, and relative colour and intensity differences between objects. During initialization, the invariants are actively identified and saved to the world model. During game play this world model is used by the perception and action skills and is updated when necessary. This work shows how the use of invariants creates robustness against variation in placement of the perception system and against variation in table dimensions and colours. When the camera is misaligned or moved mid-play, the world model is updated to ensure a smooth continuation of the game. The approach is tested on three standard football tables, with different dimensions and colours, showing that the approach is robust on standard tables that adhere to the invariants.
KW - Calibration and identification
KW - computer vision for automation
KW - mapping
KW - object detection
KW - segmentation and categorization
KW - semantic scene understanding
UR - http://www.scopus.com/inward/record.url?scp=85133688799&partnerID=8YFLogxK
U2 - 10.1109/LRA.2022.3185767
DO - 10.1109/LRA.2022.3185767
M3 - Article
AN - SCOPUS:85133688799
SN - 2377-3766
VL - 7
SP - 8542
EP - 8549
JO - IEEE Robotics and Automation Letters
JF - IEEE Robotics and Automation Letters
IS - 3
M1 - 9804782
ER -