Abstract
We build on the recently introduced PDE-G-CNN framework, which proposed the concept of non-linear morphological convolutions that are motivated by solving HJB-PDEs on lifted homogeneous spaces such as the homogeneous space of 2D positions and orientations isomorphic to G= SE(2 ). PDE-G-CNNs generalize G-CNNs and are provably equivariant to actions of the roto-translation group SE(2). Moreover, PDE-G-CNNs automate geometric image processing via orientation scores and allow for a meaningful geometric interpretation. In this article, we show various functional properties of these networks: (1.)PDE-G-CNNs satisfy crucial geometric and algebraic symmetries: they are semiring quasilinear, equivariant, invariant under time scaling, isometric, and are solved by semiring group convolutions.(2.)PDE-G-CNNs exhibit a high degree of data efficiency: even under limited availability of training data they show a distinct gain in performance and generalize to unseen test cases from different datasets.(3.)PDE-G-CNNs are extendable to well-known convolutional architectures. We explore a UNet variant of PDE-G-CNNs which has a new equivariant U-Net structure with PDE-based morphological convolutions. We verify the properties and show favorable results on various datasets.
Original language | English |
---|---|
Title of host publication | Geometric Science of Information |
Subtitle of host publication | 6th International Conference, GSI 2023, St. Malo, France, August 30 – September 1, 2023, Proceedings, Part I |
Editors | Frank Nielsen, Frédéric Barbaresco |
Place of Publication | Cham |
Publisher | Springer |
Pages | 63–72 |
Number of pages | 10 |
ISBN (Electronic) | 978-3-031-38271-0 |
ISBN (Print) | 978-3-031-38270-3 |
DOIs | |
Publication status | Published - 1 Aug 2023 |
Event | 6th International Conference on Geometric Science of Information, GSI 2023 - St. Malo, France Duration: 30 Aug 2023 → 1 Sept 2023 |
Publication series
Name | Lecture Notes in Computer Science (LNCS) |
---|---|
Volume | 14071 |
ISSN (Print) | 0302-9743 |
ISSN (Electronic) | 1611-3349 |
Conference
Conference | 6th International Conference on Geometric Science of Information, GSI 2023 |
---|---|
Abbreviated title | GSI 2023 |
Country/Territory | France |
City | St. Malo |
Period | 30/08/23 → 1/09/23 |
Funding
Acknowledgement. We gratefully acknowledge the Dutch Foundation of Science NWO for funding of VICI 2020 Exact Sciences (Duits, Geometric learning for Image Analysis VI.C. 202-031). The git repository containing the vanilla PDE-G-CNN implementations can be found at: https://gitlab.com/bsmetsjr/lietorch.
Keywords
- Group Equivariant Convolutional Neural Networks
- Lie Groups
- PDE-Based Image Processing
- Riemannian Geometry
- Semirings