Abstract
We build on the recently introduced PDE-G-CNN framework, which proposed the concept of non-linear morphological convolutions that are motivated by solving HJB-PDEs on lifted homogeneous spaces such as the homogeneous space of 2D positions and orientations isomorphic to G= SE(2 ). PDE-G-CNNs generalize G-CNNs and are provably equivariant to actions of the roto-translation group SE(2). Moreover, PDE-G-CNNs automate geometric image processing via orientation scores and allow for a meaningful geometric interpretation. In this article, we show various functional properties of these networks: (1.)PDE-G-CNNs satisfy crucial geometric and algebraic symmetries: they are semiring quasilinear, equivariant, invariant under time scaling, isometric, and are solved by semiring group convolutions.(2.)PDE-G-CNNs exhibit a high degree of data efficiency: even under limited availability of training data they show a distinct gain in performance and generalize to unseen test cases from different datasets.(3.)PDE-G-CNNs are extendable to well-known convolutional architectures. We explore a UNet variant of PDE-G-CNNs which has a new equivariant U-Net structure with PDE-based morphological convolutions. We verify the properties and show favorable results on various datasets.
| Original language | English |
|---|---|
| Title of host publication | Geometric Science of Information |
| Subtitle of host publication | 6th International Conference, GSI 2023, St. Malo, France, August 30 – September 1, 2023, Proceedings, Part I |
| Editors | Frank Nielsen, Frédéric Barbaresco |
| Place of Publication | Cham |
| Publisher | Springer |
| Pages | 63–72 |
| Number of pages | 10 |
| ISBN (Electronic) | 978-3-031-38271-0 |
| ISBN (Print) | 978-3-031-38270-3 |
| DOIs | |
| Publication status | Published - 1 Aug 2023 |
| Event | 6th International Conference on Geometric Science of Information, GSI 2023 - St. Malo, France Duration: 30 Aug 2023 → 1 Sept 2023 |
Publication series
| Name | Lecture Notes in Computer Science (LNCS) |
|---|---|
| Volume | 14071 |
| ISSN (Print) | 0302-9743 |
| ISSN (Electronic) | 1611-3349 |
Conference
| Conference | 6th International Conference on Geometric Science of Information, GSI 2023 |
|---|---|
| Abbreviated title | GSI 2023 |
| Country/Territory | France |
| City | St. Malo |
| Period | 30/08/23 → 1/09/23 |
Funding
Acknowledgement. We gratefully acknowledge the Dutch Foundation of Science NWO for funding of VICI 2020 Exact Sciences (Duits, Geometric learning for Image Analysis VI.C. 202-031). The git repository containing the vanilla PDE-G-CNN implementations can be found at: https://gitlab.com/bsmetsjr/lietorch.
Keywords
- Group Equivariant Convolutional Neural Networks
- Lie Groups
- PDE-Based Image Processing
- Riemannian Geometry
- Semirings
Fingerprint
Dive into the research topics of 'Functional Properties of PDE-Based Group Equivariant Convolutional Neural Networks'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver