Functional Properties of PDE-Based Group Equivariant Convolutional Neural Networks

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

1 Citation (Scopus)

Abstract

We build on the recently introduced PDE-G-CNN framework, which proposed the concept of non-linear morphological convolutions that are motivated by solving HJB-PDEs on lifted homogeneous spaces such as the homogeneous space of 2D positions and orientations isomorphic to G= SE(2 ). PDE-G-CNNs generalize G-CNNs and are provably equivariant to actions of the roto-translation group SE(2). Moreover, PDE-G-CNNs automate geometric image processing via orientation scores and allow for a meaningful geometric interpretation. In this article, we show various functional properties of these networks: (1.)PDE-G-CNNs satisfy crucial geometric and algebraic symmetries: they are semiring quasilinear, equivariant, invariant under time scaling, isometric, and are solved by semiring group convolutions.(2.)PDE-G-CNNs exhibit a high degree of data efficiency: even under limited availability of training data they show a distinct gain in performance and generalize to unseen test cases from different datasets.(3.)PDE-G-CNNs are extendable to well-known convolutional architectures. We explore a UNet variant of PDE-G-CNNs which has a new equivariant U-Net structure with PDE-based morphological convolutions. We verify the properties and show favorable results on various datasets.

Original languageEnglish
Title of host publicationGeometric Science of Information
Subtitle of host publication6th International Conference, GSI 2023, St. Malo, France, August 30 – September 1, 2023, Proceedings, Part I
EditorsFrank Nielsen, Frédéric Barbaresco
Place of PublicationCham
PublisherSpringer
Pages63–72
Number of pages10
ISBN (Electronic)978-3-031-38271-0
ISBN (Print)978-3-031-38270-3
DOIs
Publication statusPublished - 1 Aug 2023
Event6th International Conference on Geometric Science of Information, GSI 2023 - St. Malo, France
Duration: 30 Aug 20231 Sept 2023

Publication series

NameLecture Notes in Computer Science (LNCS)
Volume14071
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference6th International Conference on Geometric Science of Information, GSI 2023
Abbreviated titleGSI 2023
Country/TerritoryFrance
CitySt. Malo
Period30/08/231/09/23

Funding

Acknowledgement. We gratefully acknowledge the Dutch Foundation of Science NWO for funding of VICI 2020 Exact Sciences (Duits, Geometric learning for Image Analysis VI.C. 202-031). The git repository containing the vanilla PDE-G-CNN implementations can be found at: https://gitlab.com/bsmetsjr/lietorch.

Keywords

  • Group Equivariant Convolutional Neural Networks
  • Lie Groups
  • PDE-Based Image Processing
  • Riemannian Geometry
  • Semirings

Fingerprint

Dive into the research topics of 'Functional Properties of PDE-Based Group Equivariant Convolutional Neural Networks'. Together they form a unique fingerprint.

Cite this