Skip to search boxSkip to navigationSkip to main content

AI Multi-modal Sensing

Introduction

The AIMS lab researches and develops AI models for systems equipped with sensors of multiple different modalities. We foster expertise in AI analysis of RGB, thermal, depth, LiDAR, acoustic, sonar and radar sensor data. When the multi-modal sensors are combined in a sensor suite, they often provide capabilities similar to the human ‘5-sense system’, which bring the desired full situational awareness. This awareness is vital in our industrial partners in public safety & security, smart cities, defense, critical infrastructure inspection and intelligent transportation.

Profile

The AIMS lab specializes in advanced artificial intelligence methods for multi-modal sensor systems, enabling machines to perceive and interpret complex environments in real-time through the fusion of heterogeneous data sources. The core objective of the lab is to advance the real-time fusion and interpretation of multi-modal data through cutting-edge AI techniques. The research focuses on few-shot, unsupervised and self-supervised learning, casual reasoning, 4D gaussian splatting, embodied AI, and efficient edge deployment. By integrating these approaches, the lab develops methods capable of detecting events across modalities, localizing threats and objects in 3D space, and identifying abnormal patterns without requiring extensive labeled datasets.

UN SDGs

In 2015, UN member states agreed to 17 global Sustainable Development Goals (SDGs) to end poverty, protect the planet and ensure prosperity for all. This organisational unit’s work contributes to the following SDG(s):