Projects per year
Abstract
Distal myopathy represents a genetically heterogeneous group of skeletal muscle disorders with broad clinical manifestations, posing diagnostic challenges in radiology. To address this, we propose a novel multimodal attention-aware fusion architecture that combines features extracted from two distinct deep learning models, one capturing global contextual information and the other focusing on local details, representing complementary aspects of the input data. Uniquely, our approach integrates these features through an attention gate mechanism, enhancing both predictive performance and interpretability. Our method achieves a high classification accuracy on the BUSI benchmark and a proprietary distal myopathy dataset, while also generating clinically relevant saliency maps that support transparent decision-making in medical diagnosis. We rigorously evaluated interpretability through (1) functionally grounded metrics, coherence scoring against reference masks and incremental deletion analysis, and (2) application-grounded validation with seven expert radiologists. While our fusion strategy boosts predictive performance relative to single-stream and alternative fusion strategies, both quantitative and qualitative evaluations reveal persistent gaps in anatomical specificity and clinical usefulness of the interpretability. These findings highlight the need for richer, context-aware interpretability methods and human-in-the-loop feedback to meet clinicians' expectations in real-world diagnostic settings.
| Original language | English |
|---|---|
| Publisher | arXiv.org |
| Number of pages | 24 |
| Volume | 2508.01316 |
| Publication status | Published - 2 Aug 2025 |
Keywords
- cs.CV
- cs.HC
Fingerprint
Dive into the research topics of 'Multimodal Attention-Aware Fusion for Diagnosing Distal Myopathy: Evaluating Model Interpretability and Clinician Trust'. Together they form a unique fingerprint.Projects
- 1 Active
-
ENFIELD: European Lighthouse to Manifest Trustworthy and Green AI
Van Gorp, P. (Project Manager), Zhang, C. (Project member), Grau Garcia, I. (Project member) & Baer, G. (Project member)
1/09/23 → 31/12/26
Project: Third tier
Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver