SuperCUT, an unsupervised multimodal image registration with deep learning for biomedical microscopy

Grexa, István and Iván, Zsanett Zsófia and Migh, Ede and Kovács, Ferenc and Bolck, Hella A and Zheng, Xiang and Mund, Andreas and Moshkov, Nikita and Csapóné Miczán, Vivien and Koós, Krisztián and Horváth, Péter (2024) SuperCUT, an unsupervised multimodal image registration with deep learning for biomedical microscopy. BRIEFINGS IN BIOINFORMATICS, 25 (2). No.-bbae029. ISSN 1467-5463

Preview

Text GrexaI_SuperCUT.pdf - Published Version Available under License Creative Commons Attribution Non-commercial. Download (1MB) | Preview

Abstract

Numerous imaging techniques are available for observing and interrogating biological samples, and several of them can be used consecutively to enable correlative analysis of different image modalities with varying resolutions and the inclusion of structural or molecular information. Achieving accurate registration of multimodal images is essential for the correlative analysis process, but it remains a challenging computer vision task with no widely accepted solution. Moreover, supervised registration methods require annotated data produced by experts, which is limited. To address this challenge, we propose a general unsupervised pipeline for multimodal image registration using deep learning. We provide a comprehensive evaluation of the proposed pipeline versus the current state-of-the-art image registration and style transfer methods on four types of biological problems utilizing different microscopy modalities. We found that style transfer of modality domains paired with fully unsupervised training leads to comparable image registration accuracy to supervised methods and, most importantly, does not require human intervention.

Actions (login required)

Edit Item