Multistep networks for deformable multimodal medical image registration

• Verfasst von: Strittmatter, Anika [VerfasserIn]
• Verfasst von: Zöllner, Frank G. [VerfasserIn]
• Titel: Multistep networks for deformable multimodal medical image registration
• Verf.angabe: Anika Strittmatter and Frank G. Zöllner, (Senior Member, IEEE)
• E-Jahr: 2024
• Jahr: 11 June 2024
• Umfang: 17 S.
• Illustrationen: Illustrationen
• Fussnoten: Gesehen am 22.10.2024
• Titel Quelle: Enthalten in: Institute of Electrical and Electronics EngineersIEEE access
• Ort Quelle: New York, NY : IEEE, 2013
• Jahr Quelle: 2024
• Band/Heft Quelle: 12(2024), Seite 82676-82692
• ISSN Quelle: 2169-3536
• DOI: doi:10.1109/ACCESS.2024.3412216
• Datenträger: Online-Ressource
• Sprache: eng
• Sach-SW: Biomedical imaging
• Sach-SW: Computed tomography
• Sach-SW: Deep learning
• Sach-SW: Deformation
• Sach-SW: image registration
• Sach-SW: Image registration
• Sach-SW: Kidney
• Sach-SW: Liver
• Sach-SW: machine learning
• Sach-SW: Medical diagnostic imaging
• Sach-SW: medical images
• Sach-SW: multimodal data
• Sach-SW: multistep
• Sach-SW: Spatial resolution
• K10plus-PPN: 1906382433

Abstract

We proposed neural networks for deformable multimodal medical image registration that use multiple steps and varying resolutions. The networks were trained jointly in an unsupervised manner with Mutual Information and Gradient L2 loss. By comparing the multistep neural networks to each other and to a monostep/monoresolution network as a benchmark and the classical registration methods SimpleElastix and NiftyReg as a baseline, we investigated the impact of using multiple resolutions on the registration result. To assess the performance of the multistep networks, we used four three-dimensional multimodal datasets (a synthetic and an in-vivo liver dataset with CT and T1-weighted MR scans, an in-vivo kidney MR dataset with T1-weighted and T2-weighted MR scans and an in-vivo prostate MR dataset with T2-weighted and DWI MR scans). Experimental results showed that incorporating multiple steps and resolutions in a neural network leads to registration results with high structural similarity (NMI up to 0.33 ± 0.02, Dice up to 90.8 ± 3.1) and minimal image folding (|J \vert łe 0 : less than 0.5%), resulting in a medically plausible transformation, while maintaining a low registration time (<0.5 s). Moreover, our results demonstrate that spatial alignment improves with more resolutions/steps (up to 4 in this study), and multistep networks outperform monostage/monoresolution networks.