Integration of deep learning-based image analysis and genomic data in cancer pathology

• Verfasst von: Schneider, Lucas [VerfasserIn]
• Verfasst von: Laiouar-Pedari, Sara [VerfasserIn]
• Verfasst von: Kuntz, Sara [VerfasserIn]
• Verfasst von: Krieghoff-Henning, Eva [VerfasserIn]
• Verfasst von: Hekler, Achim [VerfasserIn]
• Verfasst von: Kather, Jakob Nikolas [VerfasserIn]
• Verfasst von: Gaiser, Timo [VerfasserIn]
• Verfasst von: Fröhling, Stefan [VerfasserIn]
• Verfasst von: Brinker, Titus Josef [VerfasserIn]
• Titel: Integration of deep learning-based image analysis and genomic data in cancer pathology
• Titelzusatz: a systematic review
• Verf.angabe: Lucas Schneider, Sara Laiouar-Pedari, Sara Kuntz, Eva Krieghoff-Henning, Achim Hekler, Jakob N. Kather, Timo Gaiser, Stefan Fröhling, Titus J. Brinker
• Jahr: 2022
• Umfang: 12 S.
• Fussnoten: Available online 19 November 2021 ; Gesehen am 27.06.2022
• Titel Quelle: Enthalten in: European journal of cancer
• Ort Quelle: Amsterdam [u.a.] : Elsevier, 1992
• Jahr Quelle: 2022
• Band/Heft Quelle: 160(2022) vom: Jan., Seite 80-91
• ISSN Quelle: 1879-0852
• DOI: doi:10.1016/j.ejca.2021.10.007
• Datenträger: Online-Ressource
• Sprache: eng
• Sach-SW: Biomarker identification
• Sach-SW: Cancer
• Sach-SW: Convolutional neural networks
• Sach-SW: Multimodal fusion
• Sach-SW: Omics
• K10plus-PPN: 1807840972

Abstract

Background - Over the past decade, the development of molecular high-throughput methods (omics) increased rapidly and provided new insights for cancer research. In parallel, deep learning approaches revealed the enormous potential for medical image analysis, especially in digital pathology. Combining image and omics data with deep learning tools may enable the discovery of new cancer biomarkers and a more precise prediction of patient prognosis. This systematic review addresses different multimodal fusion methods of convolutional neural network-based image analyses with omics data, focussing on the impact of data combination on the classification performance. - Methods - PubMed was screened for peer-reviewed articles published in English between January 2015 and June 2021 by two independent researchers. Search terms related to deep learning, digital pathology, omics, and multimodal fusion were combined. - Results - We identified a total of 11 studies meeting the inclusion criteria, namely studies that used convolutional neural networks for haematoxylin and eosin image analysis of patients with cancer in combination with integrated omics data. Publications were categorised according to their endpoints: 7 studies focused on survival analysis and 4 studies on prediction of cancer subtypes, malignancy or microsatellite instability with spatial analysis. - Conclusions - Image-based classifiers already show high performances in prognostic and predictive cancer diagnostics. The integration of omics data led to improved performance in all studies described here. However, these are very early studies that still require external validation to demonstrate their generalisability and robustness. Further and more comprehensive studies with larger sample sizes are needed to evaluate performance and determine clinical benefits.