Large language models as a diagnostic support tool in neuropathology

• Verfasst von: Hewitt, Katherine J. [VerfasserIn]
• Verfasst von: Wiest, Isabella [VerfasserIn]
• Verfasst von: Carrero, Zunamys I [VerfasserIn]
• Verfasst von: Bejan, Laura [VerfasserIn]
• Verfasst von: Millner, Thomas O. [VerfasserIn]
• Verfasst von: Brandner, Sebastian [VerfasserIn]
• Verfasst von: Kather, Jakob Nikolas [VerfasserIn]
• Titel: Large language models as a diagnostic support tool in neuropathology
• Verf.angabe: Katherine J. Hewitt, Isabella C. Wiest, Zunamys I. Carrero, Laura Bejan, Thomas O. Millner, Sebastian Brandner and Jakob Nikolas Kather
• E-Jahr: 2024
• Jahr: November 2024
• Umfang: 7 S.
• Fussnoten: Online veröffentlicht: 06 November 2024 ; Gesehen am 25.04.2025
• Titel Quelle: Enthalten in: The journal of pathology: clinical research
• Ort Quelle: Chichester : Wiley, 2015
• Jahr Quelle: 2024
• Band/Heft Quelle: 10(2024), 6, Artikel-ID e70009, Seite 1-7
• ISSN Quelle: 2056-4538
• DOI: doi:10.1002/2056-4538.70009
• Datenträger: Online-Ressource
• Sprache: eng
• Bibliogr. Hinweis: Ergänzung: Koga, Shunsuke: Retrieval-augmented generation versus document-grounded generation
• Sach-SW: adult-type diffuse gliomas
• Sach-SW: decision support tools
• Sach-SW: large language models
• Sach-SW: neuropathology
• K10plus-PPN: 1923693131

Abstract

The WHO guidelines for classifying central nervous system (CNS) tumours are changing considerably with each release. The classification of CNS tumours is uniquely complex among most other solid tumours as it incorporates not just morphology, but also genetic and epigenetic features. Keeping current with these changes across medical fields can be challenging, even for clinical specialists. Large language models (LLMs) have demonstrated their ability to parse and process complex medical text, but their utility in neuro-oncology has not been systematically tested. We hypothesised that LLMs can effectively diagnose neuro-oncology cases from free-text histopathology reports according to the latest WHO guidelines. To test this hypothesis, we evaluated the performance of ChatGPT-4o, Claude-3.5-sonnet, and Llama3 across 30 challenging neuropathology cases, which each presented a complex mix of morphological and genetic information relevant to the diagnosis. Furthermore, we integrated these models with the latest WHO guidelines through Retrieval-Augmented Generation (RAG) and again assessed their diagnostic accuracy. Our data show that LLMs equipped with RAG, but not without RAG, can accurately diagnose the neuropathological tumour subtype in 90% of the tested cases. This study lays the groundwork for a new generation of computational tools that can assist neuropathologists in their daily reporting practice.