A comprehensive comparison of additional benefit assessment methods applied by institute for quality and efficiency in health care and European Society for Medical Oncology for time-to-event endpoints after significant phase III trials

• Verfasst von: Büsch, Christopher [VerfasserIn]
• Verfasst von: Krisam, Johannes [VerfasserIn]
• Verfasst von: Kieser, Meinhard [VerfasserIn]
• Titel: A comprehensive comparison of additional benefit assessment methods applied by institute for quality and efficiency in health care and European Society for Medical Oncology for time-to-event endpoints after significant phase III trials
• Titelzusatz: a simulation study
• Verf.angabe: Christopher A. Büsch, Johannes Krisam, Meinhard Kieser
• E-Jahr: 2022
• Jahr: 28 October 2022
• Umfang: 10 S.
• Fussnoten: Online verfügbar 28. Juni 2022, Artikelversion 28. Oktober 2022 ; Gesehen am 14.03.2023
• Titel Quelle: Enthalten in: Value in health
• Ort Quelle: Amsterdam [u.a.] : Elsevier, 1998
• Jahr Quelle: 2022
• Band/Heft Quelle: 25(2022), 11 vom: Okt., Seite 1853-1862
• ISSN Quelle: 1524-4733
• DOI: doi:10.1016/j.jval.2022.05.015
• Datenträger: Online-Ressource
• Sprache: eng
• Sach-SW: additional benefit assessment
• Sach-SW: clinical phase III trials
• Sach-SW: oncology trials
• Sach-SW: survival analysis
• K10plus-PPN: 1839123745

Abstract

Objectives - After a successful Marketing Authorization Application for clinical trials with time-to-event endpoints, the degree of the added benefit from new treatments remains unknown and needs to be assessed. Unfortunately, until now no clear definition for added benefit determination of a treatment exists. Nevertheless, European authorities / societies have developed 2 “additional benefit assessment” methods, which have up to now not been compared: the European Society for Medical Oncology (ESMO) developed a dual rule considering relative and absolute benefit. The German Institute for Quality and Efficiency in Health Care (IQWiG) developed a method using upper 95% hazard ratio confidence interval. - Methods - We evaluate and compare both methods in an extensive simulation study including different censoring rates, failure time distributions, and treatment effects for sample size calculation. The methods’ performance is assessed via Receiver Operating Characteristic curves, Spearman correlation, and percentage of achieved maximal scores. - Results - The results show that IQWiG’s method has in many situations a lower maximal scoring proportion than ESMO’s rule, that is, up to 28.5% versus 94.7%. Various failure time distributions lead to strongly changed maximal scoring percentages for ESMO. High positive correlation between the methods is present for moderate treatment effects. - Conclusions - IQWiG’s method is usually more conservative than ESMO’s. ESMO’s rule tends to be more susceptible for various failure time distributions. Using the lower confidence interval limit seems to be a better solution resulting in a higher true-positive rate without increasing the false-positive rate. Thus, IQWiG’s method might need to be adapted accordingly to achieve a better overall classification.