gms | German Medical Science

65th Annual Meeting of the German Association for Medical Informatics, Biometry and Epidemiology (GMDS), Meeting of the Central European Network (CEN: German Region, Austro-Swiss Region and Polish Region) of the International Biometric Society (IBS)

06.09. - 09.09.2020, Berlin (online conference)

Adaptive designs with unblinded sample size re-estimation for diagnostic accuracy studies

Meeting Abstract

Search Medline for

  • Denise Köster - Department of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
  • Annika Hoyer - Departement of Statistics, Ludwig-Maximilians-University Munich, Munich, Germany
  • Antonia Zapf - Department of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany

Deutsche Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie. 65th Annual Meeting of the German Association for Medical Informatics, Biometry and Epidemiology (GMDS), Meeting of the Central European Network (CEN: German Region, Austro-Swiss Region and Polish Region) of the International Biometric Society (IBS). Berlin, 06.-09.09.2020. Düsseldorf: German Medical Science GMS Publishing House; 2021. DocAbstr. 419

doi: 10.3205/20gmds326, urn:nbn:de:0183-20gmds3265

Published: February 26, 2021

© 2021 Köster et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Outline

Text

Background: Diagnostic studies aim to estimate the proportion of correctly classified diseased and non-diseased individuals, namely sensitivity and specificity. To evaluate a diagnostic test, its effectiveness is compared to either a reference standard, which defines the true disease status, or to a standard test. If there is no standard test as a comparator, the aim is to demonstrate a pre-specified minimum sensitivity and specificity of the experimental test. If there is a standard test, both tests and the reference standard should be applied in all study participants if it is ethically acceptable and feasible [1]. Otherwise, the two tests should be randomly assigned and the reference standard should be used in all. This results in three study designs: the single-test, and the paired or unpaired two-tests design.

Methods: As in any clinical trial, a sample size calculation should be performed to avoid including too many or too few individuals. However, assumptions for the sample size planning are often uncertain. Reasons for biased estimates in diagnostic accuracy studies are analysed in Rutjes et al. [2]. Long-established methods for adaptive designs with sample size re-estimation from the field of interventional studies [3] have not yet been transferred to diagnostic studies with the particularity of co-primary endpoints.

Results: In this talk, a corresponding approach for the unblinded sample size re-estimation, which is applicable for all three designs, will be presented and illustrated by an example study. Furthermore, the results of a comprehensive simulation study will be presented, and the potential and limitations of the method will be discussed.

Conclusion: Adaptive designs with unblinded sample size re-estimation in diagnostic accuracy studies are a helpful tool to obtain efficient studies and reliable results.

The authors declare that they have no competing interests.

The authors declare that an ethics committee vote is not required.


References

1.
EMA. Guideline on clinical evaluation of diagnostic agents. Doc. Ref. CPMP/ EWP/1119/98/Rev.1. [date of last access 14/04/19]. Available from: http://www.ema.europa.eu/docs/en_GB/ document _library/ Scientific_guideline/2009/09/WC500003580.pdf External link
2.
Rutjes AW, Reitsma JB, Di Nisio M, Smidt N, van Rijn JC, Bossuyt PM. Evidence of bias and variation in diagnostic accuracy studies. CMAJ. 2006;174(4):469-76.
3.
Wassmer G, Brannath W. Group sequential and confirmatory adaptive designs in clinical trials. Heidelberg: Springer; 2016.