gms | German Medical Science

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA)

14.09. - 17.09.2016, Bern, Schweiz

Blueprinting and analysing confidence status, patient safety, ambition level and question type in single-choice questions (SCQ) of medical students’ neurology exam at Philipps-University Marburg

Meeting Abstract

  • corresponding author presenting/speaker Rafael Henrique Rangel - Marburg, Deutschland
  • Leona Möller - Marburg, Deutschland
  • Tina Stibane - Marburg, Deutschland
  • Adam Strzelczyk - Frankfurt, Deutschland

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA). Bern, 14.-17.09.2016. Düsseldorf: German Medical Science GMS Publishing House; 2016. DocP1-508

doi: 10.3205/16gma222, urn:nbn:de:0183-16gma2225

Veröffentlicht: 5. September 2016

© 2016 Rangel et al.
Dieser Artikel ist ein Open-Access-Artikel und steht unter den Lizenzbedingungen der Creative Commons Attribution 4.0 License (Namensnennung). Lizenz-Angaben siehe



Introduction: The purpose of this study is to evaluate if measuring students’ confidence may provide useful information and if it is influenced by patient safety, ambition level and question type.

Methods: Two reviewers rated question’s ambition complexity (low, medium, high), potential patient hazard (not relevant, risky to harmful) and question type in a blueprint model. 89 students participated in a 30 SCQ neurology exam and indicated their confidence status (CS) as very sure, sure, unsure or very unsure for each answered SCQ. Correct SCQ were classified as informed if CS was very sure or sure, or guessed if CS was unsure or very unsure. Incorrect responses were classified as misinformed if CS was very sure or sure and in uninformed if CS was unsure or very unsure. Additionally, sex, age and previous experience were assessed. Epidemiological data and mean confidence differences were analysed with linear regression model and repeated measure ANOVA.

Results: A total of 2670 responses were analysed and 1806 (68%) were classified as informed, 634 (24%) as guessed, 168 (6%) as uninformed and 62 (2%) as misinformed. Lower age (p=0.014) and male gender (p=0.004) had significant increasing influence on confidence. Mean confidence was not significantly associated with previous experience in neurology but was significantly higher (p<0.001) in negative SCQ comparing to positive SCQ (p<0.001). Mean confidence was significantly lower in new SCQ (p<0.001) than in SCQ used in prior exams, and significantly lower in SCQ with higher ambition level (p=0.001). Students did not show lower confidence in SCQ which might result in harmful patient hazard.

Discussion: Students’ CS allows to detect informed, guessed, misinformed and uninformed responses. CS is influenced by age, sex, ambition level and question type. Contrary to expectations, CS is not decreasing in questions which may contain potentially harmful facts.


Curtis DA, Lind SL, Boscardin CK, Dellinges M. Does student confidence on multiple-choice question assessments provide useful information? Med Educ. 2013;47(6):578-584. DOI: 10.1111/medu.12147 Externer Link
Pugsley L, McCrorie P. Improving medical education: Improving patient care. Teach Teach Educ. 2007;23(3):314-322. DOI: 10.1016/j.tate.2006.12.023 Externer Link
Burton RF. Misinformation, partial knowledge and guessing in true/false tests. Med Educ. 2002;36(9):805-811. DOI: 10.1046/j.1365-2923.2002.01299.x Externer Link
Berner ES, Graber ML. Overconfidence as a Cause of Diagnostic Error in Medicine. Am J Med. 2008;121(5 Suppl):S2-23. DOI: 10.1016/j.amjmed.2008.01.001 Externer Link
Wass V, van der Vleuten C, Shatzer J, Jones R. Assessment of clinical competence. Lancet. 2001;357(9260):945-949. DOI: 10.1016/S0140-6736(00)04221-5 Externer Link