gms | German Medical Science

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA)

05.10. - 08.10.2011, München

Implementation of a Situational Judgement Test into the student selection procedure at the Medical University of Graz: two years of experience


Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA). München, 05.-08.10.2011. Düsseldorf: German Medical Science GMS Publishing House; 2011. Doc11gma086

doi: 10.3205/11gma086, urn:nbn:de:0183-11gma0866

Veröffentlicht: 26. September 2011

© 2011 Manhal et al.
Dieser Artikel ist ein Open Access-Artikel und steht unter den Creative Commons Lizenzbedingungen ( Er darf vervielfältigt, verbreitet und öffentlich zugänglich gemacht werden, vorausgesetzt dass Autor und Quelle genannt werden.



Question: Since the introduction of student selection procedures at Austrian medical universities it had been demanded not to solely focus on basic knowledge in natural sciences but also to take psychosocial aspects into account when testing interested applicants for the studies of human medicine or dentistry. Due to this request the Medical University of Graz developed a Situational Judgement Test (SJT) with emphasis on relevant medical social interactions and introduced it to the admission test whose prognostic validity already has been shown [1], [2]. Situational Judgement Tests have been well known procedures in personnel selection for decades and are adaptable to the selection of students as well [3], [4]. They typically consist of items comprising a short description of a controversial situation, a so called critical incident, and response statements. The best response has to be selected by the candidate.

Methods: At the Medical University of Graz students‘ narrations of critical incidents had been collected during the year 2010 and instructors‘ description of critical incidents during 2011. These reports were used as basis for the development of items for the SJT which was done by an interprofessional group of medical teachers and other professionals. In 2010 twenty items with five alternative responses each were implemented into the selection procedure. 1350 applicants (729 female, 621 male) answered to these items. All items underwent postest analyses. To measure their psychometric quality item analyses were performed. Additionally all applicants evaluated the selection procedure at the Medical University of Graz so that acceptance and benefit of the SJT could be assessed.

Result: Post test analyses showed satisfactory test characteristics with item difficulties 0.55<=P<=0.99 and item selectivity 0.13<=rit<=0.39. Applicants‘ evaluation of the selection procedure at the Medical University of Graz indicate that the majority approved of the introductioin of the SJT into the test and considered this part as most important for their training as a physician/dentist and for their future professional life although they said that the SJT had been the easiest part of the admission test.

Conclusion: Therefor the SJT will once again be included into this year’s selection procedure which is going to take place in July. The quantity of items will be increased as well as their influence on the total score of the test augmented. By Octobe,r two years of experience with the integration of a SJT into a student selection procedure can be reported and two years‘ results of posttest analyses can be shown.


Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Progress of medical students after open admission or admission based on knowledge tests. Med Educ. 2010;44(2):205-214. DOI: 10.1111/j.1365-2923.2009.03576.x Externer Link
Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Dropout rates in medical students before and after the installation of admission tests. Acad Med. 2011[Epub ahead of print]
Sackett PR, Lievens F. Personnel Selection. Annu Rev Psychol. 2008;59:419-450. DOI: 10.1146/annurev.psych.59.103006.093716 Externer Link
Lievens F, Cotsier P. Situational tests in student selection: An examination of predictive validity, adverse impact, and construct validity. Int J Sel Ass. 2002;10(4):245-257. DOI: 10.1111/1468-2389.00215 Externer Link