gms | German Medical Science

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA)

26.09. - 28.09.2013, Graz, Österreich

Inventory of an experiment: Situational Judgment Test

Poster

  • corresponding author Marion Habersack - Medical University Graz, Graz, Austria
  • Hans Peter Dimai - Medical University Graz, Graz, Austria
  • Daniel Ithaler - Medical University Graz, Graz, Austria
  • Heide Maria Neges - Medical University Graz, Graz, Austria
  • Gilbert Reibnegger - Medical University Graz, Graz, Austria

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA). Graz, 26.-28.09.2013. Düsseldorf: German Medical Science GMS Publishing House; 2013. DocP14_02

doi: 10.3205/13gma132, urn:nbn:de:0183-13gma1326

Veröffentlicht: 20. August 2013

© 2013 Habersack et al.
Dieser Artikel ist ein Open Access-Artikel und steht unter den Creative Commons Lizenzbedingungen (http://creativecommons.org/licenses/by-nc-nd/3.0/deed.de). Er darf vervielfältigt, verbreitet und öffentlich zugänglich gemacht werden, vorausgesetzt dass Autor und Quelle genannt werden.


Gliederung

Text

Medical College Admission Tests (MCAT) fulfill the demand of selecting potential students and are used as predictors for the educational success of the college applicants. Admission tests thus have to

1.
guarantee the fair and reproducible allocation of limited university places to a preferably diverse future student population,
2.
should select those applicants who, with the greatest probability, develop exactly those abilities and/or abilities/characteristics that are expected from future physicians, and
3.
should identify those applicants who show the greatest probability of finishing the course of study [1], [2].

Whereas in the US the development and application of the MCAT can look back on a history of more than eight decades, the medical universities in Austria have been confronted with admission restrictions, and the resulting selection of students or the conception of selection processes since the academic year 2006/2007 [2].

As only selection criterion for admission to medical college, and due to the basic science knowledge gap (gender gap) – consistently observed since used for the first time – the admission tests at the Medical Universities of Graz, Innsbruck and Vienna are centers of attention in the public media [3].

Is the only one of the three Austrian medical universities, the Medical University of Graz has amended its admission process (cognitive testing with the subsections biology, chemistry, physics and mathematics as well as the testing of text comprehension) by including a written Situational Judgment Test (SJT) in the year 2010.

Despite some concerns regarding the SJT expressed in the literature, particularly the possibility to confront future students with the importance of the bio-psycho-social model was decisive for this extension [4], [5].

On the basis of results obtained during three admission procedures (2010 to 2012), the purposes of the present study are:

  • examining (socio-scientific, latent) constructs that are discussed in the literature in connection with medical college admission tests in general, and in connection with the administration of situational judgment tests in particular, and reporting correlations between the chosen constructs via structure equation models;
  • examining which latent constructs influence the present indicator variables to what extent; respectively, what the correlations are between latent variables (endogenic/exogenic) and indicators (measuring model);
  • examining whether the correlations between latent and indicator variables is representable as direct or indirect influence, and which causal effective direction can be evaluated;
  • examining how to define the structure model, i.e., the correlations of the putative latent variables with each other

References

1.
Shulruf B, Poole P, Wang GY, Rudland J, Wilkinson T. How well do selection tools predict performance later in a medical programme? Adv Health Sci Educ Theory Pract. 2012;17(5):615-626. DOI: 10.1007/s10459-011-9324-1 Externer Link
2.
McGaghie WC. Assessing readiness for medical education: Evolution of the Medical College Admission Test. JAMA. 2002;288(9):1085-1090. DOI: 10.1001/jama.288.9.1085 Externer Link
3.
Reibnegger G, Caluba HC, Ithaler D, Manhal S, Neges HM, Smolle J. Progress of medical students after open admission or admission based on knowledge tests. Med Educ. 2010;44(2):205-214. DOI: 10.1111/j.1365-2923.2009.03576.x Externer Link
4.
Sinha R, Oswald F, Imus A, Schmitt N. Criterion-Focused Approach to Reducing Adverse Impact in College Admissions. App Measur Educ. 2011;24(2):137-161. DOI: 10.1080/08957347.2011.554605 Externer Link
5.
McDaniel MA, Hartman NS, Whetzel DL, Grubb WL. Situational judgment tests, reponse instructions, and validity: a meta-analysis. Pers Psychol. 2007;60(1):63-91. DOI: 10.1111/j.1744-6570.2007.00065.x Externer Link