gms | German Medical Science

GMS Journal for Medical Education

Gesellschaft für Medizinische Ausbildung (GMA)

ISSN 2366-5017

On the journey to competency-based assessment for safe patient care

editorial Assessment

Search Medline for

  • corresponding author Jana Jünger - Universität Heidelberg, Medizinische Fakultät, Kompetenzzentrum Prüfungen in der Medizin Baden-Württemberg, Heidelberg, Deutschland
  • Ara Tekian - Univerity of Illinois at Chicago, Chicago, USA
  • John J. Norcini - Foundation for Advancement of International Medical Education and Research (FAIMER), Philadelphia, USA

GMS Z Med Ausbild 2015;32(4):Doc47

doi: 10.3205/zma000989, urn:nbn:de:0183-zma0009897

This is the English version of the article.
The German version can be found at: http://www.egms.de/de/journals/zma/2015-32/zma000989.shtml

Received: September 18, 2015
Revised: September 18, 2015
Accepted: September 18, 2015
Published: October 15, 2015

© 2015 Jünger et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Editorial

Over the past few decades there has been an international movement towards competency-based medical education (CBME). Germany has participated in this development and recently created the NKLM, which is a catalogue of the learning objectives for medical education [http://www.nklm.de and [http://www.nklz.de] citied 2015-09-18], [1]. The recommendations of the German Council for Science and Humanities regarding the further development of medical studies in Germany state that modified teaching and learning content should also be reflected in assessment [2]. The aims of this movement are to ensure that the graduates of our medical faculties have the necessary knowledge, skills, and attitudes to provide excellent patient care.

Implementation of CBME requires appropriate alignment of the learning objectives specified in the NKLM with the curriculum, particularly with the instructional methods and assessment strategies. A number of institutions have been experimenting with ways of making the appropriate changes within the resources available.

These exciting developments have been driven by enlightened initiatives in association with the German community of medical educators and it has generated a new culture for the academy. Central to CBME is the ability to determine when students have achieved the competencies specified in the NKLM and that requires advances in the way we do assessment.

It is in this context that we have assembled the papers for this special issue. One critical feature of this new culture is the increased involvement of the students. An example of this is the article by Wagener et al. that reports the results of student-driven competency-based progress test [3]. Not only did the students create the material across faculties for this assessment, but it also informs them about their progression during their studies in light of the NKLM-competencies. One aspect of the culture change is an increased emphasis on using assessment to support learning. For example the article by Profanter et al. focuses on workplace-based assessment which is intended to provide feedback tailored to the strengths and weaknesses of the students [4]. As a result, the teachers modified their educational activities to enhance student learning.

Students are often concerned about the fairness in their assessment. One area of on-going concern is the great variability in the grades assigned by various examiners. The paper by Schickler et al. demonstrates the importance of rater training [5]. This calibration of the examiners is important in oral examinations, especially where the stakes are high. It is clear that examiner training is an essential aspect of quality assurance.

The paper by Tekian and Norcini focuses on setting standards (i.e., selecting the pass-fail score) for examinations [6]. This topic has been largely ignored in Germany and it is essential to fairness to students. Moreover, the assumption of a 60% standard has the effect of influencing the examination content by requiring the inclusion of material based on its ability to generate the appropriate pass rates rather than based on the importance of the content. Likewise, the paper by Möltner et al. addresses the accuracy and the consistency of the pass/fail decision for assessment comprised of multiple components [7]. The paper by Hochlehnert et al. demonstrates the importance and role of technology in improving the quality and efficiency of assessment [8].

As we go forward, it is important to look to our colleagues worldwide of how to improve assessment. The paper by Berendonk et al. describes the introduction of the clinical skills examination into the national licensing examination [9].

These are only a few of the topics in assessment that are addressed in this special issue. These studies provide the first steps in achieving the goal of implementing CBME based NKLM. As we go into the future, additional progress will require collaboration, networking, and sharing of resources. Assessment is the means for improving the quality of care provided by individual practitioners. The next step is to ensure the quality of the educational programs themselves.


Competing interests

The authors declare that they have no competing interests.


References

1.
Fischer MR, Bauer D, Mohn K. Endlich fertig! Nationale Kompetenzbasierte Lernzielkataloge Medizin (NKLM) und Zahnmedizin (NKLZ) gehen in die Erprobung. GMS Z Med Ausbild. 2015;32(3):Doc35. DOI: 10.3205/zma000977 External link
2.
Wissenschaftsrat. Empfehlungen zur Weiterentwicklung des Medizinstudiums in Deutschland auf Grundlage einer Bestandsaufnahme der humanmedizinischen Modelstudiengänge. Drs 4017-14. Dresden: Wissenschaftsrat; 2014.
3.
Wagener S, Möltner A, Tımbıl S, Gornostayeva M, Schultz JH, Brüstle P, Mohr D, Vander Beken A, Better J, Fries F, Gottschalk M, Günther J, Herrmann L, Kreisel C, Moczko T, Illg C, Jassowicz A, Müller A, Niesert M, Strübing F, Jünger J. Entwicklung eines formativen kompetenzorientierten Progresstests mit MC-Fragen von Studierenden - Ergebnisse einer multifakultären Pilotstudie. GMS Z Med Ausbild. 2015;32(4):Doc46. DOI: 10.3205/zma000988 External link
4.
Profanter C, Perathoner A. Einführung von DOPS (Direct Observation of Procedural Skills) als Work-place based assessment (WBA) im studentischen Skills-Lab: Beeinflussung der Performanz klinischer Fertigkeiten und Nebeneffekte auf die curricular-institutionelle Entwicklung. GMS Z Med Ausbild. 2015;32(4):Doc45. DOI: 10.3205/zma000987 External link
5.
Schickler A, Brüstle P, Biller S. Mündlich-praktischer Teil des Zweiten Abschnitts der Ärztlichen Prüfung in Freiburg 2012 - Analyse der Notenvergabe zur Überprüfung von Qualitätssicherungsmaßnahmen. GMS Z Med Ausbild. 2015;32(4):Doc39. DOI: 10.3205/zma000981 External link
6.
Tekian A, Norcini J. Overcome the 60% passing score and improve the quality of assessment. GMS Z Med Ausbild. 2015;32(4):Doc43. DOI: 10.3205/zma000985 External link
7.
Möltner A, Tımbıl S, Jünger J. Die Zuverlässigkeit der Entscheidung "bestanden/durchgefallen" bei zusammengesetzten Prüfungen. GMS Z Med Ausbild. 2015;32(4):Doc42. DOI: 10.3205/zma000984 External link
8.
Hochlehnert A, Schultz JH, Möltner A, Tımbıl S, Brass K, Heid J, Jünger J. Elektronische Erfassung von Prüfungsleistungen bei OSCE-Prüfungen mit Tablets. GMS Z Med Ausbild. 2015;32(4):Doc41. DOI: 10.3205/zma000983 External link
9.
Berendonk C, Schirlo C, Balestra G, Bonvin R, Feller S, Huber P, Jünger E, Monti M, Schnabel K, Beyeler K, Guttormsen S, Huwendiek S. Die neue klinisch-praktische Schlussprüfung in Humanmedizin der Schweiz: Essentielle Schritte der Entwicklung und zentrale Erkenntnisse aus Sicht der nationalen Arbeitsgruppe Clinical Skills. GMS Z Med Ausbild. 2015;32(4):Doc40. DOI: 10.3205/zma000982 External link