gms | German Medical Science

GMS Journal for Medical Education

Gesellschaft für Medizinische Ausbildung (GMA)

ISSN 2366-5017

The inventory as a core element in the further development of the science curriculum in the Mannheim Reformed Curriculum of Medicine

article Science in Medical Education

  • corresponding author Julia Eckel - University Medicine Mannheim, Medical Faculty Mannheim at Heidelberg University, Department of Undergraduate Education and Educational Development, Mannheim, Germany
  • author Katrin Schüttpelz-Brauns - University Medicine Mannheim, Medical Faculty Mannheim at Heidelberg University, Department of Undergraduate Education and Educational Development, Mannheim, Germany
  • author Thomas Miethke - University Medicine Mannheim, Institute of Medical Microbiology and Hygiene, Mannheim, Germany
  • author Alexandra Rolletschek - University Medicine Mannheim, Medical Faculty Mannheim at Heidelberg University, Department of Undergraduate Education and Educational Development, Mannheim, Germany
  • author Harald M. Fritz - University Medicine Mannheim, Medical Faculty Mannheim at Heidelberg University, Department of Undergraduate Education and Educational Development, Mannheim, Germany

GMS J Med Educ 2017;34(2):Doc22

doi: 10.3205/zma001099, urn:nbn:de:0183-zma0010997

This is the English version of the article.
The German version can be found at: http://www.egms.de/de/journals/zma/2017-34/zma001099.shtml

Received: March 7, 2016
Revised: March 9, 2017
Accepted: March 17, 2017
Published: May 15, 2017

© 2017 Eckel et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Abstract

Introduction: The German Council of Science and Humanities as well as a number of medical professional associations support the strengthening of scientific competences by developing longitudinal curricula for teaching scientific competences in the undergraduate medical education. The National Competence Based Catalogue of Learning Objectives for Undergraduate Medical Education (NKLM) has also defined medical scientific skills as learning objectives in addition to the role of the scholar. The development of the Mannheim science curriculum started with a systematic inventory of the teaching of scientific competences in the Mannheim Reformed Curriculum of Medicine (MaReCuM).

Methods: The inventory is based on the analysis of module profiles, teaching materials, surveys among experts, and verbatims from memory. Furthermore, science learning objectives were defined and prioritized, thus enabling the contents of the various courses to be assigned to the top three learning objectives.

Results: The learning objectives systematic collection of information regarding the current state of research, critical assessment of scientific information and data sources, as well as presentation and discussion of the results of scientific studies are facilitated by various teaching courses from the first to the fifth year of undergraduate training. The review reveals a longitudinal science curriculum that has emerged implicitly. Future efforts must aim at eliminating redundancies and closing gaps; in addition, courses must be more closely aligned with each other, regarding both their contents and their timing, by means of a central coordination unit.

Conclusion: The teaching of scientific thinking and working is a central component in the MaReCuM. The inventory and prioritization of science learning objectives form the basis for a structured ongoing development of the curriculum. An essential aspect here is the establishment of a central project team responsible for the planning, coordination, and review of these measures.

Keywords: Curriculum inventory, longitudinal science curriculum, training of scientific skills/competences


Introduction

The strengthening of scientific competences during the undergraduate medical education is an aspect supported amongst others by the German Council of Science and Humanities [1], [2], [3], [4], [5], [6], [7]. “Scientific competences include knowledge, skills, and attitudes that are necessary for understanding, assessing, applying, and documenting scientific concepts, methods, and findings and for an active involvement in the medical learning process and the assurance of its quality” [1]. Besides the role of the scholar, the National Competence Based Catalogue of Learning Objectives for Undergraduate Medical Education (NKLM) has also defined medical scientific skills as learning objectives [7]. In order to manage the vast volumes of information [8] in the medical field, the training of generic scientific skills is required for the critical assessment of new developments in diagnosis and therapy. Fundamental methodical and scientific competences constitute a precondition for the application of evidence-based medicine (EBM) to ensure an optimum degree of patient care. These form the basis for the prompt and comprehensive integration of scientific knowledge into everyday medical care.

A number of reviews on the teaching of medical scientific competences for students in the clinical phase of their undergraduate training and for resident physicians have meanwhile been published [9], [10], [11], presenting for example learning objectives, teaching methods, and evaluations of individual teaching courses or lecture series, e.g. for evidence-based medicine [12], [13]. Single courses for teaching scientific competences should be presented together in an integrated longitudinal coordinated curriculum.

The so-called “Research Skill Development Framework” [14] defines a variety of competence levels in relationship to various facets of research (e.g. the retrieval or communication of scientific information) and the degree of the student’s autonomy (e.g. with guidance or on his/her own). One concept for the development of curricula that has proven its worth is the model proposed by Kern et al. (2009) [15]. This model distinguishes six separate steps:

1.
problem identification and general needs assessment,
2.
targeted needs assessment,
3.
target the curriculum by setting goals and objectives,
4.
selection of educational strategies,
5.
implementation of the curriculum, and
6.
evaluation.

The further development of the longitudinal science curriculum at the Medical Faculty Mannheim at Heidelberg University thus started with a systematic and comprehensive inventory [16], [17], [18], [19] of the teaching of scientific competences and skills (needs assessment) and the definition of science learning objectives (setting goals and objectives). These project stages are presented in the following paper.


Project description

The first step was to set up a task force titled “Wissenschaftsstrang” (Scientific Curriculum), involving basic researchers, clinicians, medical training experts, and students’ representatives. This task force defined the specific project stages, as presented in Figure 1 [Fig. 1] and described in the following: First, the precondition for the systematic development of a longitudinal science curriculum was established in the first half of 2014 by identifying and systematically recording all courses for the teaching of scientific competences in the Mannheim Reformed Curriculum of Medicine (MaReCuM). Two project co-workers independently documented teaching courses in which scientific competences were taught. Two different methods were used to record the courses: one project co-worker diagonally scanned module profiles and teaching materials that had been placed at the students’ disposal on the MaReCuM learning management system. She also ran a search routine through these materials, using keywords such as “science”, “research”, “studies”. Another member of the project team of the MERLIN working group [20] reviewed the match between learning objectives from module profiles of the courses of the MaReCuM programme with the NKLM learning objectives defined in chapters 6 and 14a [7]. The two co-workers then compared their results.

After that an online survey was conducted: All medical directors, module coordinators, and members of the faculty that were responsible for single subjects in the MaReCuM programme (N=75) were asked to answer the following questions: Where and which scientific competences are taught in MaReCuM (open question)? Which scientific competences are important for medical graduates at the start of their professional career, regardless of the working environment (closed question)? Figure 2 [Fig. 2] shows the possible answers (boxes below the figure). These were developed in accordance with the NKLM, chapter 14a “Medical scientific skills”. The closed questions were evaluated descriptively (percentage of agreement to the answer options), while the open question was evaluated using a qualitative content-analysis method [21]. The evaluation of the open question of the expert survey was used to validate these answers and, wherever necessary, to add missing courses.

This evaluation process was followed by mapping a structure of the inventory on the basis of the learning objectives as prioritized by the experts (see Figure 2 [Fig. 2]). The course contents from the different study years were assigned to the three learning objectives given the highest priority. The use of hyperlinks enabled both a compressed and a detailed presentation on the contents of the teaching courses at various levels of abstraction. At the end of the process, the final inventory was re-reviewed with one student representative from each of the five study years.


Results

43 persons took part in the online survey (response rate = 57%). 95% of the participants stated that they were engaged in research, either in natural science, theoretical clinical research, or the practical clinical research (5% of the participants were not engaged in research).

Figure 2 [Fig. 2] shows that the learning objectives

  • (1) Systematic collection of information on the current state of research,
  • (2) Critical appraisal of scientific information and sources, and
  • (8) Presentation and discussion of scientific results

were rated as being “very important” or “important”.

Both project co-workers arrived at almost the same results regarding the inventory. The discrepancies were then discussed and consensus was reached on the inventory. The results of the expert survey reflect the consensus reached on the results. The students in the various study years also confirmed the results of the inventory. The analyses of the open question showed that there was a lack of teacher training for special teaching methods in the science curriculum.

Figure 3 [Fig. 3] shows the results of the inventory of the science curriculum. In general, there is an implicit longitudinal science curriculum that can be identified, one that has evolved from self-interests of faculty staff in different medical fields. Overall, the inventory shows that all learning objectives of the NKLM chapters 6 and 14a have been thematized in the MaReCuM programme. The science learning objectives prioritized by the staff responsible for the undergraduate training are longitudinally addressed in the MaReCuM programme over all five years. Regarding learning objective (1), i.e. the systematic collection of information on the current state of research, it is apparent that instruction in research training is given by library co-workers in the first and third years of study. In the clinical study phase, each student is required to carry out independent literature searches for papers, case presentations, and journal clubs (whereas in the preclinical phase the materials for the presentation papers are supplied to the students). Regarding the achievement of learning objective (2), i.e. the critical appraisal of scientific information and sources, in the preclinical phase the theoretical principles for the design of experiments and statistics are taught in the courses “Biomathematics”, “Medical Psychology”, and “Ethics”, with deeper immersion into the contents following in various courses during the clinical study phase. Students are taught how to perform, record, and evaluate laboratory experiments in the basic courses in the preclinical phase. In a number of courses in the clinical phase, students are taught in the collection and evaluation of patient data using standardized measurement instruments, e.g. in the context of a pain study in the module “Primary patient care”.

The aspects of EBM and the analysis of studies are thematized in a variety of courses spread over the whole programme of medical undergraduate training. In this regard, for example, parts of studies or complete studies are dealt with during the courses, or the applicability of guidelines is critically discussed on the basis of specific patient cases. Learning objective (3), the presentation and discussion of scientific results, is addressed in the preclinical phase in various courses on pathobiochemistry in the second and third study year, and also in a course in the module “Injuries, degenerative diseases, rehabilitation” in the fourth study year in the form of a presentation of a research paper by each student. The preparation and review of a poster presentation takes place in the module “Society and health” in the third study year. Students have to present an abstract on a paper in the module “Primary patient care” in the fifth study year.


Discussion

The teaching of the principles of scientific thinking and working in the undergraduate training of medicine is recommended by the German Council of Science and Humanities as well as by a number of medical professional associations. As we have been able to show, the teaching of scientific skills and competences is already an essential part of the MaReCuM.

The MaReCuM teachers in the survey prioritized the following learning objectives: “Systematic collection of information on the current state of research”, “Critical appraisal of scientific information and sources”, and “Presentation and discussion of scientific results”. These learning objectives are also emphasized in the international context [22]. The NKLM [7] and various international frameworks [23], [24] emphasize the importance of generic skills and competences regarding the information retrieval and the critical discussion of ethics, statistics, and study designs in the scientific context. The learning objective “Dissemination of research results” is prioritized in the NKLM and in two other frameworks [23], [24]. AMEE Guide No. 69, “Developing research skills in medical students”, for example, specifies the search for and the application and communication of evidence-based knowledge as learning objectives [25]. Furthermore, a recent survey conducted among students of medicine suggests that especially the learning objective regarding the critical appraisal of scientific information and data sources should be facilitated during the course of undergraduate training: only 28% of the students think that their undergraduate training prepared them sufficiently for interpreting research results, although precisely this is one of the competences they expect to acquire [26].

The inventory has succeeded in revealing an implicit (naturally emerging) science curriculum that can now be further developed to an integrated longitudinal curriculum. The next steps must be to select teaching methods and to implement and evaluate training programmes [15]. The teaching courses should be aligned with each other both in terms of their contents and their timing, redundances should be eliminated, and gaps in the curriculum should be closed. In the clinical subjects, for example, basic principles regarding clinical guidelines (e.g. guidelines levels of evidence) are taught over and over. These basic concepts are going to be taught one time in the beginning of the clinical phase. Specific guidelines will be thematized in the individual subjects in the subsequent courses. We are going to use well-established teaching methods for facilitating evidence-based medicine [12], [27], [28]. The current reformation of the clinical phase in undergraduate training – MaReCuMplus – opens the opportunity to adapt the existing courses.

As recommended by the Research Skill Development Framework [14] the learning objectives of the longitudinal scientific curriculum should be interdependent and be based on each other, like in a learning spiral [29]. Students should apply scientific principles of medicine more frequently in the clinical context. At the same time, we are pursuing the aim of integrating these learning objectives, e.g. research aspects and scientific working techniques and evidences, into already existing courses wherever possible [3]. In this regard, the “Science Curriculum,” task force has recommended to particularly emphasise the following NKLM learning objectives (chapter 14a): definition of research questions, generation of strong hypotheses according to the current state of knowledge (14a.2.1.5), the interpretation and presentation of results of statistical hypothesis testing (14a.3.1.2), and the critical discussion of the significance of scientific results from the methodological perspective (14a.3.1.3). The constructive alignment, i.e. the coordination of learning objectives, teaching methods and assessment, plays a central role [30], [31], [32].

In the winter term 2015/16, a new certificated module named “Principles of Scientific Method” concluding with a graded research project was introduced. The research project can be started at any time of the course of studies but must be submitted at the latest four months before the second state examination. Eligible are experimental or non-experimental research projects from the entire spectrum of medicine, including the basic sciences. As a measure to prepare students for their research project, the courses “Critical assessment of scientific evidence”, “Good Scientific Practice: Procedure in the case of misconduct”, “Scientific writing”, “Applying for grants and animal testing”, and “Clinical trials, Approval of the Ethical Review Board, Data protection, Patent-protection law” have been integrated in the curriculum of the third study year.

MaReCuM teachers provided a toolbox with recommendations and tips on the issue of science teaching to improve the structured teaching of scientific competences and to enhance the diversity of teaching methods [33].

The working group is going to enhance the visibility of the science curriculum, to define implementation and communication strategies, to coordinate the teaching activities, to provide resources, and to review the efficacy of the science curriculum.

The quality of the structure, procedure, and results of science teaching including the newly introduced “Principles of Scientific Method” module with an obligatory research project will be monitored on the basis of systematic evaluations. The levels of the Research Skill Development Framework will be applied for measuring the (changes in the) scientific competence [14].


Limitations

The experts addressed in the online survey were all members of the MaReCuM teaching staff. It cannot be excluded that other faculties would have set different priorities regarding the learning objectives. In addition, almost all respondents pursue research activities besides their clinical occupation. For this reason, it remains unanswered if clinicians involved solely in patient care may have prioritized the learning objectives differently.

The inventory was recorded using written teaching materials and on the basis of available module profiles. There was no actual review of the science teaching in real life. Hence we cannot exclude the possibility that essential teaching contents that are not documented are missing from the inventory. However, the alignment with the contents stated by the teaching staff in the course of the survey and the review of the details provided by the students of all study years shows that we have succeeded in recording all major issues.


Conclusions

The structured inventory and prioritization of science learning objectives form the basis of the further development of the curriculum: thus it was possible to reveal and communicate an implicit curriculum. The development of the curriculum, however, constitutes a comprehensive and constantly ongoing process that requires the cooperation of many different faculty members. Change management processes must be initiated. A broad variety of measures must be considered in the development of structured longitudinal science curricula. It is essential that a central project coordination team is established to take responsibility for planning, coordinating and reviewing these measures.


Acknowledgement

We want to thank Dr Elisabeth Narciss for taking the inventory of the science curriculum. Special thanks to the students of the faculty who reviewed the final inventory.


Competing interests

The authors declare that they have no competing interests.


References

1.
Wissenschaftsrat. Empfehlungen zur Weiterentwicklung des Medizinstudiums in Deutschland auf Grundlage einer Bestandsaufnahme der humanmedizinischen Modellstudiengänge. Dresden: Wissenschaftsrat; 2014. Zugänglich unter/available from: http://www.wissenschaftsrat.de/download/archiv/4017-14.pdf External link
2.
Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften e.V. (AWMF). Stellungnahme der AWMF zum "Masterplan Medizinstudium 2020". Düsseldorf: AWMF; 2015. Zugänglich unter/available from: http://www.awmf.org/fileadmin/user_upload/Forschung_und_Lehre/Stellungnahme_AWMF_Masterplan_Medizinstudium_2020.pdf External link
3.
Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften e.V. (AWMF). Stellungnahme zur Wissenschaftlichkeit des Medizinstudiums. Düsseldorf: AWMF; 2014. Zugänglich unter/available from: http://www.awmf.org/fileadmin/user_upload/Stellungnahmen/Aus-_und_Weiterbildung/Stellungnahme_AWMF_Wiss.Medizinstudium_26112014-1.pdf External link
4.
Arbeitsgemeinschaft der Wissenschaftlichen Medizinischen Fachgesellschaften e.V. (AWMF). Stellungnahme zur Förderung der wissenschaftlichen Medizin schon in der studentischen Ausbildung. Düsseldorf: AWMF; 2008. Zugänglich unter/available from: http://www.awmf.org/forschung-lehre/stellungnahmen/aus-weiterbildung/foerderung-der-medizin.html External link
5.
Bundesvertretung der Medizinstudierenden in Deutschland e.V. (bvmd). Konzeptpapier zur Zukunft und Weiterentwicklung des Medizinstudiums. Berlin: bvmd; 2014. Zugänglich unter/available from: https://www.bvmd.de/fileadmin/redaktion/Positionspapiere/Positionspapier_2014-06-01_Zukunft_und_W_entwicklung_Medizinstudium.pdf External link
6.
DFG Senatskommission. Empfehlungen der Senatskommission für Klinische Forschung. Strukturierung der wissenschaftlichen Ausbildung für Medizinerinnen und Mediziner. Bonn: Deutsche Forschungsgemeinschaf; 2010. Zugänglich unter/available from: http://www.dfg.de/download/pdf/dfg_im_profil/geschaeftsstelle/publikationen/medizinausbildung_senat_klinische_forschung.pdf External link
7.
Projektgruppe NKLM. Nationaler Kompetenzbasierter Lernzielkatalog (NKLM). Berlin: Projektgruppe NKLM; 2015. Zugänglich unter/available from: http://www.nklm.de/ External link
8.
Sönnichsen A, Rinnerberger A. Medizinische Informationsflut und Wissenstransfer in die Praxis – eine Quadratur des Kreises? Schwsche Ärztez. 2008;89:1904-1905.
9.
Green ML. Graduate medical education training in clinical epidemiology, critical appraisal, and evidence-based medicine: a critical review of curricula. Acad Med. 1999;74(6):686-694. DOI: 10.1097/00001888-199906000-00017 External link
10.
Hebert RS, Levine RB, Smith CG, Wright SM. A systematic review of resident research curricula. Acad Med. 2003;78(1):61-68. DOI: 10.1097/00001888-200301000-00012 External link
11.
Bierer SB, Huiju CC. How to measure success: the impact of scholarly concentrations on students – a literature review. Acad Med. 2010;85(3):438-452. DOI: 10.1097/ACM.0b013e3181cccbd4 External link
12.
Ahmadi S-F, Hamid RB, Emad A. Effectiveness of teaching evidence-based medicine to undergraduate medical students: A BEME systematic review. Med Teach. 2015;37(1):21-30. DOI: 10.3109/0142159X.2014.971724 External link
13.
Maggio LA, Tannery NH, Chen HC, ten Cate O, O'Brien B. Evidence-based medicine training in undergraduate medical education: a review and critique of the literature published 2006–2011. Acad Med. 2013;88(7):1022-1028. DOI: 10.1097/ACM.0b013e3182951959 External link
14.
Willison J, O'Regan K. Commonly known, commonly not known, totally unknown: a framework for students becoming researchers. High Educ Res Develop. 2007;26(4):393-409. DOI: 10.1080/07294360701658609 External link
15.
Kern DE, Thomas PA. Curriculum Development for Medical Education. 2nd ed. Baltimore. Maryland: Johns Hopkins University Press; 2009.
16.
Hausman JJ. Mapping as an approach to curriculum planning. Curriculum Theory Net. 1974;4(2–3):192–198. DOI: 10.2307/1179238 External link
17.
Harden RM. AMEE Guide No. 21: Curriculum mapping: a tool for transparent and authentic teaching and learning. Med Teach. 2001;23(2):123-137. DOI: 10.1080/01421590120036547 External link
18.
Denny JC, Smithers JD, Armstrong B, Spickard A. 'Where do we teach what?' Finding broad concepts in the medical school curriculum. J Gen Intern Med. 2005;20(10):943–946. DOI: 10.1111/j.1525-1497.2005.0203.x External link
19.
Green ML. Identifying, appraising, and implementing medical education curricula: a guide for medical educators. Ann Intern Med. 2001;135(10):889–896. DOI: 10.7326/0003-4819-135-10-200111200-00009 External link
20.
Lammerding-Köppel M, Biller S, Jünger J, Obertacke U. MERLIN-Projekt: Kompetenzorientiert lernen, lehren und prüfen in der Medizin Baden-Württemberg. Programmkonferenz Qualitätspakt Lehre. Berlin, 04.-05-07.2013.
21.
Mayring P. Qualitative Inhaltsanalyse. Grundlagen und Techniken. 12th ed. Weinheim: Beltz Verlag; 2015.
22.
Hautz SC, Hautz WE, Keller N, Feufel MA, Spies C. Die Gelehrten-Rolle im Nationalen Kompetenzbasierten Lernzielkatalog Medizin (NKLM) im Vergleich zu anderen internationalen Rahmenwerken. GMS Ger Med Sci. 2015;13:Doc20. DOI: 10.3205/000224 External link
23.
Frank JR. The CanMEDS 2005 physician competency framework. Better standards. Better physicians. Better care. Ottawa: The Royal College of Physicians and Surgeons of Canada; 2005.
24.
Metz JC, Verbeek-Weel AM, Huisjes HJ. Blueprint 2001: training of doctors in the Netherlands. Adjusted objectives of undergraduate medical education in the Netherlands. Nijmegen: University Publication Office; 2001.
25.
Laidlaw A, Aiton J, Struthers J, Guild S. Developing research skills in medical students: AMEE Guide No. 69. Med Teach. 2012;34(9):754-771. DOI: 10.3109/0142159X.2012.704438 External link
26.
Loos S, Sander M, Albrecht M. Systematische Situationsanalyse zum wissenschaftlichen Nachwuchs in der klinischen Forschung. Berlin: Bundesministerium für Bildung und Forschung; 2014. Zugänglich unter: http://www.gesundheitsforschung-bmbf.de/_media/IGES-Studie_Nachwuchs_Ergebnisbericht.pdf External link
27.
Khan KS, Coomarasamy A. A hierarchy of effective teaching and learning to acquire competence in evidenced-based medicine. BMC Med Educ. 2006;6:59. DOI: 10.1186/1472-6920-6-59 External link
28.
Ilic D, Maloney S. Methods of teaching medical trainees evidence-based medicine: a systematic review. Med Educ. 2014;48(2):124-135. DOI: 10.1111/medu.12288 External link
29.
Harden RM. What is a spinal curriculum? Med Teach. 1999;21(2):141-143. DOI: 10.1080/01421599979752 External link
30.
Biggs J. Enhancing teaching through constructive alignment. High Educ. 2006;32(3):347-364. DOI: 10.1007/BF00138871 External link
31.
Biggs J. What the student does: teaching for enhanced learning. High Educ Res Develop. 2009;18(1):57-75. DOI: 10.1080/0729436990180105 External link
32.
Treleaven L, Voola R. Integrating the Development of Graduate Attributes Through Constructive Alignment. J Market Educ. 2008;30(12):160-173. DOI: 10.1177/0273475308319352 External link
33.
Eckel J, Rolletschek A, Schüttpelz-Brauns K, Miethke T, Fritz HM. Stärkung wissenschaftsorientierter Kompetenzen im Mannheimer Reformierten Curriculum für Medizin (MaReCuM) – Entwicklung einer Toolbox zur wissenschaftsorientierten Lehre. Gemeinsame Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA) und des Arbeitskreises zur Weiterentwicklung der Lehre in der Zahnmedizin (AKWLZ). Leipzig, 30.09.-03.10.2015. Düsseldorf: German Medical Science GMS Publishing House; 2015. DocP14-176. DOI: 10.3205/15gma216 External link