gms | German Medical Science

GMS Journal for Medical Education

Gesellschaft für Medizinische Ausbildung (GMA)

ISSN 2366-5017

Analysis of educational research at a medical faculty in Germany and suggestions for strategic development – a case study

article Medical Education Research

Search Medline for

  • Sarah Prediger - University Hospital Hamburg-Eppendorf, III. Medical Clinic, Hamburg, Germany
  • corresponding author Sigrid Harendza - University Hospital Hamburg-Eppendorf, III. Medical Clinic, Hamburg, Germany

GMS J Med Educ 2016;33(5):Doc71

doi: 10.3205/zma001070, urn:nbn:de:0183-zma0010707

This is the English version of the article.
The German version can be found at: http://www.egms.de/de/journals/zma/2016-33/zma001070.shtml

Received: November 24, 2015
Revised: July 7, 2016
Accepted: July 29, 2016
Published: November 15, 2016

© 2016 Prediger et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Abstract

Background: Evidence-based medical education is playing an increasingly important role in the choice of didactic methods and the development of medical curricula and assessments. In Germany, a growing number of educational research projects has accompanied an ongoing change in the medical education process. The aim of this project was to assess medical education research activities at one medical faculty to develop procedural recommendations for the support and development of best evidence medical education.

Methods: Using a newly developed online questionnaire, the 65 institutes and departments of the medical faculty of Hamburg University at Hamburg University Medical-Center (UKE) were asked to report their medical education research and service projects, medical education publications, medical education theses, financial support for educational projects, and supportive structures that they would consider helpful in the future. The data were grouped, and a SWOT analysis was performed.

Results: In total, 60 scientists who were involved in 112 medical education research publications between 1998 and 2014 were identified at the UKE. Twenty-five of them had published at least one manuscript as first or last author. Thirty-three UKE institutions were involved in educational service or research projects at the time of the study, and 75.8% of them received internal or external funding. Regular educational research meetings and the acquisition of co-operation partners were mentioned most frequently as beneficial supportive structures for the future.

Conclusion: An analysis to define the status quo of medical education research at a medical faculty seems to be a helpful first step for the development of a strategy and structure to further support researchers in medical education.

Keywords: educational research, medical education, research networks, research projects, strategic development


Introduction

Since a major revision of the medical licensure regulation in 2002 [Approbationsordnung für Ärzte (ÄAppO), accessed: 05.11.2015], medical education in Germany began to develop in an irreversible process [1], which is still ongoing today. The most common changes in educational and assessment structures at many medical faculties have been the implementation of problem-orientated learning (POL), objective structured clinical examinations (OSCE), and communication training with standardized patients [2], [3], [4]. Furthermore, medical faculties or individual departments of medical faculties have established studies to investigate whether changes in their curricula have improved undergraduate medical training [5], [6]. In addition, many medical faculties have initiated didactic teacher training programs [7], [8], [9], and a master of medical education program has been established in Germany to professionalize medical educators [10].

The German Council of Science and Humanities released recommendations for the further development of medical education in Germany based on an inventory of model curricula for undergraduate medical education [11]. These recommendations, which focus especially on the development of curricula in which basic and clinical sciences are integrated with a special focus on practical skills and communication, are greatly appreciated, but a more evidence-based approach has been demanded [Pfeilschifter J. Wissenschaft in hoher Verdünnung, accessed: 07.04.2016]. Furthermore, the Medical Faculty Association (MFT) has recently passed a National Catalogue of Competency Based Learning Objectives (NKLM) for medical schools [NKLM, accessed: 17.07.2015] and dental schools [NKLZ, accessed: 07.04.2016], which will foster a new approach to undergraduate medical education based on competences and entrustable professional activities [12], and it might trigger further curricular reform.

Research in medical education supports evidence-based medical education and facilitates the development of medical curricula based on the best evidence-based standards [13], [14]. As the impetus for curricular development, evidence-based medical education has a long tradition in North America and some European countries like Great Britain and the Netherlands, where departments of educational research and development are well established at medical faculties [15]. Hence, these countries are among those with the highest relative productivity with respect to scientific publications in educational research [16]. German universities are starting to establish Departments of Educational Development and Research in their Medical Faculties, e.g., in Munich. Additionally, with the implementation of the NKLM on trial for five years, educational research activities are needed for its assessment in practice. Furthermore, the NKLM itself emphasizes the scientific nature of medical education. In addition, the German GMS Journal for Medical Education, the scientific journal of the Society for Medical Education (GMA) to promote evidence-based medical education, celebrated its 30th anniversary in 2014 [17]. In addition, since 2010, the “Ars legend-Faculty Award for excellent teaching in Medicine” is given to outstanding medical teachers and researchers in medical education by the Association for the Promotion of Science and Humanities in Germany and the MFT [18].

Despite such positive developments and support for educational research in medicine, and in contrast to expectations, the number of contributions to AMEE (Association of Medical Education in Europe) conferences by participants from German-speaking countries has not shown a continuous increase between 2005 and 2013 [19]. The number of publications by German education researchers in international medical education journals has increased since 2009 [20]. However, between 2004 and 2013, only five German universities published more than ten manuscripts with a German first or last author in an international medical education journal [20].

Meanwhile, at least one faculty member of every medical faculty in Germany completed a Master of Medical Education program [10], and many more have attended workshops for education research in medicine [21]. To increase the international visibility of medical educational research, establish evidence-based curriculum development activities and promote educational research at medical faculties with a network of educational researchers, it might be a useful approach to investigate the “status quo” of educational research at a medical faculty and to develop strategic steps from such an analysis to bundle education research activities. Our study describes the process used to analyze medical education research and development activities at the Medical Faculty of Hamburg University and the development of strategic ideas based on this analysis to promote evidence-based medical education at this faculty.


Methods

The planning of a strategic development process is usually based on a thorough analysis of the specific situation of an organization preparing for change to customize recommendations for the next steps with the most precision [22], [23]. Therefore, we developed the following strategy for the analysis of medical education research and development activities at the Medical Faculty of Hamburg University including an online questionnaire, telephone interviews, and an internet based search. We designed an online questionnaire consisting of 23 mostly closed-ended questions with the option to include additional aspects in open questions. The questions included the following topics:

1.
currently active education researchers per institution,
2.
publications in educational research (journals with or without impact factors, books),
3.
current education projects (research or development, topics, methods, target groups),
4.
funding for education projects (funding source, amount),
5.
promotion of young educational researchers (PhD program, MD thesis),
6.
current partners for cooperation
7.
expectations of an organizational structure for medical education at a medical faculty.

Furthermore, open questions were asked with respect to additional needs and suggestions regarding the possible establishment of a network for medical education at the University Hospital Hamburg-Eppendorf (UKE). Additional information regarding research activities, funding or memberships was collected from the dean of education’s secretary and from the UKE website (see attachment 1 [Attach. 1]).

A link to the online questionnaire was sent by email to the teaching coordinator of every department (n=37) and institute (n=27) at the UKE and to the executive director of the vice deanship of education of the Medical Faculty of Hamburg University (n=1). The departments or institutes from which no survey responses were obtained were contacted again by mail or telephone to guarantee the participation of every institution. A database was established using the information provided and subsequently evaluated. With respect to data evaluation, a SWOT analysis [24] considering strength and weaknesses (internal perspective) as well as opportunities and threats (external perspective) for the strategy of establishing a medical education research network at the UKE was performed by the authors as an additional analysis tool to generate recommendations based on this analysis.


Results

Thirty-two of the 65 institutions replied to the online survey. All remaining institutions were contacted by email or telephone until a response from every institute and department had been gathered. Most of the institutions who did not reply to the online survey initially were not involved in educational projects.

Sixty medical education researchers who had been involved in 112 publications in the field of medical education from 1998 to 2014 – 25 of them as first or last authors – were identified in 23 departments or institutes at the Medical Faculty of Hamburg University. Among these manuscripts, 99 (88.4%) were published in journals (see Figure 1 [Fig. 1]) and 13 (11.6%) were contributions to books. The first publication in medical education at the UKE dated back to the year 1998. From 2000 to 2002, no manuscripts on medical education were published. The individual number of journal publications per person varied from one to 43.

At the time of the survey, 24.6% of the departments and institutes at the Medical Faculty of Hamburg University were involved in educational research projects and 46.2% participated in educational service projects. Research projects were defined as projects with a scientific question and a description of methodical proceeding. Service projects were defined as projects that implement new courses or educational material without a specific research question. In total, at least 42 ongoing research projects and 57 service projects were identified. Table 1 [Tab. 1] shows the different topics of the current medical education research projects. The target groups mentioned in this multiple-answer question are mostly undergraduate medical students in their preclinical (42.4%) and clinical (53.1%) years or in their practice year (31.2%). Individual research projects address physicians in postgraduate training, pupils, university applicants, psychotherapists or nursing students. In another multiple-answer question, 46.9% of the participants used quantitative research methods and 45.5% used qualitative methods to answer their research questions. Mixed-method approaches were only employed by 17.6% of the participants.

Currently, 33 institutions are involved in medical education projects at the UKE. Four institutions receive funding for educational research projects, 18 for educational service projects and three for projects of both types. Hence, 75.8% of the institutions have received funding for their educational projects (education fund of the Medical Faculty: 96%, Federal Ministry of Education and Research and Ministry of Education and Science: 12%, Foundations: 8%). Eight institutions have received no funding for their medical education projects.

Between 2005 and 2014, 14 medical or dental and one non-medical doctoral theses with research questions in the field of medical education were completed. Nineteen doctoral theses (four of them in a PhD program) are currently in progress, including medical, dental and non-medical doctoral candidates. One postdoctoral lecture qualification in the field of medical education was completed in 2014. Ten current faculty members graduated in a Master of Medical Education (MME) program (five in Heidelberg, five in Bern), and six are currently studying in Heidelberg. Seven MME participants (five with MME-diploma and two without) have left the UKE. One faculty member holds a professorship for internal medicine/educational research, and three faculty members hold professorships with preponderant teaching obligations.

The survey participants were also asked to express their expectations, needs and wishes with respect to a possible organizational structure for medical education research at the Medical Faculty of Hamburg University (see Table 2 [Tab. 2]). Regular meetings regarding “work in progress”, finding partners for cooperation, and workshops on educational research methods were the most frequently mentioned topics.

Based on these data, a SWOT analysis was performed by the authors with respect to the strengths and weaknesses (internal perspective) as well as opportunities and threats (external perspective) related to the possible establishment of a network of educational research at the Medical Faculty of Hamburg University (see Figure 2 [Fig. 2]).


Discussion

With its current output of publications in the field of medical education, the Medical Faculty of Hamburg University is among the five German universities with more than 10 first or last author publications in international education journals from 2004 to 2013 [20]. This rate of publications seems to be a good foundation for international visibility and a unique selling point that is currently not shared by many other universities in Germany. Furthermore, the increasing number of MME graduates, the number of 42 current educational research projects, and increased third-party funding for educational projects underscore the faculty’s striving for research based medical education. Having identified 25 medical education researchers at the UKE who published at least one manuscript with an educational topic as first or last author, the formation of an educational network appears to be a helpful next step to support the research activities and publications of the these authors, according to our SWOT analysis. However, only three of the 25 researchers published more than 10 manuscripts in national or international journals as first or last authors. This raises the question whether a critical mass of experts, which is crucial for developmental undertakings [25], can currently be achieved at the UKE for such an enterprise. We identified the dependency on a small number of experienced educational researcher as a potential weakness. However, a network with a supportive infrastructure – the lack of which has also been identified as a weakness – might support and motivate young education researchers who are just starting to publish or who hold MME degrees to pursue education research.

In the mid-1990s, the results of medical educational research were often neglected in educational decision-making [26]. Hence, many changes that lack the support of research evidence have been implemented in medical curricula. Thus, the idea that medical education departments should “promote and sustain medical education research” [26] was generated to support curriculum developers with educational research data to provide best evidence medical education [27]. Recommendations have been provided regarding how to establish departments of medical education and support educational researchers [13]. Some of the recommendations for setting up departments of medical education and for evidence-based progress in medical education [28] also address the following supportive necessities to tackle weaknesses that were identified in our SWOT analysis for setting up an education research network. Firstly, support from the dean is required for such an enterprise because faculty member resistance might be expected with respect to a lack of support for researchers from their department with an interest in educational research. Secondly, financial support may be necessary to establish an administrative infrastructure for a network. Thirdly, a multi-professional team of researchers must be willing to share their expertise to educate young academics.

When the process of “unfreezing” [29] of the faculty is successfully underway and the decision is made to establish a network, several additional recommendations concerning how to successfully conduct collaborative research in medical education [30] must be considered. The fear of increased competition between researchers, as addressed in our SWOT analysis, could be met with the early development of authorship criteria [30]. If financial support is not immediately available, it might be necessary to identify enthusiastic faculty members who will work without funding during the start-up period [30]. Furthermore, like for basic science research, it will be necessary to receive funding for educational research from external sources, which requires expertise in educational grant proposal writing [31] and the identification of funding sources. Regarding the distribution of educational research findings and ensuring their availability for the development of curricula, research in the USA has demonstrated the utility of various national organizations and the Society of Directors of Research in Medical Education [32]. Such an approach will be especially necessary in Germany with respect to the integration of the NKLM into undergraduate medical education and the development or pursuit of model curricula.

An analysis similar to ours to establish the status quo regarding medical education research at a medical faculty could be the first step for a faculty to decide whether it would like to proceed in creating a network or other structure for improved modes of operation. A faculty needs to be aware that research in medical education seeks to deepen our understanding of learning and is not only interested in solving concrete local problems [33]. It can provide evidence that should be considered during the development of an undergraduate medical curriculum [34]. However, setting up a strategy and a structure for development of a nucleus and network in medical education research will require the complete commitment and support of the faculty leaders and a critical mass of faculty members who are willing to tackle grant writing, the establishment of projects and the preparation of manuscripts.


Conclusion

If a medical faculty wishes to consider the establishment of an educational research focus in its portfolio, an analysis of the status quo with respect to medical education research and researchers appears to be an important first step. Once the analysis data are available, a possible next step towards a network for educational researchers could be a workshop comprising faculty members who are interested in educational research. Such a workshop might provide the dean with additional information for the SWOT analysis to contemplate whether the faculty is ready for the full enterprise of educational research or whether smaller additional steps need to be taken first to reach a critical mass of researchers and sufficient support by leading faculty members.


Competing interests

The authors declare that they have no competing interests.


References

1.
Clade H. Reform des Medizinstudiums: Ein langer Weg. Dtsch Arztebl. 2002;99(18):A-1189.
2.
Schäfer M, Georg W, Mühlinghaus I, Fröhmel A, Rolle D, Pruskil S, Heinz A, Burger W. Experience with new teaching methods and testing in psychiatric training. Nervenarzt. 2007;78(3):287-290, 292-293. DOI: 10.1007/s00115-99005-2048-9 External link
3.
Ruesseler M, Weinlich M, Byhahn C, Müller MP, Jünger J, Marzi I, Walcher F. Increased authenticity in practical assessment using emergency case OSCE stations. Adv Health Sci Educ Theory Pract. 2010;15(1):81-95. DOI: 10.1007/s10459-009-9173-3 External link
4.
Nikendei C, Zipfel S, Roth C, Löwe B, Herzog W, Jünger J. Communication and interaction in psychosomatic education: use of standardized patients. Psychother Psychosom Med Psychol. 2003;53(11):440-445. DOI: 10.1055/s-2003-43388 External link
5.
Nouns Z, Schauber S, Witt C, Kingreen H, Schüttpelz-Brauns K. Development of knowledge in basic science: a comparison of two medical curricula. Med Educ. 2012;46(12):1206-1214. DOI: 10.1111/medu External link
6.
Kadmon G, Schmidt J, De Cono N, Kadmon M. A model for Persistent Improvement of Medical Education as Illustrated by the Surgical Reform Curriculum HeiCuMed. GMS Z Med Ausbild. 2011;28(2):Doc29. DOI: 10.3205/zma000741 External link
7.
Roos M, Kadmon M, Kirschfink M, Koch E, Jünger J, Strittmatter-Haubold V, Steiner T. Developing medical educators – a mixed method evaluation of a teaching education program. Med Educ Online. 2014;19:23868. DOI: 10.3402/meo.v19.23868 External link
8.
Kuhnigk O, Schreiner J, Harendza S. Sustained change in didactic skills – does teacher training last? GMS Z Med Ausbild. 2013;30(3):Doc37. DOI: 10.3205/zma000880 External link
9.
Lammerding-Koeppel M, Ebert T, Goerlitz A, Karsten G, Nounla C, Schmidt S, Stosch C, Dieter P. German Medical TeachingNetwork (MDN) implementing national standards for teacher training. Med Teach. 2015;8:1-7. DOI: 10.3109/0142159X.2015.1047752 External link
10.
Jünger J, Fischer MR, Duelli R, Putz R, Resch F. Concept, implementation and evaluation of an interfaculty Master of Medical Education Programme. Z Evid Fortbild Qual Gesundhwes. 2008;102(10):620-627. DOI: 10.1016/j.zefq.2008.11.017 External link
11.
Wissenschaftsrat. Empfehlungen zur Weiterentwicklung des Medizinstudiums in Deutschland auf Grundlage einer Bestandsaufnahme der humanmedizinischen Modellstudiengänge. Dresden: Wissenschaftsrat; 2014.
12.
Chen HC, van den Broek WE, ten Cate O. The case for use of Entrustable professional activities in undergraduate medical education. Acad Med. 2015;90(4):431-436. DOI: 10.1097/ACM.0000000000000586 External link
13.
Park S, Khan NF, Hampshire M, Knox R, Malpass A, Thomas J, Anagnostelis B, Newman M, Bower P, Rosenthal J, Murray E, Iliffe S, Heneghan C, Band A, Georgieva Z. A BEME systematic review of UK undergraduate medical education in the general practice setting: BEME Guide No. 32. Med Teach. 2015;37:611-630. DOI: 10.3109/0142159X.2015.1032918 External link
14.
Al-Eraky MM. Twelve Tips for teaching medical professionalism at all levels of medical education. Med Teach. 2015;37:1018-1025. DOI: 10.3109/0142159X.2015.1020288 External link
15.
Davis MH, Karunathilake I, Harden RM. AMEE Educational Guide no. 28: The development and role of departments of medical education. Med Teach. 2005;27(8):665-675. DOI: 10.1080/01421590500398788 External link
16.
Doja A, Horsley T, Sampson M. Productivity in medical education research: an examination of countries of origin. BMC Med Educ. 2014;14:243. DOI: 10.1186/s12909-014-0243-8 External link
17.
Hahn EG, Gabry G, Fischer MR. 30 Years of the Zeitschrift für Medizinische Ausbildung (GMS Z Med Ausbild): heading in a good direction. GMS Z Med Ausbild. 2014;31(4):Doc50. DOI: 10.3205/zma000942 External link
18.
Harendza S. The Ars legendi-faculty award for excellent teaching in medicine: honour and career stepping stone. GMS Z Med Ausbild. 2013;30(3):Doc30. DOI: 10.3205/zma000873 External link
19.
Raes P, Bauer D, Schöppe F, Fischer MR. The active participation of German-speaking countries in conferences of the Association for Medical Education in Europe (AMEE) between 2005 and 2013: a reflection of the development of medical education research? GMS Z Med Ausbild. 2014;31(3):Doc28. DOI: 10.3205/zma000920 External link
20.
Ackel-Eisnach K, Raes P, Hönikl L, Bauer D, Wagener S, Möltner A, Jünger J, Fischer MR. Is German Medical Education Research on the rise? An analysis of publications from the years 2004 to 2013. GMS Z Med Ausbild. 2015;32(3):Doc30. DOI: 10.3205/zma000972 External link
21.
Schüttpelz-Brauns K, Kiessling C, Ahlers O, Hautz WE. Symposium 'Methodology in Medical Education Research' organized by the Methodology in Medical Education Research committee of the German Society of Medical Education May, 25th to 26th 2013 at Chairé, Berlin. GMS Z Med Ausbild. 2015;32(1):Doc3. DOI: 10.3205/zma000945 External link
22.
Kern DE, Thomas PA, Hughes MT. Curriculum Development for Medical Education: A Six-Step Approach. 2nd Edition. Baltimore: Johns Hopkins Univ Press; 2009.
23.
Bland CJ, Starnaman S, Wersal L, Moorhead-Rosenberg L, Zonia S, Henry R. Curricular change in medical schools: how to succeed. Acad Med. 2000;75(6):575-594. DOI: 10.1097/00001888-200006000-00006 External link
24.
Abell DF, Hammond JS. Strategic Market Planning. Englewood Cliffs, NJ: Prentice-Hall; 1979.
25.
Rogers EM. Diffusion of innovations. 5th Edition. New York: Simon and Schuster; 2003.
26.
Wartman SA. Research in medical education: the challenge for the next decade. Acad Med. 1994;69(8):608-614. DOI: 10.1097/00001888-199408000-00003 External link
27.
Harden RM, Grant J, Buckley G, Hart IR. Best Evidence Medical Education. Adv Health Sci Educ Theory Pract. 2000;5(1):71-90. DOI: 10.1023/A:1009896431203 External link
28.
Ramsden P. Learning to lead in higher education. London: Routledge; 1998.
29.
Schein EH. Organizational Culture and Leadership. 3rd Edition. San Francisco: Jossey-Bass; 2004.
30.
Huggett KN, Gusic ME, Greenberg R, Ketterer JM. Twelve tips for conducting collaborative research in medical education. Med Teach. 2011;33(9):713-718. DOI: 10.3109/0142159X.2010.547956 External link
31.
Bordage G, Dawson B. Experimental study design and grant writing in eight steps and 28 questions. Med Educ. 2003;37(4):376-385. DOI: 10.1046/j.1365-2923.2003.01468.x External link
32.
Albanese MA, Dottl S, Nowacek GA. Offices of research in medical education: accomplishments and added value contributions. Teach Learn Med. 2011;13(4):258-267. DOI: 10.1207/S15328015TLM1304_08 External link
33.
Ringsted C, Hodges B, Scherpbier A. 'The research compass': an introduction to research in medical education: AMEE Guide no. 56. Med Teach. 2011;33(9):695-709. DOI: 10.3109/0142159X.2011.595436 External link
34.
Norman G. Research in medical education: three decades of progress. BMJ. 2002;324(7353):1560-1562. DOI: 10.1136/bmj.324.7353.1560 External link