gms | German Medical Science

GMS Journal for Medical Education

Gesellschaft für Medizinische Ausbildung (GMA)

ISSN 2366-5017

Opportunities and challenges of e-learning in vocational training in General Practice – a project report about implementing digital formats in the KWBW-Verbundweiterbildungplus

short report Asynchronous Digital Teaching

  • author Christian Förster - Universitätsklinikum Tübingen, Institut für Allgemeinmedizin und Interprofessionelle Versorgung, Tübingen, Germany
  • author Jessica Eismann-Schweimler - Universitätsklinikum Freiburg, Lehrbereich Allgemeinmedizin, Freiburg, Germany
  • author Sandra Stengel - Universitätsklinikum Heidelberg, Abteilung für Allgemeinmedizin und Versorgungsforschung, Heidelberg, Germany
  • author Martina Bischoff - Universitätsklinikum Freiburg, Lehrbereich Allgemeinmedizin, Freiburg, Germany
  • author Monika Fuchs - Universitätsklinikum Ulm, Institut für Allgemeinmedizin, Ulm, Germany
  • author Andreas Graf von Luckner - Universitätsklinikum Freiburg, Lehrbereich Allgemeinmedizin, Freiburg, Germany
  • author Thomas Ledig - Universitätsklinikum Heidelberg, Abteilung für Allgemeinmedizin und Versorgungsforschung, Heidelberg, Germany
  • author Anne Barzel - Universitätsklinikum Ulm, Institut für Allgemeinmedizin, Ulm, Germany
  • author Andy Maun - Universitätsklinikum Freiburg, Lehrbereich Allgemeinmedizin, Freiburg, Germany
  • author Stefanie Joos - Universitätsklinikum Tübingen, Institut für Allgemeinmedizin und Interprofessionelle Versorgung, Tübingen, Germany
  • author Joachim Szecsenyi - Universitätsklinikum Heidelberg, Abteilung für Allgemeinmedizin und Versorgungsforschung, Heidelberg, Germany
  • corresponding author Simon Schwill - Universitätsklinikum Heidelberg, Abteilung für Allgemeinmedizin und Versorgungsforschung, Heidelberg, Germany

GMS J Med Educ 2020;37(7):Doc97

doi: 10.3205/zma001390, urn:nbn:de:0183-zma0013906

This is the English version of the article.
The German version can be found at: http://www.egms.de/de/journals/zma/2020-37/zma001390.shtml

Received: August 7, 2020
Revised: September 30, 2020
Accepted: October 15, 2020
Published: December 3, 2020

© 2020 Förster et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Abstract

Background: The task of the Competence Centers for vocational training (KW) is to increase the attractiveness and quality of vocational (=post-graduate) training in general practice. For this purpose, they offer, among other things, a structured seminar program for post-graduate trainees in general practice (GP-trainees). During the Covid-19 pandemic the seminar program of the KWBW-Verbundweiterbildungplus® in Baden-Württemberg was converted to digital formats. The goal of the paper is to evaluate the acceptance by the GP-trainees and lecturers, to describe experiences with the conversion to e-learning and to derive recommendations with regard to the future orientation of seminar programs in post-graduate as well as continuing medical education.

The implementation was based on a modified Kern-cycle and aimed at offering eight teaching units of 45 minutes each to a large number of GP-trainees. It tried to maintain the high quality of content and education as well as the interactive character of the previous seminars. For this purpose, the events were designed as synchronous webinars (six units) with asynchronous preparation and post-processing (two units) according to the flipped classroom method. The evaluation by the participating GP-trainees and lecturers was performed online using a multi-center developed and pre-piloted questionnaire.

Results and discussion: N=101 GP-trainees participated in the evaluation of five individual seminar days in the second quarter of 2020 (response rate 97%). 58% (N=59) of the trainees were satisfied or very satisfied with the implementation. 82% (n=83) rated pre-tasks as helpful. 99% (n=100) would participate in an online seminar again. For 52% (n=53) of the trainees, the attitude towards e-learning had changed positively. The main advantages mentioned were no travel, save in time and costs as well as increased flexibility. The main disadvantages mentioned were less personal interaction and technical obstacles.

The high acceptance of the new digital format showed the fundamental potential of e-learning in continuing medical education. The experiences can be a source of inspiration for other departments and KW. However, it also shows that important goals of KW, such as the personal interaction of the peer group, could not be achieved. In the future, it is important to develop a suitable mix of presence and digital formats with the aim to improve the attractiveness as well as sustainability of continuing medical education.

Keywords: postgraduate medical education, residency, vocational training, competence centers for postgraduate medical education, general practice, primary care, e-learning, webinar, blended learning


Background

In order to increase the quality and efficiency of vocational (=post-graduate) training in general practice (=GP), competence centers for vocational training (KW) were founded in 2017 [1]. Based on the experience of the Verbundweiterbildungplus as the first project of its kind in Germany (2009-2017) [2], [3], the KW in Baden-Württemberg (KWBW) offers the KWBW-Verbundweiterbildungplus®, a concomitant program that accompanies the training post [https://www.weiterbildung-allgemeinmedizin.de/]. An essential component is the seminar program designed for post-graduate trainees in GP (=GP-trainees) [4]. In 2019, the KWBW conducted 39 seminar days, in which a total of 379 GP-trainees participated.

While digital formats were already used in medical education before the Covid-19 pandemic [5], [6], they have rarely been used for vocational training in Germany. Since the regulations for protection against SARS-CoV-2 [7] were issued, the KWBW has converted the seminars that had already been planned in presence into digital formats in only four weeks. The project implementation was based on a modified Kern cycle [8]. In accordance with the requirements and objectives (steps 1-3 according to Kern), it was decided to hold up the standards of high quality in content and educations while maintaining the interactive character in the online format. A synchronous teaching format in the form of webinars was chosen as teaching method (step 4 according to Kern). For a better understanding of the content, the possibility of more intensive work during the seminars and to promote in-depth learning [9], preparatory and follow-up tasks were specified, based on the online inverted classroom model (oICM) [10]. This is a variant of the flipped classroom method [11]. To stimulate self-reflection, the preparatory tasks were carried out with a portfolio, the competence-based curriculum for general practice [12]. For the implementation (step 5 according to Kern), the technical aspects were considered as threats when implementing the E-EST. For this purpose, participants were requested to use a cable-based Internet connection, a headset and a software-based application (instead of a browser-based one). The evaluation (step 6 according to Kern) was carried out with a multicenter newly developed and pre-piloted questionnaire. For the participants it contained six questions on sociodemographic data and 22 questions on the format of e-learning. For the lecturers it contained six sociodemographic questions and 29 questions on e-learning.

The aim of this study was to evaluate the acceptance of digital teaching formats and to explore the advantages and disadvantages compared to traditional face-to-face teachings from the trainee’s (=GP-trainees) as well as trainers’ (=lecturers) perspective.


Results and discussion

From 23.04.2020 to 09.05.2020 five seminar days were conducted online (offer for 125 GP-trainees). n=104 attended. A total of 101 GP-trainees (response rate 97.1%) and all lecturers (n=11) who were not employees of the KWBW participated. Table 1 [Tab. 1] depicts sociodemographic data. 28.7% (n=29) of GP-trainees and 45% (n=5) of the lecturers had already experienced e-learning. 52% (n=53) of the GP-trainees and 55% (n=6) of the lecturers have changed their attitude towards e-learning (all comments in the free text sections were positive changes in attitude). The results of the evaluation from the GP-trainees’ point of view are shown in figure 1 [Fig. 1]. Nine lecturers (82%) were satisfied or very satisfied with the idea of e-learning, all of them would like to be involved in a digital format again. 55% (n=6) assessed the learning success for GP-trainees to be worse, 45% (n=5) considered it comparable to classical teaching formats. All lecturers felt that the interaction with the GP-trainees was worse (n=7) or significantly worse (n=4). Advantages and disadvantages of e-learning from the trainees’ and trainers’ perspective are shown in table 2 [Tab. 2] and table 3 [Tab. 3].

In this short report we show for the first time that the conversion of an education program for GP-trainees into a digital format is possible at short notice and can be seen as an opportunity by the learners. Previous studies of the acceptance of e-learning in continuing medical education, reported a reserved basic attitude [13]. This seems to have changed positively with the increasing spread of electronic media [14], [15], which our results confirm. Half of the GP-trainees stated that their attitude towards e-learning had changed positively through participation. The main reasons cited were that it had exceeded existing expectations (n=13) and was a good alternative in the current situation (n=5). The limited opportunities for interaction with the lecturers and with each other were critically assessed. The explicit goal of the KW is to contribute not only to the transfer of knowledge, but also to the networking among GP-trainees and their professional identity in GP [2]. However, the limited exchange of information has also been described by others [16], e.g. students would also like to have more opportunities for interaction in e-learning [17]. Lecturers evaluated the e-learning experience surprisingly positive, but scrutinized whether the increase in learning is comparable to a classroom event. Qualitative studies with lecturers are necessary with regard to the justification of this position as well as possible changes in attitude.

The high acceptance of the flipped classroom method shows that the integration of activating elements can be successful. The preparatory tasks were considered to be helpful by n=83 (82%). The reasons given were a positive effect on learning success (n=30), a better understanding of content (n=25) and a comparable level of knowledge of the ÄiW (n=6). This method has rarely been evaluated in vocational training in Germany [5]. Studies with medical students show that it can contribute positively to motivation and commitment [18]. In particular, it can help to promote deep learning [19]. These effects are not only limited to e-learning [20], therefore the positive attitude of the ÄiW described by us can also motivate a broad implementation of the flipped classroom in face-to-face seminars.

A strength of this study is the high number of responses. Approximately one fifth of the places stayed vacant (comparable to participation in face-to-face seminars). We do not know whether professional or family obligations during the pandemic or the format itself (e.g. insufficient access or lack of inner readiness) influenced the registration. Changes in attitude can only be rudimentarily presented in a questionnaire, for a more detailed exploration a qualitative follow-up study is necessary.

Despite all the opportunities offered by the digital possibilities, it is important to maintain the regional personal reference during the seminar days. During medical school and the clinical training of vocational trainees there is interdisciplinary and social interaction with colleagues on a regular basis. These opportunities are not available in general practice. This gap had been closed by our face-to-face seminars [2]. E-learning can contribute to a better compatibility of education and family tasks, especially for GP-trainees in rural regions. It can hereby further increase the attractiveness of general practice. The results of our work motivate us to implement e-learning beyond the Covid-19 pandemic as a supplement at the KWBW. Further studies on e-learning in vocational training and continuing medical education are needed with an emphasize on how the social interaction of colleagues can be improved parallelly to a continuous increase in learning.


Competing interests

The authors declare that they have no competing interests.


References

1.
Kassenärztliche Bundesvereinigung. Vereinbarung zur Förderung der Weiterbildung gemäß § 75a SGB V Anlage IV Förderung von Qualität und Effizienz der Weiterbildung. Berlin: Kassenärztliche Bundesvereinigung; 2019. Zugänglich unter/Available from: https://www.kbv.de/media/sp/Foerderung_Allgemeinmedizin_Anlage4.pdf External link
2.
Schwill S, Magez J, Joos S, Steinhäuser J, Ledig T, Rubik A, Niebling W, Szecsenyi J, Flum E. New paths in post-graduate medical training in general practice-8 years of experience with the pilot project Verbundweiterbildungplus Baden-Württemberg. GMS J Med Educ. 2017;34(5):Doc62. DOI: 10.3205/zma001139 External link
3.
Steinhauser J, Roos M, Haberer K, Ledig T, Peters-Klimm F, Szecsenyi J, Joos S. Bericht aus der Praxis: Das Programm Verbundweiterbildungplus des Kompetenzzentrums Allgemeinmedizin Baden-Württemberg - Entwicklung, Umsetzung und Perspektiven [Report from general practice: the composite graduate education(plus) program of the Baden-Wurttemberg General Practice Competence Center - development, implementation and prospects]. Z Evid Fortbild Qual Gesundhwes. 2011;105(2):105-109. DOI: 10.1016/j.zefq.2011.02.002 External link
4.
Flum E, Magez J, Aluttis F, Hoffmann M, Joos S, Ledig T, Oeljeklaus L, Simon M, Szecsenyi J, Steinhäuser J. Das Schulungsprogramm der Verbundweiterbildungplus Baden-Württemberg: Entwicklung und Implikationen für die Implementierung von Verbundweiterbildungsprogrammen in Deutschland. Z Evid Fortbild Qual Gesundhwes. 2016;112:54-60. DOI: 10.1016/j.zefq.2016.03.02 External link
5.
Kuhn S, Frankenhauser S, Tolks D. Digitale Lehr-und Lernangebote in der medizinischen Ausbildung. Bundesgesundheitsbl Gesundheitsforsch Gesundheitsschutz. 2018;61(2):201-209. DOI: 10.1007/s00103-017-2673-z External link
6.
Vaona A, Banzi R, Kwag KH, Rigon G, Cereda D, Pecoraro V, Tramacere I, Moja L. E-learning for health professionals. Cochrane Database Syst Rev. 2018;1(1):CD011736. DOI: 10.1002/14651858.CD011736.pub2 External link
7.
Bundesland Baden-Württemberg. Verordnung der Landesregierung über infektionsschützende Maßnahmen gegen die Ausbreitung des Virus SARS-Cov-2 (Corona-Verordnung - CoronaVO). Stuttgart: Bundesland Baden-Württemberg; 2020. Zugänglich unter/Available from: https://www.baden-wuerttemberg.de/de/service/aktuelle-infos-zu-corona/aktuelle-corona-verordnung-des-landes-baden-wuerttemberg/ External link
8.
Kern D, Thomas P, Howard D, Bass E. Curriculum development for medical education. A six-step approach. Baltimore: The Johns Hopkins University Press; 1998. Chapter Four: Step. 1991;34:29.
9.
Marton F, Säljö R. On qualitative differences in learning: I-Outcome and process. Br J Educ Psychol. 1976;46(1):4-11. DOI: 10.1111/j.2044-8279.1976.tb02980.x External link
10.
Tolks D, Romeike BF, Ehlers J, Kuhn S, Kleinsorgen C, Huber J, Fischer MR, Bohne C, Hege I. The online inverted classroom model (oICM). A blueprint to adapt the inverted classroom to an online learning setting in medical and health education. MedEdPublish. 2020;9. DOI: 10.15694/mep.2020.000113.1 External link
11.
Tolks D, Schäfer C, Raupach T, Kruse L, Sarikas A, Gerhardt-Szép S, Klauer G, Lemos M, Fischer MR, Eichner B, Sostmann K, Hege I. An introduction to the inverted/flipped classroom model in education and advanced training in medicine and in the healthcare professions. GMS J Med Educ. 2016;33(3):Doc46. DOI: 10.3205/zma001045 External link
12.
Steinhaeuser J, Chenot JF, Roos M, Ledig T, Joos S. Competence-based curriculum development for general practice in Germany: a stepwise peer-based approach instead of reinventing the wheel. BMC Res Notes. 2013;6(1):314. DOI: 10.1186/1756-0500-6-314 External link
13.
Vollmar HC, Rieger MA, Butzlaff ME, Ostermann T. General Practitioners' preferences and use of educational media: a German perspective. BMC Health Serv Res. 2009;9(1):31. DOI: 10.1186/1472-6963-9-31 External link
14.
Shabli S, Heuermann K, Leffers D, Kriesche F, Abrams N, Yilmaz M, Klußmann JP, Guntinas-Lichius O, Beule A. Umfrage zum Bedarf einer e-Learning-Plattform für Ärzte in der HNO-Facharzt-Weiterbildung. Laryngorhinootologie. 2019;98(12):869-876. DOI: 10.1055/a-1025-2024 External link
15.
Necknig U, Sterz J, Leyh H, Fischer M. Urologie onLINE-Webinar für Assistenten. Urologe. 2019;58(6):658-665. DOI: 10.1007/s00120-018-0845-6 External link
16.
Hoffmann E. E-Learning als wirkungsvolles Element der Digitalisierung. Industrie 40 für die Praxis. Heidelberg: Springer; 2018. p.201-220. DOI: 10.1007/978-3-658-21118-9_15 External link
17.
Busse B, Bargel T. Befragungen zu E-Learning an Hochschulen: Erfahrungen und Sicht der Studierenden. Konstanz: Universität Konstanz; 2017.
18.
Chen F, Lui AM, Martinelli SM. A systematic review of the effectiveness of flipped classrooms in medical education. Med Educ. 2017;51(6):585-597. DOI: 10.1111/medu.13272 External link
19.
McLean S, Attardi SM, Faden L, Goldszmidt M. Flipped classrooms and student learning: not just surface gains. Adv Physiol Educ. 2016;40(1):47-55. DOI: 10.1152/advan.00098.2015 External link
20.
Hew KF, Lo CK. Flipped classroom improves student learning in health professions education: a meta-analysis. BMC Med Educ. 2018;18(1):38. DOI: 10.1186/s12909-018-1144-z External link