gms | German Medical Science

GMS Journal for Medical Education

Gesellschaft für Medizinische Ausbildung (GMA)

ISSN 2366-5017

One year of general practice during the COVID-19 pandemic – presentation and evaluation of digital medical education

article community medicine

  • corresponding author Piet van der Keylen - Friedrich-Alexander-University Erlangen-Nürnberg, Institute of General Practice, University Hospital Erlangen, Erlangen, Germany
  • author Nikoletta Zeschick - Friedrich-Alexander-University Erlangen-Nürnberg, Institute of General Practice, University Hospital Erlangen, Erlangen, Germany
  • author Anna-Lena Langer - Friedrich-Alexander-University Erlangen-Nürnberg, Institute of General Practice, University Hospital Erlangen, Erlangen, Germany
  • author Thomas Kühlein - Friedrich-Alexander-University Erlangen-Nürnberg, Institute of General Practice, University Hospital Erlangen, Erlangen, Germany
  • author Marco Roos - Universität Augsburg, Medizinische Fakultät, Lehrstuhl für Allgemeinmedizin, Augsburg, Germany

GMS J Med Educ 2022;39(3):Doc29

doi: 10.3205/zma001550, urn:nbn:de:0183-zma0015509

This is the English version of the article.
The German version can be found at: http://www.egms.de/de/journals/zma/2022-39/zma001550.shtml

Received: February 28, 2022
Revised: April 21, 2022
Accepted: May 5, 2022
Published: July 15, 2022

© 2022 van der Keylen et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Abstract

Background and teaching situation: The SARS-CoV-2 pandemic had a substantial didactic impact on medical teaching. In Erlangen, the lecture “General Practice” was offered asynchronously and digitally in an inverted-classroom concept. Contents were available via a learning platform. The lecture was presented using annotated videos, consolidation materials and control questions. A forum encouraged for discussions and feedback and collected in-depth aspects for a case-based video consultation. The aim of this work is to evaluate and critically examine the digital teaching concept during the SARS-CoV-2 pandemic.

Methodology: Two semester cohorts evaluated the lecture. Overall impression of the lecture, didactic elements, suitability and the desired future lecture format were surveyed quantitatively. Free text answers were evaluated by means of qualitative content synthesis.

Results: In terms of overall impression, the students (N=199) rated the lecture on average as “very good” (M=1.41, SD=.57). Digital methods were perceived as suitable for supporting self-study, and digital usage was rated as unproblematically (M=1.18, SD=.50). Desired future teaching formats were blended learning concepts (79.4%). Organisation, structure and content presentation were highly appreciated. The time for completing the course was perceived critically. The students urged for more practical and consolidating lecture work.

Discussion and implications: The results illustrate high acceptance of digital teaching and underline the demand for future blended learning concepts. It is particularly important to better consider the students’ time investment and practical relevance of digital self-learning mechanisms.

Keywords: digital teaching, COVID-19, general practice, inverted classroom, blended learning


1. Background

1.1. Impacts of the pandemic

The SARS-CoV-2 pandemic generated circumstances in Germany [1] that may offer potential for sustainable changes in medical teaching and didactics. One challenge was the sustainable transformation of established courses into a modern, digital format in a short time. Although the Masterplan for Medical Studies 2020 and the German Council of Science and Humanities have long been pointing out the urgency to digitise medical teaching [2], [3], it was the SARS-CoV-2 pandemic that created the necessary pressure to take action. Medical faculties are also aware of the importance of the digitalisation of the healthcare system and the impact on the medical curriculum [4].

1.2. Teaching situation

Erlangen anchors general practice in the 1st clinical semester as a lecture with two semester hours per week (Semesterwochenstunden; SWS). Core contents are primary (general) medicine in acute low-prevalence consultations, the care of patients with common (chronic) diseases and methods of (also digital) information retrieval by the means of evidence-based medicine. Pre-pandemically, general practice was organised as a classroom lecture to convey content on the basis of consultation cases. The content had already been made digitally available beforehand via an ILIAS learning platform. Using this learning platform and its digital possibilities, the “lecture general practice” and the clinical elective “Smart decisions in everyday clinical practice” were offered fully digitally for the first time in the summer term 2020 [5], [6].The main didactic idea was to promote the digitalisation of general practice teaching in the curriculum as well [7]. Furthermore, other subjects within the medical curriculum are also showing efforts to transform digital teaching through inverted classroom models [8], [9], [10]. In addition to changing the teaching method, the complexity of the learning goals was transformed from a rather content-oriented level to a more reflective and consolidating level. With this, the heterogeneity of medical procedures in general practice is facilitated beyond factual knowledge and medical guideline recommendations. This work presents an asynchronous, fully digital concept for curricular teaching of general practice. Primary research questions of this work are:

  • How do students evaluate the concept presented?
  • What is the potential for improvement and what digital format do students request for the future?

Thus, approaches for further development after SARS-CoV-2 shall be compiled.


2. Concept and methods

The lecture content was offered asynchronously, i.e. communication and interaction between teachers and learners took place at different times. On the basis of a pilot work [6], didactic and content-related adaptations (esp. improvement of the video material, purely audio-commented presentations were now additionally video-commented and provided with further content, such as links and QR codes) were made for the subsequent terms presented here (winter term 2020/2021 and summer term 2021).

2.1. Digital transformation

The time slots of the formerly 90-minute lectures were offered as video-commented recordings. For this purpose, each lecture was divided into three to five smaller, shorter topic blocks (10 to 30 minutes, “segmenting principle”) [11] and made available by audio or video annotated presentation (.mp4) via the ILIAS learning platform [https://www.studon.fau.de]. Total duration of the video content should not exceed 45-60 minutes per lecture to reduce content emphasis and, in the sense of the inverted classroom concept, create more time to the critical examination of content and higher learning objective complexities. From the second online semester onwards, the contents of the entire semester were already available at the beginning of the semester to enable even more individual learning independent from time and location. In order to consolidate individual topic blocks, activating assignments for self-study were integrated into the learning platform. Thereby, digital passivity was to be antagonised already during the content presentation stage. The theoretical content was now applied to patient cases and reflective discussions of guideline recommendations and research papers were introduced. After this type of content presentation, digital exercise questions were provided via the learning platform for self-monitoring, which included feedback and explanation functions. To counteract possible content-related ambiguities during self-study, an interactive forum was offered via the learning platform, where discussion for the students, feedback possibilities and interaction with the lecturers were provided. A weekly reflective video consultation session with the lecturers was also offered (university-internal zoom platform). This 45 to 60-minute live appointment served several didactical ideas:

1.
The possibility of bridging the personal distance to the lecturers (“personalisation principle”) [12].
2.
The opportunity of an optional learning- and time-structure as an aid to students who perceive a learning environment without distinct time and place commitments insufficient.
3.
Consolidation of content (and not its repetition) in the sense of exam preparation.

Thus, a digital variant of an inverted classroom concept was created [13]. This variant now offered the possibility of reflective learning in an asynchronous, location- and time-independent environment, a highly individual learning pace with constantly recurring points of contact with the lecturers via a supervised forum and virtual face-to-face consultation hours. Figure 1 [Fig. 1] shows the didactic teaching concept.

2.2. Evaluation

After completing the lecture, an anonymous evaluation was carried out by the students via the learning platform. It contained self-developed items that were adapted to the digital concept of the lecture beyond the cumulative evaluation of the faculty. The overall impression of the lecture, didactic elements and methods, clarity of digital instructions as well as the desired future form of attendance were evaluated. The response format followed the German school grade principle (grades 1-6 (1=“very good”, 6=“insufficient”) or a 5-point Likert scale (1=“fully agree” to 5=“fully disagree”). Lastly, free text answers were also possible on further desired digital elements and criticism. The open, qualitative free-text evaluation was comprised of two questions:

1.
What further digital elements would you like to see in the lecture for the future?
2.
What other wishes (or criticism) do you have (feedback, further suggestions for improvement)?

Quantitative evaluation was carried out by exporting the data from the learning platform into an excel format for data preparation and depiction (Excel 2019, Microsoft Systems, Redmond, WA, USA). The free text answers were processed by qualitative content synthesis [14] through inductive category formation with the help of the software QCAmap [https://www.qcamap.org/].


3. Results

3.1. Quantitative evaluation

The students rated the overall impression of the lecture according to German school grades (response rate N=199/343; 58.0%, see figure 2 [Fig. 2]) as “very good” on average (M=1.41, SD=.57). Digital elements and methods were perceived as predominantly suitable for supporting self-study. The digital lecture videos (M=1.19, SD=.49) were rated best in comparison to the forum (M=2.11, SD=1.05), which offers potential for improvement. The instructions for digital use were rated as mostly clear (M=1.42, SD=.72) and unproblematic (M=1.18, SD=.50). The predominantly desired future teaching and learning formats for the general practice lecture were “Digital focus & consolidation in face-to-face attendance” (42.7%; N=85) and “Focus on face-to-face attendance & digital support” (36.7%; N=73). Only 3.5% of the students wanted a pure face-to-face attendance.

3.2. Qualitative evaluation

Figure 3 [Fig. 3] shows the categories, subcategories and individual aspects of the free-text comments of the two open questions prepared according to inductive content synthesis. Two main categories “commendation” and “criticism and suggestions for improvement” were created. For each main category, three subcategories were formed, each comprising up to three individual aspects. The individual aspects were weighted according to number of mentions in a descending order.


4. Discussion

The quantitative evaluation of two semester cohorts in general practice shows a very good acceptance of asynchronous, digital teaching by the students during the pandemic. A demand for blended learning teaching concepts was particularly prominent. There was little demand for digital-only or pure face-to-face events with physical attendance for future teaching in general practice. The qualitative statements support the quantitative evaluation, especially in the subcategories of organisation, structure and content. However, distinct potential for improvement of the teaching concept was identified. The most profound criticism by the students was, that time investment was perceived as too high. Additionally, times of distanced teaching and learning show a demand for even more content-related discussion and active practice with the presented content. Technical aspects such as the demand for an individual playback speed of video and audio material play a minor role.

4.1. Factor: time

Although asynchronous, digital teaching allows students a lot of flexibility, an individual learning pace and locational independence in clinical teaching, this concept offers potential for improvement. The students’ main criticism was the increased time factor for completing the lecture. Both the preparation and consolidation phases should be considered when calculating the time required to not create an additional time burden on students with a "digital on top" measure. Considering the time required for content preparation (45-60 min.), consolidation through the video consultation (45-60 min.) and self-study consolidation phase through exercises and control questions (5-15 min.), the workload appears to be significantly higher than two SWS. From a didactic point of view, however, not only the pure time spent during the semester should be weighed against each other, but also the amount of time effectively used by the students. This concept translocated the main part of in-depth self-study and exam preparation to a phase together with the lecturers and digital connection and guidance. Following this, self-study can be flexibly structured, and preparation phases for the exam can also be effectively disburdened for the students. Particularly passive content transfer holds potential for demotivation with digitalisation [15] and must shift towards active handling of content, reflective consolidation and practical application. Faculty learning portals should also implement common individualisation functionalities (e.g. for individual playback speeds) in order to strengthen digital teaching technically as well.

4.2. Practical teaching

A desire for more practice-oriented teaching is depicted by the demands for more guideline work, exercises and control questions together with the lecturers and practical examples. On the one hand, this illustrates the potential for teaching general practice content based on distinct situations in the actual field of work. On the other hand, the desire for active and reflective handling of information shows that too much time is still given to theoretical information transfer. This is particularly relevant because reflective consolidation offers potential during the semester and can thus significantly relieve the exam preparation time in self-study. The presented concept offers adjustment potential for a more effective use of students’ learning time.

4.3. Bypass physical distance

The concept offers the opportunity to motivate students and grant flexibility in the digital medical curriculum [16]. Physical distance can be proactively addressed through a digital consultation hour or an asynchronous forum, thus favouring motivating self-learning strategies. The evaluated appreciation (in terms of the human and digital engagement during the pandemic) shows that an emotional connection of students to an asynchronously and digitally taught clinical subject can be generated [17]. Digital teaching can also be successfully used in courses with patient contact [18], [19].

4.4. Accelerate self-study

Students rate the various digital elements differentiated in their suitability for self-study. The content-conveying annotated videos and the control questions are perceived as most suitable for self-study. More in-depth and reflective elements such as further reading and video tutorials score a little lower in this respect. The interactive forum is still perceived as suitable by more than 70% of the students, but drops in its suitability for self-study as a digital method. Important implications for digital teaching according to the inverted classroom concept within medicine arise:

1.
Medical students should be confronted with the inverted classroom concept at an early stage, as the focus of students, especially in the first clinical semester, remains on purely content-based learning objectives in clinical subjects. The shift to suitable self-learning strategies should occur early, as these strategies remain an important basis for subsequent continuing medical education.
2.
Digital elements must be evaluated with regard to their suitability for self-study. Digital elements in particular, such as consultation hours and the forum, must offer clear and tangible additional value for students in terms of consolidation and exam preparation. Otherwise they will be perceived as mere digital delivery of additional content. Open communication of expectations, teaching concept and didactic methods can help students to be more satisfied with digital teaching [20].
4.5. Quo vadis – blended learning in medicine?

The new normality [21] requires a review of all preclinical and clinical subjects with regard to their potential for digitalisation. As our preliminary investigation, the present paper and another study show, the focus of digital teaching concepts in the future will be particularly on blended learning teaching concepts [6], [17]. However, lecturers were initially confronted with an increased time requirement to develop digital concepts, which resulted in additional burdens [22], [23]. The recognition of digital teaching (e.g. teaching effort calculation, digital didactics training) by the faculties is an important step towards recognising and promoting digital teaching achievements. This is also necessary so that the increased workload for students and lecturers in pilot semesters does not act as a deterrent leading to a post-pandemic return to the familiar, purely content-based formats in medicine. The present work shows that students were very satisfied with a structured and openly communicated asynchronous digital teaching concept in the inverted classroom model in general practice. For the future, students would like to see blended learning concepts. The digital flexibility should be maintained, and the phases of content transfer should be shortened in favour of practical, in-depth work together with the lecturers.


5. Limitations

This paper reports an evaluation of two semester cohorts in general practice at a Bavarian university in medicine. The study can therefore initially provide a report of the status quo for the subject of general practice. A valid comparison of the concept within the faculty and with other universities is not feasible due to the heterogeneity of teaching concepts. Moreover, in the case of voluntary evaluation, sample bias due to varying willingness to participate cannot be excluded.


Notes

First authorship/author contributions

The authors Piet van der Keylen and Nikoletta Zeschick contributed equally to the present work and share the first authorship.

PK and NZ were responsible for manuscript preparation, collection and analysis of data and development of the evaluation. AL was responsible for the extraction, processing and presentation of the data. TK and MR revised and edited the manuscript. MR and NZ developed the evaluation. PK, MR and TK were mutually responsible for the development and implementation of the teaching idea. The present thesis was written in (partial) fulfilment of the requirements for obtaining the doctoral degree Dr. rer. biol. hum. for NZ.

Data availability and data protection

All primary data collected can be requested in anonymised form from the authors. The anonymous collection of data with an internal, password- and access-protected learning platform ensured at all times that only participants of the specific event were able to evaluate. At no time was it technically possible to trace the data back to individual participants.


Acknowledgements

We would like to sincerely thank the students of the "covid cohorts" being available for the evaluation and thus the completion of the present work. The authors would like to thank the medical faculty for its advice on digital implementation in the context of the pandemic conditions.


Competing interests

The authors declare that they have no competing interests.


References

1.
Bayerisches Staatsministerium für Wissenschaft und Kunst. Grundlegendes zum Hochschulbetrieb, zum kulturellen Leben, zu Hilfen im Kunst- und Kulturbereich und zur Forschung. München: Bayerisches Staatsministerium für Wissenschaft und Kunst; 2021. Zugänglich unter/available from: https://www.stmwk.bayern.de/allgemein/meldung/6461/faq-grundlegendes-zum-hochschulbetrieb-zum-kulturellen-leben-zu-hilfen-im-kunst-und-kulturbereich-und-zur-forschung.html External link
2.
Bundesministerium für Bildung und Forschung. „Masterplan Medizinstudium 2020“. Berlin: Bundesministerium für Bildung und Forschung; 2017. Zugänglich unter/available from: https://www.bmbf.de/files/2017-03-31_Masterplan%20Beschlusstext.pdf External link
3.
Wissenschaftsrat. Neustrukturierung des Medizinstudiums und Änderung der Approbationsordnung für Ärzte. Empfehlungen der Expertenkommission zum Masterplan Medizinstudium 2020. Drs. 7271-18. Köln: Wissenschaftsrat; 2018. Zugänglich unter/available from: https://www.wissenschaftsrat.de/download/archiv/7271-18.pdf External link
4.
Neumann M, Fehring L, Kinscher K, Truebel H, Dahlhausen F, Ehlers JP, Mondritzki T, Boehme P. Perspective of German medical faculties on digitization in the healthcare sector and its influence on the curriculum. GMS J Med Educ. 2021;38(7):Doc124. DOI: 10.3205/zma001520 External link
5.
Lippert N, Frank L, Schnitzius K, Stubner BM, Kühlein T, Roos M, van der Keylen P. Auswirkungen eines Wahlfachs zur evidenzbasierten klinischen Entscheidungsfindung auf die Kompetenzen und Einstellungen von Medizinstudierenden: Eine Pilotstudie [Impact of an elective course in evidence-based clinical decision-making on competencies and attitudes of medical students: A pilot study]. Z Evid Fortbild Qual Gesundhwes. 2021;162:70-8. DOI: 10.1016/j.zefq.2021.02.010 External link
6.
van der Keylen P, Lippert N, Kunisch R, Kühlein T, Roos M. Asynchronous, digital teaching in times of COVID-19: a teaching example from general practice. GMS J Med Educ. 2020;37(7):Doc98. DOI: 10.3205/zma001391 External link
7.
Streitlein-Böhme I, Woestmann B, Vollmar HC, Böhme K. We can also do online - evaluation of the accompanying digital seminar of the elective subject "General Practice" during intership (PJ) at Ruhr-University Bochum. GMS J Med Educ. 2021;38(4):Doc73. DOI: 10.3205/zma001469 External link
8.
Teichgraber U, Mensel B, Franiel T, Herzog A, Cho-Noth CH, Mentzel HJ, Ingwersen M, et al. Virtual inverted classroom to replace in-person radiology lectures at the time of the COVID-19 pandemic - a prospective evaluation and historic comparison. BMC Med Educ. 2021;21(1):611. DOI: 10.1186/s12909-021-03061-4 External link
9.
Martini ML, Yaeger KA, Kellner CP, Hadjipanayis C, Shrivastava R, Mocco J, Morgenstern PF. Student Survey Results of a Virtual Medical Student Course Developed as a Platform for Neurosurgical Education During the Coronavirus Disease 2019 Pandemic. World Neurosurg. 2021;152:e250-e265. DOI: 10.1016/j.wneu.2021.05.076 External link
10.
Crome M, Adam K, Flohr M, Rahman A, Staufenbiel I. Application of the inverted classroom model in the teaching module "new classification of periodontal and peri-implant diseases and conditions" during the COVID-19 pandemic. GMS J Med Educ. 2021;38(5):Doc89. DOI: 10.3205/zma001485 External link
11.
Clark RC, Mayer RE. Applying the segmenting and pretraining principles: managing complexity by breaking a lesson into parts. In: Clark RC, Mayer RE, editors. E-Learning and the Science of Instruction: Proven Guidelines for Consumers and Designers of Multimedia. Hoboken, NJ: Wiley & Sons; 2010. p.201-218. DOI: 10.1002/9781119239086.ch10 External link
12.
Mayer RE. Principles of multimedia learning based on social cues: Personalization, voice, and image principles. In: Mayer RE, editor. The Cambridge handbook of multimedia learning. Cambridge: Cambridge University Press. 2005. p.201-212. DOI: 10.1017/CBO9781139547369.017 External link
13.
Tolks D, Schäfer C, Raupach T, Kruse L, Sarikas A, Gerhardt-Szép S, Kllauer G, Lemos M, Fischer MR, Eichner B, Sostmann K, Hege I. An introduction to the inverted/flipped classroom model in education and advanced training in medicine and in the healthcare professions. GMS J Med Educ. 2016;33(3):Doc46. DOI: 10.3205%2Fzma001045 External link
14.
Mayring P, editor. Qualitative content analysis: theoretical foundation, basic procedures and software solution. Klagenfurt: Weinheim, Beltz; 2014. DOI: 10.1007/978-94-017-9181-6_13 External link
15.
Stephan M, Markus S, Gläser-Zikuda M. Students' Achievement Emotions and Online Learning in Teacher Education. Front Educ (Lausanne). 2019;4:Article 109. DOI: 10.3389/feduc.2019.00109 External link
16.
Chen F, Lui AM, Martinelli SM. A systematic review of the effectiveness of flipped classrooms in medical education. Med Educ. 2017;51(6):585-597. DOI: 10.1111/medu.13272 External link
17.
Weissmann Y, Useini M, Goldhahn J. COVID-19 as a chance for hybrid teaching concepts. GMS J Med Educ. 2021;38(1):Doc12. DOI: 10.3205/zma001408 External link
18.
Harendza S, Gartner J, Zelesniack E, Prediger S. Evaluation of a telemedicine-based training for final-year medical students including simulated patient consultations, documentation, and case presentation. GMS J Med Educ. 2020;37(7):Doc94. DOI: 10.3205/zma001387 External link
19.
Haucke E, Walldorf J, Ludwig C, Buhtz C, Stoevesandt D, Clever K. Application of telepresence systems in teaching - transfer of an interprofessional teaching module on digital aided communication into the block training "internal medicine" during the Covid-19 pandemic. GMS J Med Educ. 2020;37(7):Doc84. DOI: 10.3205/zma001377 External link
20.
Seifert T, Becker T, Buttcher AF, Herwig N, Raupach T. Restructuring the clinical curriculum at University Medical Center Gottingen: effects of distance teaching on students' satisfaction and learning outcome. GMS J Med Educ. 2021;38(1):Doc1. DOI: 10.3205/zma001397 External link
21.
Harendza S. The "new" normal. GMS J Med Educ. 2021;38(2):Doc48. DOI: 10.3205/zma001444 External link
22.
Gottschalk M, Werwick K, Albert C, Weinert S, Schmeisser A, Stieger P, Braun-Dullaeus RC. Digitalization of presence events in the COVID-19 pandemia - the lecturers' perspective. GMS J Med Educ. 2021;38(1):Doc30. DOI: 10.3205/zma001426 External link
23.
Herrmann-Werner A, Erschens R, Zipfel S, Loda T. Medical education in times of COVID-19: survey on teachers' perspectives from a German medical faculty. GMS J Med Educ. 2021;38(5):Doc93. DOI: 10.3205/zma001489 External link