gms | German Medical Science

68. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS)

17.09. - 21.09.23, Heilbronn

Learning Analytics in Virtual Patients: practical use and lessons learned

Meeting Abstract

Search Medline for

  • Carina Pfeifer - GECKO Institut, Hochschule Heilbronn, Heilbronn, Germany
  • Martin Adler - INSTRUCT gGmbH, München, Germany
  • Martin Haag - Hochschule Heilbronn, Heilbronn, Germany

Deutsche Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie. 68. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS). Heilbronn, 17.-21.09.2023. Düsseldorf: German Medical Science GMS Publishing House; 2023. DocAbstr. 201

doi: 10.3205/23gmds116, urn:nbn:de:0183-23gmds1161

Published: September 15, 2023

© 2023 Pfeifer et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Outline

Text

Introduction: Medical education and training faces many challenges such as rapidly growing amount of knowledge and therefore high complexity of the subjects [1] or seasonal diseases and an increasing amount of critically ill patients in hospitals [2]. Virtual patients have been used in medical education and training for many years and have shown to be a solution to these problems [2]. In addition, studies have shown an enhancement in learning results while using virtual patients [3]. For further improvement and optimal usage of virtual patients the combination with learning analytics is pursued. Learning analytics aims to evaluate, analyse and interpret user data that is created in the learning process and provide the participants, teachers and learners, with new insights on how to improve teaching and better understand education [4].

Methods: Although learning analytics have been available for some time, the usage in virtual patients has not been as high as anticipated. Therefore, workshops with the teaching personnel were held to evaluate their needs. Based on the ideas of the workshop the learning data was formatted and made available for the authors via the authoring tool of the virtual patient software CAMPUS CASUS. The authors were provided with different possibilities of viewing and exporting the data from plain answers to prepared graphics and tables. The data source can be limited from all available anonymized data in a course down to individual data. Afterwards it was made possible to choose time slots and to build cohorts of specific students to use the data in certain blended learning scenarios. Workshops and trainings on how to use the data properly were provided several times. Feedback on the usage of these data reports was given by teachers and students regularly over time via different channels like interviews, support requests and evaluations.

Results: Based on the number of retrievals a higher usage of the learning analytics functions and evaluations can be reported. It was also stated that the usage of the learning analytics data led to a more enhanced learning experience on both sides. Teachers could identify misconceptions of their own on which topics they sensed as simple and the learners didn’t and the other way around. Learners could identify for themselves where they had individually additional backlog.

Discussion: These results show that the usage of learning analytics data can enhance the learning experience with virtual patients and give the participants a deeper understanding of the learning process. Furthermore, it was also learned that providing the data is not sufficient to reach its full potential. Teachers need proper instructions in workshops and additional support during the application of the data in their courses. Especially in scenarios with different teaching personnel and tutors the data must be provided via low-threshold access and with back-office support. In prospect the objective is a study to collect qualitative data on learning improvements.

Conclusion: In conclusion learning analytics can enhance the learning experience and results of virtual patients in medical education and training.

The authors declare that they have no competing interests.

The authors declare that an ethics committee vote is not required.


References

1.
Berman NB, Durning SJ, Fischer MR, Huwendiek S, Triola MM. The Role for Virtual Patients in the Future of Medical Education. Acad Med. 2016 Sep;91(9):1217-22. DOI: 10.1097/ACM.0000000000001146 External link
2.
Haag M, Huwendiek S. The virtual patient for education and training: a critical review of the literature. it-Information Technology Methoden und innovative Anwendungen der Informatik und Informationstechnik. 2010;52(5):281-287. DOI: 10.1524/itit.2010.0603 External link
3.
Cook DA, Erwin PJ, Triola MM. Computerized virtual patients in health professions education: a systematic review and meta-analysis. Acad Med. 2010 Oct;85(10):1589-602. DOI: 10.1097/ACM.0b013e3181edfe13. External link
4.
Leitner P, Khalli M, Ebner M. Learning Analytics in Higher Education - A Literature Review. In: Peña-Ayala A, editor. Learning Analytics: Fundaments, Applications, and Trends. Cham: Springer; 2017. (Studies in Systems, Decision and Control; vol. 94). p. 1-23. DOI: 10.1007/978-3-319-52977-6_1 External link