gms | German Medical Science

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA)

25.09. - 27.09.2014, Hamburg

Unravelling the testing effect: a qualitative study on the effectiveness of formative key feature examinations as an instructional method

Vortrag

Jahrestagung der Gesellschaft für Medizinische Ausbildung (GMA). Hamburg, 25.-27.09.2014. Düsseldorf: German Medical Science GMS Publishing House; 2014. DocV445

doi: 10.3205/14gma310, urn:nbn:de:0183-14gma3108

Published: September 11, 2014

© 2014 Andresen et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by-nc-nd/3.0/deed.en). You are free: to Share – to copy, distribute and transmit the work, provided the original author and source are credited.


Outline

Text

Introduction: Summative assessments are powerful drivers of student learning; their effect on learning outcome is largely moderated by their impact on learning behaviour. In contrast to this, formative assessments help students to identify potential areas of improvement. However, recent research suggests that formative assessments may also enhance knowledge acquisition by inducing specific learning processes on the subconscious level. This qualitative study aimed at identifying evidence of this phenomenon (also termed ‘direct testing effect’) in medical students using formative assessments to train higher-order cognitive skills.

Methods: In winter 2013/14, fourth-year medical students participated in a randomised trial on the effectiveness of formative key feature (KF) questions versus a reading assignment. After the final exam, students shared their views on how these E-learning sessions had impacted on their learning outcome in three focus group discussions. Content analysis was conducted by two different researchers.

Results: Student comments referred to four distinct themes: comparison between KF questions and reading assignments / learning processes / implementation / future developments. Compared to reading assignments, students perceived KF questions as motivating due to their being directly related to clinical practice. They also felt that KF questions enhanced knowledge retention by forcing them to actively produce an answer rather than simply reproducing factual knowledge. The feedback provided with correct answers was also valued highly by students. While the software used was deemed suboptimal, there were numerous positive comments on implementation within the context of the undergraduate curriculum. Students felt that clinical cases helped them draw connections between different areas of internal medicine.

Discussion/conclusion: These qualitative data support the hypothesis that formative KF assessments enhance learning outcome by promoting learning processes [1], [2], [3], [4].


References

1.
Roediger HL, Karpicke JD. The Power of Testing Memory - Basic Research and Im-plications for Educational Practice. Perspect Psychol Sci. 2006;1:181-210.
2.
Kromann CB, Jensen ML, Ringsted C. The effect of testing on skills learning. Med Educ. 2009;43(1):21-27. DOI: 10.1111/j.1365-2923.2008.03245.x External link
3.
Schmidmaier R, Ebersbach R, Schiller M, Hege I, Holzer M, Fischer MR. Using electronic flashcards to promote learning in medical students: retesting versus restudying. Med Educ. 2011;45(11):1101-10. DOI: 10.1111/j.1365-2923.2011.04043.x. External link
4.
Wood T. Assessment not only drives learning, it may also help learning. Med Educ. 2009;43(1):5-6. DOI: 10.1111/j.1365-2923.2008.03237.x External link