Article
An empirically based checklist to assess teaching quality: development and attempt of validation
Empirisch basierte Checkliste zur Messung von Unterrichtsqualität: Entwicklung und Validierungsansatz
Search Medline for
Authors
Published: | September 2, 2009 |
---|
Outline
Text
Background: Empirically based methods to assess quality in clinical teaching, providing the basis of various studies in educational research and feedback for teachers, do not yet exist.
Methods: Ten empirically based criteria with evidence in school teaching were identified and transferred into a 33-item-checklist using 5-point-Likert-scales:
- 1.
- amount of true learning time,
- 2.
- climate facilitating learning,
- 3.
- clarity of content,
- 4.
- clear structure,
- 5.
- meaningful communication,
- 6.
- diversity of methods,
- 7.
- individual promotion,
- 8.
- intelligent practicing,
- 9.
- transparent expectations,
- 10.
- prepared setting.
An external observer used the checklist analysing 28 clinical teaching sessions (bedside teaching and seminars). Results were compared to evaluation questionnaires from students, presenting the bare (non-operationalised) 10 criteria, each beeing explanied by sufficient examples.
For comparison the Bland-Altman-method was used by calculating the differences between the two percentages of each method. Equivalence was proposed if the difference layed within a predefined range from - =-1 to + =+1.
Results: Six criteria of clinical teaching sessions layed within the range of equivalence (≥89%), criterion four, five, eight, ten in ≤82%. Generally, there was no significant difference between bedside teaching and seminars, but they differed significantly in four criteria (p<0,05).
Conclusions: The Checklist is an empirically based, validated 33-item instrument to measure quality of teaching sessions.
Checklist and evaluation questionnaire agree sufficiently well concerning six criteria. The operationalization of criteria four, seven, eight and ten might be improved. The checklist is applicable to different teaching methods.
References
- 1.
- Brophy JE. Teaching. Genf: International Bureau of Education (IBE), Educational Practices Series; 2000. Zugänglich unter: http://www.ibe.unesco.org.
- 2.
- Bland JM, Altman DG. Statistical method for assessing agreement between two methods of clinical measurement. Lancet 1986;1(8476):307-310.
- 3.
- Bland JM, Altman DG. Measuring agreement in method comparison studies. Stat Methods Med Res. 1999;8(2):135-160. DOI: 10.1191/096228099673819272.