gms | German Medical Science

GMS Journal for Medical Education

Gesellschaft für Medizinische Ausbildung (GMA)

ISSN 2366-5017

Multi-source evaluation of an educational program aimed at medical students for interviewing/taking the clinical history using standardized patients

article evaluation

  • Sophia Denizon Arranz - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • José Manuel Blanco Canseco - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • María Montserrat Pouplana Malagarriga - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • María Soledad Holgado Catalán - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • María Isabel Gámez Cabero - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • Antonio Ruiz Sánchez - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • Diana Monge Martín - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • Roger Ruiz Moral - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain
  • author Santiago Álvarez Montero - Francisco de Vitoria University, Faculty of Health Sciences, School of Medicine, Madrid, Spain

GMS J Med Educ 2021;38(2):Doc40

doi: 10.3205/zma001436, urn:nbn:de:0183-zma0014360

This is the English version of the article.
The German version can be found at: http://www.egms.de/de/journals/zma/2021-38/zma001436.shtml

Received: January 2, 2020
Revised: September 3, 2020
Accepted: October 19, 2020
Published: February 15, 2021

© 2021 Denizon Arranz et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Abstract

Introduction: Simulations with standardized patients (SP) have long been used for teaching/assessing communication skills. The present study describes and evaluates an experiential training methodology aimed at medical students and based on interviews with standardized simulated patients. The training was focused on developing basic communication skills and taking medical histories.

Methods: Longitudinal observational study of a cohort of third-year medical students. Three interviews with SP were carried out and videotaped. These interviews were assessed by the students, the SPs and the professors of the relevant subject areas.

Results: 83 students conducted the interviews. The self-evaluations performed by the students showed an improvement between the first and third interviews, as demonstrated by the increase of 6.7% (CI 95%=3.6-10.0%) (p<0.001) in the percentage of detected items. The SPs stated an improvement of 8.5% (CI 95%=2.9-14.1) (p=0.003) from the first to the third interview regarding the percentage of students that showed a level of interest in, and ease with, the patients’ concerns. Finally, the teachers found a mean percentage of items identified in the third written clinical history of 61.4% (CI 95%=59.1-63.7) of the total available.

Conclusions: This educational program, carried out with standardized simulated patients, showed positive signs of improvement from the first to the third interview, in both the student self-evaluations and the level of interest and ease perceived by the SPs. Additionally, the mean level of information recorded in the written medical histories was considered to be acceptable.

Keywords: educational program, standardized patients, clinical history, medical students


1. Introduction

The clinical interview is probably the most frequently performed activity in clinical practice [1]. Therefore, eliciting a good clinical history (CH) from a patient is an essential element of effective medical intervention [2]. History taking consists of obtaining relevant personal, psychosocial and symptomatic information from the patient in order to acquire useful data for making a diagnosis and providing medical care [3].

The classic study of Hampton, published in 1975, showed that 66-80% of patients were correctly diagnosed by the CH alone [4]. Other studies show that the CH provides from the majority of new patients on internal or general medicine clinical settings enough information for making a diagnosis even before any physical examination or complementary tests [5].

Taking a good CH requires establishing a set of communication guidelines aimed at building a clinical relationship that facilities the collection of relevant information and stablishes a positive therapeutic partnership from the first moment of contact.

Educational programs aimed at improving communication skills have been developed in the majority of medical schools in the United States [6], Canada [7], Germany [8] and the United Kingdom [9] and Spain [10] where they are considered essential. National accreditation agencies and various expert consensuses have highlighted the importance of training programs that focus on the fundamental skill of taking a CH [11], [12], [13].

It is well known that experiential pedagogic methods are the most effective [14], [15], [16]. However, training of this kind continues to be a challenge, with important questions left unresolved. For example, how can this type of methodology be implemented while producing the least amount of “suffering” for the students [9], [17], [18], [19]? Furthermore, when and in what way should it be implemented [17], [20]? What concrete strategies should be applied in changing educational environments, and with which groups of students [21], [22], [23], [24], [25]?

It has been a challenge to introduce training for the CH interview for students with no previous experience of rotations in health centers in order to to start off their internships as efficiently as possible.

Along the last years, our medical school has developed a curriculum for learning interpersonal skills whose main characteristics are: its development throughout the whole curriculum (from the first to the last year), with diverse contents (from basic communication skills to more specific topics, such as managing emotions, breaking bad news or motivational interviewing) and with experiential methodologies: teaching in small groups, simulated patient interviews, structured feedback and rehearsals, encouraging group discussions and the student's personal reflection on their performance. Details about different aspects of this program and its impact have been published elsewhere [26], [27], [28], [29], [30].

Simulation with SPs has proven to be useful, both as an instruction tool and to assess communication and clinical skills, such as investigative and reasoning skills [31]. In addition, it leads to an improvement in patient safety by reducing the number of potential mistakes in real clinical practice [32]. The SP training is the best way to guarantee the authenticity and reproducibility of clinical simulated encounters [33], [34], [35]. Students have greatly value this experience [36], [37].

Authenticity and feedback have been highlighted as two of the most important variables for determining the quality and the SP training [30]. Our SP receive a training program in which the priority is to guarantee both factors, through a high and diverse pool of SP (authenticity) and a specific scheduled training that includes feedback on their performances and on the way in which the SP themselves must provide feedback to students [38]. When interviews with SPs are recorded, the feedback of second-year medical students is more positive than when these interviews are only observed [39].

The evidence in favor of using SPs in communication skills training for taking CH is growing [40], [41], [42], [43], but still a bit scarce in specific areas [3]. Although there is enough broadly evidence that these skills can be taught, studies with standardized patients and workshops with small groups of preclinical students are sparse. In the Keifenheim et al. systematic review [3] only 6 studies were carried out with SPs, and of them, only two assessed specifically history taking [37], [44]. We provide additional evidence supporting their results by using and assessing an experiential methodology aimed at third-year medical students. The training was based on interviews with SPs to teach basic communication skills (including the perceived level of comfort and interest of students during the clinical interview) and how to take the CH.

Its objective is to determine if this training is effective in helping students achieve these skills prior to the beginning of their clinical practice and to know about the learner perception about the experience. To make it, we conducted a longitudinal observational study of a cohort of medical students. We registered student self-evaluation of the videotaped interviews and the written history as well as the SPs’ assessment. In addition, we explored the teacher-student assessment correlation in the evaluation of the written history and considered the student opinion by a survey.


2. Methods

2.1. Design and scenario

The study was conducted as a longitudinal observational study of a cohort of medical students. It was undertaken during the “Clinical Methods I” (CM I) course in the fourth month of the third year of the medical degree curriculum. The main objective of CM I course consists on training students to establish an adequate clinical relationship during the clinical interview and teaching them how to gather significant clinical data through anamnesis and physical examination.

The specific training undertaken during CM I mainly consists teaching how to get and record a traditional CH (anamnesis; "history taking") and how to do a basic physical examination (clinical semiology; the “physical exam”), as well as how to cover certain basic procedures to properly use some devices (for instance a peak-flow-meter). They also are initiated on some basic communication skills needed in order to develop a patient-focused interview. These basic skills consisted, on the one hand, on being careful respecting elementary courtesy rules (self-introduction to patients, making them feel comfortable, requesting consent to complete a medical record) and, on the other hand, getting information about the patients perspective (their idea about their health problem cause, their experience over the impact of their symptoms on their lifestyle, or their concerns and knowledge of the condition).

The subject (CM I) is taught for six weeks, and includes: 24 hours of theoretical classes with participative methodologies, 26 hours of practical workshops in a simulation environment, three interviews with SPs that simulate clinical scenarios with different pathologies, and three briefing seminars after the interviews. CM I is taught before students begin their rotations at health centers, allowing them to practice the skills obtained in training. In the fourth year of medical study, the CM II subject complements the knowledge acquired in CM I, and deepens training in communication skills.

2.2. Participants

Among the 126 third-year medical students who were invited to participate in the program, 111 actively participated. There were nine teachers giving the course, all of whom were primary care physicians.

When the SPs had no previous experience, their training included a preliminary introduction session, two main sessions or specific training workshops, and one or more shorter complementary sessions with fewer objectives (Standardized Patient Training Program of the Francisco de Vitoria University Medical School in Madrid) [38].

Scripts for the SP roles were based on real clinical cases and were developed by two clinicians.

2.3. Training intervention

Along the training undertaken within CM I course every student received 28 hours of theorical classes and 22 hours of workshops to practice physical exams among themselves or with simulators when needed (for instance to recognize cardiac and pulmonary pathologic sounds), 3 interposed interviews with SP and 1 workshop after each SP encounter (3 in total) focused to feedback. There was no role-playing in small groups neither virtual or real patients in our training program. Our program was different from the traditional approaches (lectures or review of videos) because, in addition to these approaches, standardized patients were interposed. Afterwards, students worked in small group sessions where two facilitators collected their impressions and concerns about these encounters. The educational intervention, specifically aimed at improving the know-how of history taking and basic communication skills, had the following components (see figure 1 [Fig. 1]):

2.3.1. Demonstrative sessions and sessions in small groups

During the first session, the CH anamnesis structure is discussed. The second session focuses on the basic communication skills needed for establishing a doctor-patient relationship, and for collecting and providing information. Through presentations, video clips and situations designed to prompt discussion, relevant information was given by the teacher to the students, encouraging the whole class to reflect. Later on, students work in small ad hoc groups that are created according to their shared skills and experience followed by an exchange.

2.3.2. Individual interviews with SPs

These meetings are carried out at the Advanced Clinical Simulation Center, which offers all the necessary resources for various simulation scenarios. The students perform three encounters with three different SPs. The clinical situations faced by students are carried out in a general medicine context. The SP scenarios consist of the following:

1.
a 35-year-old female patient who comes to the office with pain in her right wrist as a consequence of a fall (eventual diagnosis: scaphoid fracture);
2.
a 60-year-old male patient who has developed chest pain over the course of two months with the usual characteristics (eventual diagnosis: unstable angina);
3.
a 35-year-old female patient who comes to the office expressing fatigue, having gradually lost weight over the last month (eventual diagnosis: onset of diabetes mellitus).

These encounters are performed sequentially during the symptomatology program. The clinical problems that arise in each encounter according to the subject matter that students were studied and received training on. Besides that, they were of increasing difficulty in terms of history taking skills.

Each encounter consists of a 15-minute clinical interview that is videotaped. The students are then given 15 minutes to write the CH (on paper).

After each encounter with the SP, the student watches their videotaped interview via the online system (the Learning Space Program). They then assess their performance using a specific self-evaluation template (see an example in table 1 [Tab. 1]), as well as their written CH using another self-evaluation template designed for this purpose (see table 2 [Tab. 2]). The checklist for the written CH is structured in four blocks:

1.
Preliminaries and reason for consultation;
2.
Personal history and lifestyle;
3.
Family history; and
4.
Current disease (see an example in table 2 [Tab. 2]).

Each student evaluates their own performance through the completion of this form.

Teachers compiled the list of history taking skills/tasks and built a tailored checklist scale to assess the level displayed by the student in the interview. There were some little differences among checklists to fit them to each case training objectives required. This scale was discussed by the group of teachers and its final version was agreed (face validity). To collect the opinion of the SP, a simple grading scale was proposed, its levels were discussed with the simulated patients.

In order to evaluate the students’ opinion of this teaching program, they also complete a survey consisting of seven items (see table 3 [Tab. 3]). Each item is formulated as a statement and assessed on a six-point, single, ordinal, Likert-type scale: 1-2=less useful and comfortable; 3-4=intermediate score; 5-6=useful and comfortable.

The teachers had no role during the interviews except to keep aware that everything is going on in the right way. The feedback comes up from students’ auto-evaluation watching their own videos and written CH along with the checklist tool.

2.3.3. Group workshops

Once the students have evaluated themselves, they then take part in a group workshop consisting of 30 students. The class is split into four or five smaller groups in order to discuss their experiences of the clinical encounter and CH. The workshop is conducted according to the established training principles for small groups, and is moderated by two teachers. The material addressed in this session is shown in table 4 [Tab. 4]. The main measures of effect were: items correctly identified in viewing the first and third videotaped interviews, items correctly identified in the evaluation of the third written CH, correlation about teachers’ and students’ evaluation of the third written CH, standardized patient’s subjective opinion about basic communication skills of students (feeling of comfortableness along the interview and perception of student’s interest in patient’s viewpoint and experience), and the measures related to students’ opinion survey.

Student-related measures (self-evaluation)

  • Percentage of items correctly identified in viewing the first and third videotaped interviews carried out by the student with the SP.
  • Percentage of items correctly identified in the evaluation of the third written CH (using the checklist).
  • Results of the opinion survey.

SP-related: Level of improvement of the student’s basic communication skills from the first to the third interview. After the interviewing, the SP should have to rating two sentences to express his/her own perception, from 1 (the worst) to 3 (the best):

1.
The interviewer has made me feel comfortable (he/she has been kind and respectful).
2.
The interviewer has shown interest in my concerns about my problem.

Analysis of correlation between teachers’ and students’ evaluations: An analysis of the correlation between the self-evaluation of the third written CH carried out by the students and the teachers’ evaluation as “clinic experts” is carried out in order to detect where the students most overvalue (or overestimate) their perception as compared to the values outlined by the teachers. The differences detected will be useful for implementing improvements in the next academic year.

2.4. Ethical statement

All local, regional and national standards, laws and regulations have been respected. In addition, participants have filled an informed consent procedure for recording sessions, have voluntarily participated in all the procedures described below and the necessary steps to ensure anonymity in the management of the data have also been taken.

2.5. Statistical analysis

Mean, median and standard deviation (SD) were used to analyze the percentage of correct items in each student’s self-evaluation of the CH and recorded interviews, and the percentage of occasions in each interview in which the student made the SP feel comfortable and attentively listened to.

To analyze the differences, the mean percentage of the observed improvement in the detection of items between the first and the third interview was calculated together with the corresponding confidence interval (CI) of 95%. The paired Student’s t-test was used for comparing means.

To assess the differences between the percentage of items detected in the CH by the student, and the items detected by the “clinical expert” (the teacher), the percentage of occasions where the student overestimated their perception with regard to the teacher’s results was used. Four teachers participated in this assessment, and each of them evaluated a quarter of the clinical histories written by the students. Prior to this evaluation, the interobserver concordance index was analyzed by the Kappa coefficient for each item. A coefficient greater than 0.8 was achieved on all occasions.

The analysis was carried out using IBM SPSS statistical software for Windows v.21, and the alpha level of significance of <0.05 was considered.


3. Results

3.1. Student self-evaluation of the videotaped interviews

Among the 111 students who participated in the program, 84 students conducted the three interviews. The mean percentage of items correctly identified by the students after viewing the videotapes increased from 73.6% in the first interview (median 76.2%, SD 11.6%) to 79% (median 80.7%, SD 13.2%) in the third interview. The mean variation of the improvement in the percentage of detected items was 6.7% (CI 95%, 3.6-10.0%) (p<0.001).

3.2. Evaluation performed by the standardized patients (SP)

The mean percentage of occasions in which the SP perceived that the student made him feel comfortable (being kind and respectful) and observed the student's interest in his concerns regarding his health problem was 73.6%73.6% in the first interview (median 75%, SD 28.4%) and 82.0% (median 75%, SD 19.7%) in the third interview. The mean difference was 8.5% (CI 95%, 2.9-14.1) (p=0.003).

3.3. Evaluation of the third written CH: teacher and student correlations

Among the 71 students who completed the self-evaluation of the third CH, a mean of 70.6% (CI 95%=66.9-73.3%) of the total items was detected using the evaluation checklist. When the evaluation was performed by the teachers, this value was 61.4% (CI 95%, 59.1-63.7). By analyzing the results from the four blocks in greater detail, it was found that:

1.
Preliminaries and reason for consultation: students overestimate 10% of the data with respect to the teachers’ external evaluation (see figure 2 [Fig. 2]).
2.
Personal history and lifestyle: students overestimate 22% of the data with respect to the teachers’ external evaluation (see figure 2 [Fig. 2]).
3.
Family history: students overestimate 30% of the data with respect to the teachers’ external evaluation (see figure 2 [Fig. 2]).
4.
Current disease: students overestimate 50% of the data with respect to the teachers’ external evaluation (see figure 2 [Fig. 2]).
3.4. Results of the student opinion survey

The survey response rate was 36.9% (n=41). The highest scores (on a scale of 1 to 6) were detected in the assessment of the usefulness of the SP interview (mean 5.2 points), the self-evaluation of the videotaped interview using a checklist (mean 5.0 points), the task of writing the CH (mean 5.2 points) and the self-evaluation of the written history using a checklist (mean 5.0 points). The mean score related to feeling comfortable during the interview was 4.4 points. The lowest scores corresponded to the feedback seminars (mean 2.7 points) and the significant impact made by teachers’ interventions on the learning experience (mean 3.8 points) table 3 [Tab. 3], figure 3 [Fig. 3] shows the mean scores obtained for each item with CI 95%.


4. Discussion

Communication skills can be acquired and mastered by practice, and experiential learning is very important in this regard [45]. SPs are most commonly used for

1.
teaching communication skills, and
2.
teaching clinical skills [46].

Our results show an increase on percentage of detected items by student’s videotape assessment, an improvement of the SPs’ perception of students’ basic communication skills and a student’s survey with high scores about usefulness of SP interview and self-evaluation, but low scores on feedback and teacher’s intervention in seminars held after each interview. Most of these data are in accordance with those obtained in other studies [3] in which students and instructors showed high levels of satisfaction with SP methodology [47].

If we consider the possibility that SP perception improvement could be related to an improvement of students’ basic communication skills, then the simulation could be useful to prevent real patients’ unpleasant feelings or an impression that the medical professional does not show enough interest in their problems.

Despite the limitations of our students’ self-evaluation found out in our correlation study of the written CH, they showed a tendency to improve that was not attributable to chance alone, as demonstrated by the mean percentage of items identified in the first and third videotaped interviews. This improvement coincides with the perceptions of the SPs, who discerned a significant improvement in concerns for their health from the first to the third interview. Actually, this may due to different causes such as habituation effect and not only to an improvement of students’ basic communication skills. Anyway, this result does not contradict the data obtained in published literature [14], [15], [16]. In addition, it demonstrates the progress that can be achieved with reflexive learning. Only two studies assessed preclinical students history taking through SP interventions [37], [44]. It was through self-evaluation questionnaire and course evaluation [37] and through OSCE and writing stations [44]. Our study intervention is similar but, additionally, we performed a multi-source evaluation, which includes self-assessment of students, their evaluation of the course, the evaluation by teachers of the written clinical history and the evaluation of the communication perceived by the SP.

When analyzing the correlation between the external evaluation by teachers and the self-evaluation by students after the written CH was completed, there were two results that were of particular pedagogical and evaluative interest:

1.
the student self-evaluation was overestimated (excessively favorable), or
2.
the external evaluation was either in line with the self-evaluation or the student was more rigorous than the teacher in the evaluation.

The first result is not desirable since it may suggest a low level of self-reflection. However, it may also suggest that we have to improve some items to rephrase them in a more specific and clearer way. Otherwise, students may tend to interpret ambiguous sentences in their own sake. When items could be interpreted differently, the percentage of overestimation may rise. If this one was so, we have to review, for instance, the items formulated in the "Family background" and "Current disease” sections.

The high percentage of items collected in the written CH by the students and verified by observers is likely attributable to students’ theoretical training, engagement with practical workshops and the first and second SP interviews. The results can be improved, but they are encouraging given the large amount of items that must be evaluated. Our study agrees with those by Von Lengerke et al. [37] and Battles et al. [44], in the fact that the standardized patient seems to be a key factor for improving their practical skills for history taking.

Many studies have suggested that medical students suffer from high levels of stress and anxiety throughout their undergraduate training, and that these anxiety levels may influence the type of communication students establish with patient [47]. This finding would justify the score relating to levels of comfort with the experience (i.e. the interviews with the SPs) stated by the students in our study. Although this score was not particularly high, it seems acceptable, considering the high level of stress that this training methodology usually produces in students [9], [17], [18], [19]. Our study agrees with Von Lengerke et al. [37] about the student positive opinion on standardized patients as a training intervention.

The negative attitudes expressed with regard to how students feel may signal that students have a negative perception of the way these skills are taught [17]. However, this does not necessarily correspond with negative attitudes toward the benefit of using such skills when seeing patients [17]. Indeed, the high score obtained in the statements related to the usefulness of interviews in simulation conditions demonstrated students’ satisfaction with the experience and the overall adequacy of the teaching. This result is significant and is in accordance with previous research [36], [47]. On the other hand, the low score obtained with regard to the group workshops suggests that these should be reviewed. The students answered survey open questions saying that the amount of time dedicated to each feedback seminar done after each SP interview was excessive. They found them "not very useful" because they were "repetitive" or "too long". Their feedback were very useful to manage future seminars.

The design of the study implies certain methodological limitations, as it was conducted as a longitudinal observation of a cohort of students without a control group. It has not been possible to make a comparison between the items recorded in the CH in the first and the third interviews, as the teaching objectives of the CH were different, being more extensive in the third than the first interview. The difference between the number of students enrolled in the course and those who completed the study is difficult to interpret. The difference between the students who completed the first and third interviews and those who recorded the CH in writing is 15%. These decreases in percentage are difficult to interpret with the data that is available, and are probably due in part to the non-summative nature of the evaluation. In any case, further research is needed regarding the impact of this type of educational intervention on the collection of relevant information by students.


5. Conclusions

This educational program aimed at medical students for interviewing and taking clinical histories using SPs, showed positive signs of improvement from the first to the third interview.

The student self-evaluations of the videotaped interviews using a checklist showed an increase of checklists collected items percentage.

From first to third interview, there was an improvement of participating SP’s perception on their comfort levels and sensation of interest from students in their medical concerns.

The mean level of information recorded in the written medical histories has been considered to be acceptable given the increasing complexity of interviews, although improvable for future courses.

Scores of students’ perception about SP interviews and self-assessment shown that they found this experience useful and acceptably comfortable.


Competing interests

The authors declare that they have no competing interests.


References

1.
Nichols LO, Mirvis DM. Physician-patient communication: does it matter? Tenn Med. 1998;91(3):94-86.
2.
Engel GL, Morgan WL, Morgan WL. Interviewing the patient. London, Philadelphia: W. B. Saunders; 1973. p.129.
3.
Keifenheim KE, Teufel M, Ip J, Speiser N, Leehr EJ, Zipfel S, Herrmann-Werner A. Teaching history taking to medical students: a systematic review. BMC Med Educ. 2015;15:159. DOI: 10.1186/s12909-015-0443-x External link
4.
Hampton JR, Harrison MJ, Mitchell JR, Prichard JS, Seymour C. Relative contributions of history-taking, physical examination, and laboratory investigation to diagnosis and management of medical outpatients. Br Med J. 1975;2(5969):486-489. DOI: 10.1136/bmj.2.5969.486 External link
5.
Schechter GP, Blank LL, Godwin HA, LaCombe MA, Novack DH, Rosse WF. Refocusing on history-taking skills during internal medicine training. Am J Med. 1996;101(2):210-216. DOI: 10.1016/S0002-9343(96)80078-7 External link
6.
Novack DH, Volk G, Drossman DA, Lipkin M. Medical interviewing and interpersonal skills teaching in US medical schools. Progress, problems, and promise. JAMA. 1993;269(16):2101-2105. DOI: 10.1001/jama.1993.03500160071034 External link
7.
Hatem DS, Barrett SV, Hewson M, Steele D, Purwono U, Smith R. Teaching the medical interview: methods and key learning issues in a faculty development course. J Gen Intern Med. 2007;22(12):1718-1724. DOI: 10.1007/s11606-007-0408-9 External link
8.
Schildmann J, Kampmann M, Schwantes U. Lehrveranstaltungen zu Themen der Anamnese und Gesprächsführung in Deutschland: Eine Umfrage unter Studierenden von 12 medizinischen Fakultäten [Teaching courses on aspects of medical history taking and communication skills in Germany: a survey among students of 12 medical faculties]. Z Arztl Fortbild Qualitatssich. 2004 Jun;98(4):287-92.
9.
Hargie O, Dickson D, Boohan M, Hughes K. A survey of communication skills training in UK schools of medicine: present practices and prospective proposals. Med Educ. 1998;32(1):25-34. DOI: 10.1046/j.1365-2923.1998.00154.x External link
10.
Ruiz-Moral R, García de Leonardo C, Cerro Pérez A, Monge Martín D, Caballero Martínez F. Cómo se está incorporando, enseñando y evaluando la comunicación clínica en las facultades de Medicina españolas. Educ Médica. 2020. DOI: 10.1016/j.edumed.2019.12.003 External link
11.
The Medical School Objectives Writing Group. Learning objectives for medical student education--guidelines for medical schools: report I of the Medical School Objectives Project. Acad Med. 1999;74(1):13-18. DOI: 10.1097/00001888-199901000-00010 External link
12.
Wiskin C, Barrett M, Fruhstorfer B, Schmid ML. Recommendations for undergraduate medical electives: a UK consensus statement. Med Educ. 2018;52(1):14-23. DOI: 10.1111/medu.13445 External link
13.
García de Leonardo C, Ruiz-Moral R, Caballero F, Cavaco A, Moore P, Dupuy LP, Pithon-Cyrino A, Cortés T, Gorostegui M, Loureiro E, Bosch Fontcuberta J, Casabuenas Duarte L, Kretzer L, Arrighi E, Jovell A, on behalf of the participants in the Consensus Panel. A Latin American, Portuguese and Spanish consensus on a core communication curriculum for undergraduate medical education. BMC Med Educ. 2016;16:99. DOI: 10.1186/s12909-016-0610-8 External link
14.
Berkhof M, van Rijssen HJ, Schellart AJM, Anema JR, van der Beek AJ. Effective training strategies for teaching communication skills to physicians: an overview of systematic reviews. Patient Educ Couns. 2011;84(2):152-162. DOI: 10.1016/j.pec.2010.06.010 External link
15.
Henry SG, Holmboe ES, Frankel RM. Evidence-based competencies for improving communication skills in graduate medical education: a review with suggestions for implementation. Med Teach. 2013;35(5):395-403. DOI: 10.3109/0142159X.2013.769677 External link
16.
Smith S, Hanson JL, Tewksbury LR, Christy C, Talib NJ, Harris MA, Beck GL, Wolf FM. Teaching patient communication skills to medical students: a review of randomized controlled trials. Eval Health Prof. 2007;30(1):3-21. DOI: 10.1177/0163278706297333 External link
17.
Anvik T, Gude T, Grimstad H, Baerheim A, Fasmer OB, Hjortdahl P, Holen A, Risberg T, Vaglum P. Assessing medical students' attitudes towards learning communication skills--which components of attitudes do we measure? BMC Med Educ. 2007;7:4. DOI: 10.1186/1472-6920-7-4 External link
18.
Beckman HB, Frankel RM. The use of videotape in internal medicine training. J Gen Intern Med. 1994;9(9):517-521. DOI: 10.1007/BF02599224 External link
19.
Nilsen S, Baerheim A. Feedback on video recorded consultations in medical teaching: why students loathe and love it - a focus-group based qualitative study. BMC Med Educ. 2005;5:28. DOI: 10.1186/1472-6920-5-28 External link
20.
Rees C, Sheard C. Evaluating first-year medical students' attitudes to learning communication skills before and after a communication skills course. Med Teach. 2003;25(3):302-307. DOI: 10.1080/0142159031000100409 External link
21.
Cleland J, Foster K, Moffat M. Undergraduate students' attitudes to communication skills learning differ depending on year of study and gender. Med Teach. 2005;27(3):246-251. DOI: 10.1080/01421590400029541 External link
22.
Mukohara K, Kitamura K, Wakabayashi H, Abe K, Sato J, Ban N. Evaluation of a communication skills seminar for students in a Japanese medical school: a non-randomized controlled study. BMC Med Educ. 2004;4:24. DOI: 10.1186/1472-6920-4-24 External link
23.
Prochaska JJ, Gali K, Miller B, Hauer KE. Medical Students' Attention to Multiple Risk Behaviors: A Standardized Patient Examination. J Gen Intern Med. 2012;27(6):700-707. DOI: 10.1007/s11606-011-1953-9 External link
24.
Thompson BM, Teal CR, Scott SM, Manning SN, Greenfield E, Shada R, Haidet P. Following the Clues: Teaching Medical Students to Explore Patients' Contexts. Patient Educ Couns. 2010;80(3):345-350. DOI: 10.1016/j.pec.2010.06.035 External link
25.
Utting MR, Campbell F, Rayner C, Whitehouse CR, Dornan TL. Consultation skills of medical students before and after changes in curriculum. J R Soc Med. 2000;93(5):2472-53. DOI: 10.1177/014107680009300509 External link
26.
Ruiz Moral R, Caballero Martínez F, García de Leonardo C, Monge D, Cañas F, Castaño P. Enseñar y aprender habilidades de comunicación clínica en la Facultad de Medicina. La experiencia de la Francisco de Vitoria (Madrid). Educ Médica. 2017;18(4):289-297. DOI: 10.1016/j.edumed.2017.03.026 External link
27.
Ruiz-Moral R, Pérula de Torres L, Monge D, García Leonardo C, Caballero F. Teaching medical students to express empathy by exploring patient emotions and experiences in standardized medical encounters. Patient Educ Couns. 2017;100(9):1694-1700. DOI: 10.1016/j.pec.2017.04.018 External link
28.
Ruiz Moral R, Monge Martín D, Garcia de Leonardo C, Pérula de Torres LA, Caballero Martínez F. Promoting Health Promotion: Medical students perceptions about an educational program on behavioral change in primary care. Aten Primaria. 2019;51(7):435-441. DOI: 10.1016/j.aprim.2018.02.013 External link
29.
Ruiz-Moral R, Gracia de Leonardo C, Caballero Martínez F, Monge Martín D. Medical students' perceptions towards learning communication skills: a qualitative study following the 2-year training programme. Int J Med Educ. 2019;10:90-97. DOI: 10.5116/ijme.5cbd.7e96 External link
30.
Moral RR, García de Leonardo C, Caballero Martínez F, Monge Martín D. Medical students' attitudes toward communication skills learning: comparison between two groups with and without training. Adv Med Educ Pract. 2019;10:55-61. DOI: 10.2147/AMEP.S182879 External link
31.
May W, Park JH, Lee JP. A ten-year review of the literature on the use of standardized patients in teaching and learning: 1996-2005. Med Teach. 2009;31(6):487-492. DOI: 10.1080/01421590802530898 External link
32.
Salas Perea RS, Ardanza Zulueta P. La simulación como método de enseñanza y aprendizaje. Educ Médica Super. 1995;9(1):3-4.
33.
Chur-Hansen A, Burg F. Working with standardised patients for teaching and learning. Clin Teach. 2006;3(4):220-224. DOI: 10.1111/j.1743-498X.2006.00128.x External link
34.
Ruiz Moral R. Educacion Medica. Manual Practico Para Clinicos. Practical Guide for Clinicians. Madrid: Editorial Medica Panamericana; 2010.
35.
Wind LA, Van Dalen J, Muijtjens AMM, Rethans JJ. Assessing simulated patients in an educational setting: the MaSP (Maastricht Assessment of Simulated Patients). Med Educ. 2004;38(1):39-44. DOI: 10.1111/j.1365-2923.2004.01686.x External link
36.
Eoaskoon W, Sumawong V, Silpakit C. Evaluation of training medical students in patient-interviewing skills by three modes of learning. J Med Assoc Thail Chotmaihet Thangphaet. 1996;79(8):526-530.
37.
Von Lengerke T, Kursch A, Lange K. The communication skills course for second year medical students at Hannover Medical School: An evaluation study based on students' self-assessments. GMS Z Für Med Ausbild. 2011;28(4):Doc54. DOI: 10.3205/zma000766 External link
38.
Ruiz-Moral R, Caballero-Martínez F. Programa para seleccionar y entrenar pacientes estandarizados en el contexto de un currículo universitario de simulación clínica. FEM Rev Fund Educ Médica. 2014;17(4):199-204. DOI: 10.4321/S2014-98322014000400005 External link
39.
Ozcakar N, Mevsim V, Guldal D, Gunvar T, Yildirim E, Sisli Z, Semin I. Is the use of videotape recording superior to verbal feedback alone in the teaching of clinical skills? BMC Public Health. 2009;9:474. DOI: 10.1186/1471-2458-9-474 External link
40.
Keifenheim KE, Petzold ER, Junne F, Erschens RS, Speiser N, Herrmann-Werner A, Zipfel S, Teufel M. Peer-Assisted History-Taking Groups: A Subjective Assessment of their Impact Upon Medical Students' Interview Skills. GMS J Med Educ. 2017;34(3):Doc35. DOI: 10.3205/zma001112 External link
41.
Block L, Brenner J, Conigliaro J, Pekmezaris R, DeVoe B, Kozikowski A. Perceptions of a longitudinal standardized patient experience by standardized patients, medical students, and faculty. Med Educ Online. 2018;23(1):1548244. DOI: 10.1080/10872981.2018.1548244 External link
42.
Doherty-Restrepo J, Odai M, Harris M, Yam T, Potteiger K, Montalvo A. Students' Perception of Peer and Faculty Debriefing Facilitators Following Simulation- Based Education. J Allied Health. 2018;47(2):107-112.
43.
Ruesseler M, Sterz J, Bender B, Hoefer S, Walcher F. The effect of video-assisted oral feedback versus oral feedback on surgical communicative competences in undergraduate training. Eur J Trauma Emerg Surg Off Publ Eur Trauma Soc. 2017;43(4):461-466. DOI: 10.1007/s00068-016-0734-x External link
44.
Battles JB, Sprankell SJ, Carpenter JL, Bedford JA, Kirk LM. Developing a support system for teaching and assessing clinical competence. J Biocommun. 1992;19(4):19-25.
45.
Ferreira-Padilla G, Ferrandez-Anton T, Baleriola-Julvez J, Bras M, Dordevic V. Communication skills in medicine: where do we come from and where are we going? Croat Med J. 2015; 56(3):311-314. DOI: 10.3325/cmj.2015.56.311 External link
46.
Nestel D, Groom J, Eikeland-Husebo S, O'Donnell JM. Simulation for learning and teaching procedural skills: the state of the science. Simul Healthc. 2011;6 Suppl:S10-13. DOI: 10.1097/SIH.0b013e318227ce96 External link
47.
Loureiro EM, Severo M, Bettencourt P, Ferreira MA. Attitudes and anxiety levels of medical students towards the acquisition of competencies in communication skills. Patient Educ Couns. 2011;85(3):e272-277. DOI: 10.1016/j.pec.2011.07.005 External link