gms | German Medical Science

Brücken bauen – von der Evidenz zum Patientenwohl: 19. Jahrestagung des Deutschen Netzwerks Evidenzbasierte Medizin e. V.

Deutsches Netzwerk Evidenzbasierte Medizin e. V.

08.03. - 10.03.2018, Graz

User Testing of an Adaptation of Fishbone Diagrams to Depict Results of Systematic Reviews

Meeting Abstract

  • author presenting/speaker Viktoria Titscher - Department für Evidenzbasierte Medizin und Klinische Epidemiologie
  • Gerald Gartlehner - Donau-Universität Krems
  • Marie-Therese Schultes - Department of Maternal and Child Health, Gillings School of Global Public Health, University of North Carolina at Chapel Hill, USA; Department für Evidenzbasierte Medizin und Klinische Epidemiologie, Krems, Österreich
  • Laura C. Morgan - RTI International, Research Triangle Park, NC, USA
  • Georgiy V. Bobashev - RTI International, Research Triangle Park, NC, USA
  • Peyton Williams - RTI International, Research Triangle Park, NC, USA
  • Suzanne L. West - RTI International, Research Triangle Park, NC, USA

Brücken bauen – von der Evidenz zum Patientenwohl. 19. Jahrestagung des Deutschen Netzwerks Evidenzbasierte Medizin. Graz, Österreich, 08.-10.03.2018. Düsseldorf: German Medical Science GMS Publishing House; 2018. Doc18ebmP3-4

doi: 10.3205/18ebm086, urn:nbn:de:0183-18ebm0861

Veröffentlicht: 6. März 2018

© 2018 Titscher et al.
Dieser Artikel ist ein Open-Access-Artikel und steht unter den Lizenzbedingungen der Creative Commons Attribution 4.0 License (Namensnennung). Lizenz-Angaben siehe http://creativecommons.org/licenses/by/4.0/.


Gliederung

Text

Background: Summary of findings tables in systematic reviews are highly informative but require epidemiological training to be interpreted correctly. The usage of fishbone diagrams as graphical displays could offer researchers an effective approach to simplify content for readers with limited epidemiological training. In this paper we demonstrate how fishbone diagrams can be applied to systematic reviews. We also present the results of an initial user testing of fishbone diagrams compared with summary of findings tables.

Methods: Findings from two systematic reviews were graphically depicted in the form of the fishbone diagram. To test the utility of fishbone diagrams compared with summary of findings tables, we developed and pilot-tested an online survey using Qualtrics. Respondents were randomized to the fishbone diagram or a summary of findings table presenting the same body of evidence. They answered questions in both open-ended and closed-answer formats; all responses were anonymous. Our measures of interest focused on first and second impressions, the ability to find and interpret critical information, as well as user experience with both displays. After working with them, we asked respondents about the perceived utility of fishbone diagrams compared to summary of findings tables. We analyzed quantitative data by conducting t-tests and comparing descriptive statistics.

Results: Based on real world systematic reviews, we provide two different fishbone diagrams to show how they might be used to display complex information in a clear and succinct manner. User testing on 77 students with basic epidemiological training revealed that participants preferred summary of findings tables over fishbone diagrams. Significantly more participants liked the summary of findings table than the fishbone diagram (71.8% vs. 44.8%; p < .01); significantly more participants found the fishbone diagram confusing (63.2% vs. 35.9%, p < .05) or indicated that it was difficult to find information (65.8% vs. 45%; p < .01). However, more than half of the participants in both groups were unable to find critical information and answer three respective questions correctly (52.6% in the fishbone group; 51.3% in the summary of findings group).

Conclusions: Fishbone diagrams are compact visualizations that, theoretically, may prove useful for summarizing the findings of systematic reviews. Initial user testing, however, did not support the utility of such graphical displays.