gms | German Medical Science

Kongress Medizin und Gesellschaft 2007

17. bis 21.09.2007, Augsburg

Scenario-based evaluation of a web-frontend for an internet-information platform on hospital related data

Meeting Abstract

  • Christa Weßel - Institut für Medizinische Informatik, RWTH Aachen, Aachen
  • Cord Spreckelsen - Institut für Medizinische Informatik, RWTH Aachen, Aachen
  • Klaus Spitzer - Institut für Medizinische Informatik, RWTH Aachen, Aachen
  • Julia Rams - Institut für Medizinische Informatik, RWTH Aachen, Aachen

Kongress Medizin und Gesellschaft 2007. Augsburg, 17.-21.09.2007. Düsseldorf: German Medical Science GMS Publishing House; 2007. Doc07gmds451

The electronic version of this article is the complete one and can be found online at:

Published: September 6, 2007

© 2007 Weßel et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution License ( You are free: to Share – to copy, distribute and transmit the work, provided the original author and source are credited.



User-centred evaluation is an important task in Medical Informatics [1], [2], [3]. The Klinik-Scout is a prototype of a web-based information system on German hospitals, providing the basis for a web-based evaluation of users' needs and ideas [4], [5]. One of its modules presents hospital data on tables [6], which had to be re-engineered for the start of the Klinik-Scout. A study evaluated the usability and identified users' requests [7].

The study started with the exploration of users' needs by three semi-structured interviews with potential patients [1], [8], [9], [10]. The results of the computer-supported qualitative text analysis [11], [12] were used to design five persona and scenarios for the evaluation in the lab [13], [14], [15]. The scenarios described invented persons, which look for information in the Internet, to select a particular hospital, e.g. on the therapy of varices. The 13 participants were asked to solve this task and to answer a short questionnaire on their experience with the web-frontend. A group interview finished the evaluation in the lab to explore users' ideas on improvements of the web-frontend [16].

The data from the questionnaire, both quantitative and free texts, and the analysis of the transcribed group interview, resulted in the identification of 19 users' requests and ideas (e.g. "avoid technical terminology", "name medical staff qualification ", "improve navigation").

Triangulation fostered the reliability by using both qualitative and quantitative research methods [17]. The immediate use of the findings for the re-engineering of the web-frontend facilitated the start of the Klinik Scout [5], [18].

Websites on health care related data are a central resource, used by health care professionals and potential patients during their decision making. With this study we want to contribute to concise evaluations and procedures to assess the quality of such information systems and to identify necessary adaptations [3].


Friedman C, Wyatt J. Evaluation Methods in Medical Informatics. New York: Springer 2006.
Eysenbach G. Consumer Health Informatics. BMJ 2000; 230: 1713-16.
Ammenwerth E, Brender J, Nykänen P, Prokosch H-U, Rigby M, Talmon J. Visions and strategies to improve evaluation of health information system - reflections and lessons based an the HIS-EVAL workshop in Innsbruck. Int J Med Inf 2004; 73: 479-491.
Weßel C, Weymann F, Spreckelsen C. A Framework for the Web-based Multi-method Evaluation of a Web-based Information System on Hospitals. In: Löffler M, Winter A (Hrsg.) 51. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie (GMDS). Klinische Forschung vernetzen. Düsseldorf, Köln: German Medical Science; 2006. Doc 06gmds015 Published: 01-09-2006 External link
Klinik-Scout - - last access on March 31, 2007 External link
Weymann F. CAMESE - Entwicklung eines webbasierten Front-Ends für JANUS mit automatischer GUI-Generierung. Student's Research Project in Medical Informatics. Aachen: RWTH Aachen, 2002.
Rams J. Informationen über Krankenhäuser im Internet - Evaluation des Web-Frontends einer Objektdatenbank. (Information on Hospitals in the Internet - Evaluation of the Web-Fornted of an Object-Database.) PhD Thesis in Medicine: Thesis in Progress. Aachen: RWTH Aachen 2007.
Bortz J, Döring N. Forschungsmethoden und Evaluation für Human- und Sozialwissenschaftler. Berlin: Springer 2003.
Weßel C, Weymann F, Spreckelsen C. Streamlining Qualitative Research Methods for Medical Informatics - A Methodological Approach. Paper and poster on the XX International Congress of the European Federation for Medical Informatics (MIE 2006), August 27-30, 2006, Maastricht, The Netherlands.
Spreckelsen C, Karakas G, Laue M, Brüffer M, Spitzer K, Weßel C. Explorationsphase und Anforderungsanalyse für das rechnergestützte klinische Informations- und Wissensmanagement. In: Klar R, Köpcke W, Kuhn K, Lax H, Weiland S, Zaiß A (Hg.) 50. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie (GMDS). Düsseldorf, Köln: German Medical Science; 2005. Doc 05gmds225 Veröffentlicht: 08-09-2005 External link
MAXqda - The Art of Text Analysis. last access on March 31, 2007 External link
Mayring P. Qualitative Inhaltsanalyse. Grundlagen und Techniken. Weinheim: Beltz 2002.
Nielsen J. Usability Engineering. Amsterdam: Morgan Kaufmann 1993.
Cooper A. The Inmates Are Running the Asylum: Why High-Tech Products Drive Us Crazy and How to Restore the Sanity. Indianapolis: Sams Publishing 2004.
Weymann F. Repräsentation und Abfrage von Zeit-Aspekten in einem webgestützten, objekt-orientierten Informationssystem über Krankenhäuser (Representation and query of time aspects in a webbased, object-oriented information system about hospitals). Diploma-Thesis in Computer Science. Aachen, RWTH Aachen 2006.
Coreil J. Group Interview Methods in Community Health Research. Med Anthropol 1995; 16: 193-210.
Ammenwerth E, Iller C, Mansmann U. Can evaluation studies benefit from triangulation? A case study. Int J Med Inform. 2003, 72: 237-248.
Weßel C, Becker N. The CERES Project. CAMESE - Re-Engineering 2006. Project Report. Aachen: RWTH Aachen, Department of Medical Informatics 2007.