gms | German Medical Science

68. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS)

17.09. - 21.09.23, Heilbronn

Application of the ISO standard for alarm floods in the intensive care setting – a data-driven exploration

Meeting Abstract

  • Mona Prendke - Institute of Medical Informatics, Charité - Universitätsmedizin Berlin, Berlin, Germany
  • Anne Rike Flint - Institute of Medical Informatics, Charité - Universitätsmedizin Berlin, Berlin, Germany
  • Patrick Heeren - Institute of Medical Informatics, Charité - Universitätsmedizin Berlin, Berlin, Germany; Department of Anesthesiology and Intensive Care Medicine, Charité – Universitätsmedizin Berlin, Berlin, Germany
  • Felix Balzer - Institute of Medical Informatics, Charité - Universitätsmedizin Berlin, Berlin, Germany
  • Akira-Sebastian Poncette - Institute of Medical Informatics, Charité - Universitätsmedizin Berlin, Berlin, Germany; Department of Anesthesiology and Intensive Care Medicine, Charité – Universitätsmedizin Berlin, Berlin, Germany

Deutsche Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie. 68. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS). Heilbronn, 17.-21.09.2023. Düsseldorf: German Medical Science GMS Publishing House; 2023. DocAbstr. 309

doi: 10.3205/23gmds154, urn:nbn:de:0183-23gmds1549

Published: September 15, 2023

© 2023 Prendke et al.
This is an Open Access article distributed under the terms of the Creative Commons Attribution 4.0 License. See license information at http://creativecommons.org/licenses/by/4.0/.


Outline

Text

Introduction: Alarm floods occur when operators receive more alarms in a period of time than they can manage appropriately [1]. In the intensive care unit (ICU) setting this can lead to alarm fatigue, where staff gets desensitized by a high number of often (72-99%) irrelevant alarms, which endangers patients [2]. In industrial plant alarm management alarm floods are interpreted as ≥ 10 alarms in 10 minutes [3]. This interpretation was previously adapted in the medical field [4] although its suitability in this setting is unknown. We aim to explore different applications of alarm floods based on the ISO definition [1] and their association with alarm relevance.

Methods: Following IRB approval (EA1/127/18), we retrospectively analyzed annotated alarm data [5] from July-September 2022 (21-bed ICU, 92 days, 210 patients, 175,804 alarms). An alarm is considered actionable and relevant if followed by a related medical intervention. An alarm flood is defined as ≥ x alarms in a y-minute interval per bed, with x Element y, 2*y and y Element 5,10,15. y-minute intervals as (a) sliding bins starting at each (actionable) alarm and (b) fixed overlapping bins shifted by y/2. Actionable alarm floods refer to only actionable alarms. Metrics include mean and standard deviation of (actionable) alarm floods per day.

Results: The mean number of alarm floods per day varies immensely by approach, whereas the proportion of actionable alarm floods remains similar (Table 1 [Tab. 1]). The daily mean of non-actionable alarm floods across explored applications is 86-92% of the daily mean of all alarm floods. Sliding bins measure an order of magnitude more alarm floods compared to fixed bins.

Discussion: All approaches show a non-actionable alarm flood rate of 86-92%, similar to the rate of irrelevant alarms [2]. Measuring more alarm floods when using sliding bins as compared to fixed bins suggests actionable and non-actionable alarms often occur clustered. This is plausible as a single event can produce multiple alarms. However, it results in the sliding bin approach multi-counting one alarm into multiple alarm floods, overestimating the occurrence of alarm floods and thereby the alarm load. We propose an approach that limits multi-counting, such as fixed bins. ICU alarms should be analyzed in the context of the overall alarm situation and the temporal dimension as alarm clusters. Limitations of this research include disregarding the available number of alarm-managing operators and patients.

Conclusion: This research demonstrates analyzing ICU alarms as alarm clusters by interpreting the ISO definition of alarm floods and suggests a fixed bin approach to measure them. Non-actionable alarm floods account for 86-92% of all alarm floods, highlighting the need for alarm flood reduction to alleviate alarm fatigue. Further research is required to investigate a more precise interpretation of alarm floods in medical settings, considering the number of alarm-managing operators and patients, as well as approaches to minimize their occurrence such as mechanisms to individualize and automatically adjust alarm thresholds in contexts where they lead to non-actionable alarm floods.

Grant: BMBF 16SV8559.

The authors declare that they have no competing interests.

The authors declare that a positive ethics committee vote has been obtained.


References

1.
ISO International Standardization Organization, IEC International Electronical Commission. IEC 60601-1-8 Amendment 2: Medical electrical equipment - part 1-8: General requirements for basic safety and essential performance - Collateral Standards: General requirements, tests and guidance for alarm systems in medical electrical equipment and medical electrical systems. IEC International Electronical Commission; 2020. p. 6.
2.
Sendelbach S, Funk M. Alarm Fatigue. AACN Advanced Critical Care. 2013;24(4):378-86.
3.
Engineering Equipment and Materials Users Association. Alarm systems: A guide to design, management and procurement. EEMUA Publication No. 191. 1991.
4.
Poncette AS, Wunderlich MM, Spies C, Heeren P, Vorderwülbecke G, Salgado E, et al. Patient Monitoring Alarms in an Intensive Care Unit: Observational Study With Do-It-Yourself Instructions. J Med Internet Res. 2021 May 28;23(5):e26494.
5.
Klopfenstein SAI, Flint AR, Heeren P, Prendke M, Chaoui, A, et al. How to Annotate Patient Monitoring Alarms in Intensive Care Medicine for Machine Learning. Version 1 [Preprint]. Research Square. 2023. DOI: 10.21203/rs.3.rs-2514969/v1 External link