gms | German Medical Science

68. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS)

17.09. - 21.09.23, Heilbronn

Missing data in the German version of the Patient Activation Measure-13 (PAM-13-D): A simulation study using real-world data

Meeting Abstract

  • Inka Rösel - Institute for General Practice and Interprofessional Care, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany; Institute for Clinical Epidemiology and Applied Biostatistics, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany
  • Daniela Fröhlich - Institute for General Practice and Interprofessional Care, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany
  • Jan Valentini - Institute for General Practice and Interprofessional Care, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany
  • Holger Mauch - Institute for General Practice and Interprofessional Care, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany
  • Stefanie Joos - Institute for General Practice and Interprofessional Care, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany
  • Peter Martus - Institute for Clinical Epidemiology and Applied Biostatistics, University Hospital and Faculty of Medicine Tuebingen, Tübingen, Germany

Deutsche Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie. 68. Jahrestagung der Deutschen Gesellschaft für Medizinische Informatik, Biometrie und Epidemiologie e. V. (GMDS). Heilbronn, 17.-21.09.2023. Düsseldorf: German Medical Science GMS Publishing House; 2023. DocAbstr. 225

doi: 10.3205/23gmds161, urn:nbn:de:0183-23gmds1616

Veröffentlicht: 15. September 2023

© 2023 Rösel et al.
Dieser Artikel ist ein Open-Access-Artikel und steht unter den Lizenzbedingungen der Creative Commons Attribution 4.0 License (Namensnennung). Lizenz-Angaben siehe http://creativecommons.org/licenses/by/4.0/.


Gliederung

Text

Introduction: Patient-reported outcome measures (PROMs) have the potential to improve the quality of patient-centered care by providing services and support tailored to the individual’s needs. A concept to assess and quantify patients’ active engagement and their ability of self-managing their health status is therefore crucial in health care practice and research. The Patient Activation Measure-13 (PAM-13) is a 13-item self-administered questionnaire relating to knowledge, skills, confidence and behaviors critical for individuals to take responsibility for their own health [1]. From the 13 items an overall PAM-score is calculated, according to which patients can be categorized into one of four progressive stages of activation [1]. As all PROMs, the PAM-13 is highly susceptible to missing data and analyses can be compromised when missingness is handled inappropriately, leading to biased results or reduced power [2].

State of the art: In Germany, two validation studies of the German PAM-13-D were published by (a) Brenk-Franz et al. [3] and (b) Zill et al. [4] in 2013. They differ with respect to their recommendations on how to handle missing data: (a) only questionnaires with ≥ 7 items were included in the analysis. In case of missingness in the remaining datasets, the total score was divided by the number of completed items and multiplied by 13. The resulting sum raw scores were transformed into natural logarithm and from the logit metric to a standardized metric ranging from 0-100; (b) PAM-questionnaires with < 9 items present were excluded. For patients with less missingness, missing values were imputed using expectation-maximization procedure. The score was then calculated by adding up the raw scores and mapping the value onto a scale of 0–100.

Concept: As no conclusive guidelines on the handling of missing data in the PAM-13-D exist, the objective of our study was to compare four different approaches: (a) and (b) as described above, (c) multiple imputation (MI) by item regardless of the number of missing items, (d) MI at raw sum score level.

Implementation: Real-world data from a controlled longitudinal implementation study (CCC-integrativ) on a 3-month interprofessional complementary and integrative healthcare (CIH) counseling program for oncology patients was used [5]. In analogy to the primary endpoint of the original study, our analysis focused on pre-/post-intervention (T1, T2) PAM-13 data. In a first step, the data was reduced to complete cases, then we mimicked the missingness patterns observed in the original CCC-integrativ with different overall proportions of missingness ranging from 5% to as high as 60%. The simulation process was repeated 100 times for stable results. Different performance measures will be used to measure the accuracy and error of the simulated results with respect to the true values.

Lessons learned: Simulations are currently work-in-progress, first results are expected by the time of the conference. Differences of the approaches will be discussed and conclusions on the best method drawn to provide clinicians with clearer recommendations on how to appropriately account for missing answers in the PAM-13-D.

The authors declare that they have no competing interests.

The authors declare that a positive ethics committee vote has been obtained.


References

1.
Hibbard JH, Mahoney ER, Stockard J, Tusler M. Development and testing of a short form of the patient activation measure. Health Serv Res. 2005;40(6 Pt 1):1918-30.
2.
Linden A. Estimating Measurement Error of the Patient Activation Measure for Respondents with Partially Missing Data. Biomed Res Int. 2015;2015:270168.
3.
Brenk-Franz K, Hibbard JH, Herrmann WJ, Freund T, Szecsenyi J, Djalali S, et al. Validation of the German version of the patient activation measure 13 (PAM13-D) in an international multicentre study of primary care patients. PLoS One. 2013;8(9):e74786.
4.
Zill JM, Dwinger S, Kriston L, Rohenkohl A, Härter M, Dirmaier J. Psychometric evaluation of the German version of the Patient Activation Measure (PAM13). BMC Public Health. 2013;13:1027.
5.
Valentini J, Fröhlich D, Stolz R, Mahler C, Martus P, Klafke N, et al. Interprofessional evidence-based counselling programme for complementary and integrative healthcare in patients with cancer: study protocol for the controlled implementation study CCC-Integrativ. BMJ Open. 2022;12(2):e055076.