Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions

I.G.L. Cuba Gyllensten, A. Crundall-Goode, R.M. Aarts, K. Goode

Research output: Contribution to journalArticleAcademicpeer-review

3 Citations (Scopus)
48 Downloads (Pure)

Abstract

Background: Home telemonitoring (HTM) of chronic heart failure (HF) promises to improve care by timely indications when a patient's condition is worsening. Simple rules of sudden weight change have been demonstrated to generate many alerts with poor sensitivity. Trend alert algorithms and bio-impedance (a more sensitive marker of fluid change), should produce fewer false alerts and reduce workload. However, comparisons between such approaches on the decisions made and the time spent reviewing alerts has not been studied. Methods: Using HTM data from an observational trial of 91 HF patients, a simulated telemonitoring station was created and used to present virtual caseloads to clinicians experienced with HF HTM systems. Clinicians were randomised to either a simple (i.e. an increase of 2 kg in the past 3 days) or advanced alert method (either a moving average weight algorithm or bio-impedance cumulative sum algorithm). Results: In total 16 clinicians reviewed the caseloads, 8 randomised to a simple alert method and 8 to the advanced alert methods. Total time to review the caseloads was lower in the advanced arms than the simple arm (80 ± 42 vs. 149 ± 82 min) but agreements on actions between clinicians were low (Fleiss kappa 0.33 and 0.31) and despite having high sensitivity many alerts in the bio-impedance arm were not considered to need further action. Conclusion: Advanced alerting algorithms with higher specificity are likely to reduce the time spent by clinicians and increase the percentage of time spent on changes rated as most meaningful. Work is needed to present bio-impedance alerts in a manner which is intuitive for clinicians.

Original languageEnglish
Article number11
Number of pages11
JournalBMC Medical Informatics and Decision Making
Volume17
Issue number1
Early online date2017
DOIs
Publication statusPublished - 17 Jan 2017

Fingerprint

Case Management
Workload
Electric Impedance
Heart Failure
Weights and Measures

Cite this

@article{b5a94c9bfeb2491b952ccacaf1618292,
title = "Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions",
abstract = "Background: Home telemonitoring (HTM) of chronic heart failure (HF) promises to improve care by timely indications when a patient's condition is worsening. Simple rules of sudden weight change have been demonstrated to generate many alerts with poor sensitivity. Trend alert algorithms and bio-impedance (a more sensitive marker of fluid change), should produce fewer false alerts and reduce workload. However, comparisons between such approaches on the decisions made and the time spent reviewing alerts has not been studied. Methods: Using HTM data from an observational trial of 91 HF patients, a simulated telemonitoring station was created and used to present virtual caseloads to clinicians experienced with HF HTM systems. Clinicians were randomised to either a simple (i.e. an increase of 2 kg in the past 3 days) or advanced alert method (either a moving average weight algorithm or bio-impedance cumulative sum algorithm). Results: In total 16 clinicians reviewed the caseloads, 8 randomised to a simple alert method and 8 to the advanced alert methods. Total time to review the caseloads was lower in the advanced arms than the simple arm (80 ± 42 vs. 149 ± 82 min) but agreements on actions between clinicians were low (Fleiss kappa 0.33 and 0.31) and despite having high sensitivity many alerts in the bio-impedance arm were not considered to need further action. Conclusion: Advanced alerting algorithms with higher specificity are likely to reduce the time spent by clinicians and increase the percentage of time spent on changes rated as most meaningful. Work is needed to present bio-impedance alerts in a manner which is intuitive for clinicians.",
author = "{Cuba Gyllensten}, I.G.L. and A. Crundall-Goode and R.M. Aarts and K. Goode",
year = "2017",
month = "1",
day = "17",
doi = "10.1186/s12911-016-0398-9",
language = "English",
volume = "17",
journal = "BMC Medical Informatics and Decision Making",
issn = "1472-6947",
publisher = "BioMed Central",
number = "1",

}

Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions. / Cuba Gyllensten, I.G.L.; Crundall-Goode, A.; Aarts, R.M.; Goode, K.

In: BMC Medical Informatics and Decision Making, Vol. 17, No. 1, 11, 17.01.2017.

Research output: Contribution to journalArticleAcademicpeer-review

TY - JOUR

T1 - Simulated case management of home telemonitoring to assess the impact of different alert algorithms on work-load and clinical decisions

AU - Cuba Gyllensten, I.G.L.

AU - Crundall-Goode, A.

AU - Aarts, R.M.

AU - Goode, K.

PY - 2017/1/17

Y1 - 2017/1/17

N2 - Background: Home telemonitoring (HTM) of chronic heart failure (HF) promises to improve care by timely indications when a patient's condition is worsening. Simple rules of sudden weight change have been demonstrated to generate many alerts with poor sensitivity. Trend alert algorithms and bio-impedance (a more sensitive marker of fluid change), should produce fewer false alerts and reduce workload. However, comparisons between such approaches on the decisions made and the time spent reviewing alerts has not been studied. Methods: Using HTM data from an observational trial of 91 HF patients, a simulated telemonitoring station was created and used to present virtual caseloads to clinicians experienced with HF HTM systems. Clinicians were randomised to either a simple (i.e. an increase of 2 kg in the past 3 days) or advanced alert method (either a moving average weight algorithm or bio-impedance cumulative sum algorithm). Results: In total 16 clinicians reviewed the caseloads, 8 randomised to a simple alert method and 8 to the advanced alert methods. Total time to review the caseloads was lower in the advanced arms than the simple arm (80 ± 42 vs. 149 ± 82 min) but agreements on actions between clinicians were low (Fleiss kappa 0.33 and 0.31) and despite having high sensitivity many alerts in the bio-impedance arm were not considered to need further action. Conclusion: Advanced alerting algorithms with higher specificity are likely to reduce the time spent by clinicians and increase the percentage of time spent on changes rated as most meaningful. Work is needed to present bio-impedance alerts in a manner which is intuitive for clinicians.

AB - Background: Home telemonitoring (HTM) of chronic heart failure (HF) promises to improve care by timely indications when a patient's condition is worsening. Simple rules of sudden weight change have been demonstrated to generate many alerts with poor sensitivity. Trend alert algorithms and bio-impedance (a more sensitive marker of fluid change), should produce fewer false alerts and reduce workload. However, comparisons between such approaches on the decisions made and the time spent reviewing alerts has not been studied. Methods: Using HTM data from an observational trial of 91 HF patients, a simulated telemonitoring station was created and used to present virtual caseloads to clinicians experienced with HF HTM systems. Clinicians were randomised to either a simple (i.e. an increase of 2 kg in the past 3 days) or advanced alert method (either a moving average weight algorithm or bio-impedance cumulative sum algorithm). Results: In total 16 clinicians reviewed the caseloads, 8 randomised to a simple alert method and 8 to the advanced alert methods. Total time to review the caseloads was lower in the advanced arms than the simple arm (80 ± 42 vs. 149 ± 82 min) but agreements on actions between clinicians were low (Fleiss kappa 0.33 and 0.31) and despite having high sensitivity many alerts in the bio-impedance arm were not considered to need further action. Conclusion: Advanced alerting algorithms with higher specificity are likely to reduce the time spent by clinicians and increase the percentage of time spent on changes rated as most meaningful. Work is needed to present bio-impedance alerts in a manner which is intuitive for clinicians.

UR - http://www.scopus.com/inward/record.url?scp=85011277043&partnerID=8YFLogxK

U2 - 10.1186/s12911-016-0398-9

DO - 10.1186/s12911-016-0398-9

M3 - Article

C2 - 28095849

AN - SCOPUS:85011277043

VL - 17

JO - BMC Medical Informatics and Decision Making

JF - BMC Medical Informatics and Decision Making

SN - 1472-6947

IS - 1

M1 - 11

ER -