Respiratory failure & ventilation

A Comparison of Five Algorithmic Methods and Machine Learning Pattern Recognition for Artifact Detection in Electronic Records of Five Different Vital Signs: A Retrospective Analysis

AnesthesiologyPublished Retrospective diagnostic accuracy study

Authors' conclusion

No single artifact detection method consistently performed well across different vital signs and clinical settings.

Study context

Population
Intraoperative OR and intensive care unit (ICU) electronic health record datasets (heart rate, oxygen saturation, BP, temperature, capnometry)53 OR and 53 ICU
Participants
106 participants
Comparison
Five classical artifact detection algorithms and an LSTM neural network vs human expert annotation
Outcome
Sensitivity and specificity of each artifact detection algorithm vs human expert reference
Methodological detailssingle-centre
  • Single-centre

Performance

As reported in the abstract

Artifact detection performance
Test or modelSensitivity, heart rate (ICU)Sensitivity, systolic invasive BP (OR)Sensitivity, systolic invasive BP (ICU)Sensitivity, temperature (OR)Sensitivity, oxygen saturation (OR)
Neural network33.6% (95% CI, 33.1 to 44.6)62.2% (95% CI, 57.5 to 71.9)60.7% (95% CI, 57.3 to 71.8)76.1% (95% CI, 63.6 to 89.7)— not stated in the abstract
Z-value— not stated in the abstract— not stated in the abstract— not stated in the abstract— not stated in the abstract88.9%

Sensitivity, heart rate (ICU)

Neural network33.6% (95% CI, 33.1 to 44.6)
Z-value— not stated in the abstract

Sensitivity, systolic invasive BP (OR)

Neural network62.2% (95% CI, 57.5 to 71.9)
Z-value— not stated in the abstract

Sensitivity, systolic invasive BP (ICU)

Neural network60.7% (95% CI, 57.3 to 71.8)
Z-value— not stated in the abstract

Sensitivity, temperature (OR)

Neural network76.1% (95% CI, 63.6 to 89.7)
Z-value— not stated in the abstract

Sensitivity, oxygen saturation (OR)

Neural network— not stated in the abstract
Z-value88.9%

— not stated in the abstract

Data points annotated as artifacts by human experts
5,167 (1.3%)

Original publication

A Comparison of Five Algorithmic Methods and Machine Learning Pattern Recognition for Artifact Detection in Electronic Records of Five Different Vital Signs: A Retrospective Analysis. Anesthesiology. Published 11 March 2024. doi:10.1097/aln.0000000000004971

Composed by AI from the published abstract and checked against it. How Briefs are made →

Get them every week

New studies on this topic in My Week and in your Monday e-mail.

We e-mail you a sign-in link and a code. No password, no spam.