Signal Quality Auditing for Time-series Data (2402.00803v1)
Abstract: Signal quality assessment (SQA) is required for monitoring the reliability of data acquisition systems, especially in AI-driven Predictive Maintenance (PMx) application contexts. SQA is vital for addressing "silent failures" of data acquisition hardware and software, which when unnoticed, misinform the users of data, creating the risk for incorrect decisions with unintended or even catastrophic consequences. We have developed an open-source software implementation of signal quality indices (SQIs) for the analysis of time-series data. We codify a range of SQIs, demonstrate them using established benchmark data, and show that they can be effective for signal quality assessment. We also study alternative approaches to denoising time-series data in an attempt to improve the quality of the already degraded signal, and evaluate them empirically on relevant real-world data. To our knowledge, our software toolkit is the first to provide an open source implementation of a broad range of signal quality assessment and improvement techniques validated on publicly available benchmark data for ease of reproducibility. The generality of our framework can be easily extended to assessing reliability of arbitrary time-series measurements in complex systems, especially when morphological patterns of the waveform shapes and signal periodicity are of key interest in downstream analyses.
- Aggarwal, C. C. 2017. An introduction to outlier analysis. In Outlier analysis, 1–34. Springer.
- ECG signal denoising by wavelet transform thresholding. American Journal of applied sciences, 5(3): 276–281.
- ECG signal quality during arrhythmia and its application to false alarm reduction. IEEE transactions on biomedical engineering, 60(6): 1660–1666.
- Noise reduction in ECG signals using fully convolutional denoising autoencoders. Ieee Access, 7: 60806–60813.
- Signal quality indices and data fusion for determining clinical acceptability of electrocardiograms. Physiological measurement, 33(9): 1419.
- Donoho, D. L. 1995. De-noising by soft-thresholding. IEEE transactions on information theory, 41(3): 613–627.
- Empirical mode decomposition as a filter bank. IEEE signal processing letters, 11(2): 112–114.
- Identification and Explanation of Severity of Bleeding-Induced Hypovolemia Using Unsupervised Deep Learning. In TP55. TP055 MECHANICAL VENTILATION, ICU MANAGEMENT, AND CV, A2841–A2841. American Thoracic Society.
- Detecting Patterns of Physiological Response to Hemodynamic Stress via Unsupervised Deep Learning. arXiv preprint arXiv:1911.05121.
- PhysioBank, PhysioToolkit, and PhysioNet: components of a new research resource for complex physiologic signals. circulation, 101(23): e215–e220.
- Real alerts and artifact classification in archived multi-signal vital sign monitoring data: implications for mining big data. Journal of clinical monitoring and computing, 30(6): 875–888.
- Robust heart rate estimation from multiple asynchronous noisy sources using signal quality indices and a Kalman filter. Physiological measurement, 29(1): 15.
- A machine learning approach to multi-level ECG signal quality classification. Computer methods and programs in biomedicine, 117(3): 435–447.
- Automated Assessment of Cardiovascular Sufficiency Using Non-Invasive Physiological Data. Sensors, 22(3): 1024.
- Isolation forest. In 2008 eighth ieee international conference on data mining, 413–422. IEEE.
- NeuroKit2: A Python toolbox for neurophysiological signal processing. Behavior Research Methods, 1–8.
- An annotated ECG database for evaluating arrhythmia detectors. In IEEE Transactions on Biomedical Engineering, volume 29, 600–600. IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC 345 E 47TH ST, NEW YORK, NY ….
- The MIT-BIH arrhythmia database on CD-ROM and software for use with it. In [1990] Proceedings Computers in Cardiology, 185–188. IEEE.
- The impact of the MIT-BIH arrhythmia database. IEEE Engineering in Medicine and Biology Magazine, 20(3): 45–50.
- A noise stress test for arrhythmia detectors. Computers in cardiology, 11(3): 381–384.
- Dynamically Personalized Detection of Hemorrhage. In Machine Learning for Healthcare Conference, 109–123. PMLR.
- An adequately robust early TNF-α𝛼\alphaitalic_α response is a hallmark of survival following trauma/hemorrhage. PloS one, 4(12): e8406.
- Efficient algorithms for mining outliers from large data sets. In Proceedings of the 2000 ACM SIGMOD international conference on Management of data, 427–438.
- A review of signal processing techniques for electrocardiogram signal quality assessment. IEEE reviews in biomedical engineering, 11: 36–52.
- Estimating the support of a high-dimensional distribution. Neural computation, 13(7): 1443–1471.
- Improving the quality of ECGs collected using mobile phones: The Physionet/Computing in Cardiology Challenge 2011. In 2011 Computing in Cardiology, 273–276. IEEE.
- ECG denoising based on the empirical mode decomposition. In 2006 International Conference of the IEEE Engineering in Medicine and Biology Society, 1–4. IEEE.
- SQI quality evaluation mechanism of single-lead ECG signal based on simple heuristic fusion and fuzzy comprehensive evaluation. Frontiers in Physiology, 9: 727.
Collections
Sign up for free to add this paper to one or more collections.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.