Learning with Noisy Labels for Human Fall Events Classification: Joint Cooperative Training with Trinity Networks (2310.06854v1)
Abstract: With the increasing ageing population, fall events classification has drawn much research attention. In the development of deep learning, the quality of data labels is crucial. Most of the datasets are labelled automatically or semi-automatically, and the samples may be mislabeled, which constrains the performance of Deep Neural Networks (DNNs). Recent research on noisy label learning confirms that neural networks first focus on the clean and simple instances and then follow the noisy and hard instances in the training stage. To address the learning with noisy label problem and protect the human subjects' privacy, we propose a simple but effective approach named Joint Cooperative training with Trinity Networks (JoCoT). To mitigate the privacy issue, human skeleton data are used. The robustness and performance of the noisy label learning framework is improved by using the two teacher modules and one student module in the proposed JoCoT. To mitigate the incorrect selections, the predictions from the teacher modules are applied with the consensus-based method to guide the student module training. The performance evaluation on the widely used UP-Fall dataset and comparison with the state-of-the-art, confirms the effectiveness of the proposed JoCoT in high noise rates. Precisely, JoCoT outperforms the state-of-the-art by 5.17% and 3.35% with the averaged pairflip and symmetric noises, respectively.
- Fall detection for elderly people using the variation of key points of human skeleton. IEEE Access 7 (2019), 154786–154795.
- A closer look at memorization in deep networks. In International conference on machine learning. PMLR, 233–242.
- Evaluation of accelerometer-based fall detection algorithms on real-world falls. PloS one 7, 5 (2012), e37062.
- Noise-tolerant learning, the parity problem, and the statistical query model. Journal of the ACM (JACM) 50, 4 (2003), 506–519.
- Elizabeth Burns and Ramakrishna Kakara. 2018. Deaths from falls among persons aged≥\geq≥ 65 years—United States, 2007–2016. Morbidity and Mortality Weekly Report 67, 18 (2018), 509.
- Fall detection based on key points of human-skeleton using openpose. Symmetry 12, 5 (2020), 744.
- Yueng Santiago Delahoz and Miguel Angel Labrador. 2014. Survey on fall detection and fall prevention using wearable and external sensors. Sensors 14, 10 (2014), 19806–19842.
- A vision-based approach for fall detection using multiple cameras and convolutional neural networks: A case study using the UP-Fall detection dataset. Computers in biology and medicine 115 (2019), 103520.
- RMPE: Regional Multi-person Pose Estimation. In International Conference on Computer Vision, ICCV.
- Multi-Level Cooperative Fusion of GM-PHD Filters for Online Multiple Human Tracking. IEEE Transactions on Multimedia 21, 9 (2019), 2277–2291. https://doi.org/10.1109/TMM.2019.2902480
- Enhanced Detection Reliability for Human Tracking Based Video Analytics. In 22th International Conference on Information Fusion (FUSION).
- Comprehensive review of vision-based fall detection systems. Sensors 21, 3 (2021), 947.
- Co-teaching: Robust training of deep neural networks with extremely noisy labels. Advances in neural information processing systems 31 (2018).
- Vision-based fall detection system for improving safety of elderly people. IEEE Instrumentation & Measurement Magazine 20, 6 (2017), 49–55.
- Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition. 770–778.
- Human-skeleton based fall-detection method using LSTM for manufacturing industries. In 2019 34th International Technical Conference on Circuits/Systems, Computers and Communications (ITC-CSCC). IEEE.
- Mentornet: Learning data-driven curriculum for very deep neural networks on corrupted labels. In International Conference on Machine Learning. PMLR, 2304–2313.
- A framework for fall detection based on openpose skeleton and lstm/gru models. Applied Sciences 11, 1 (2020), 329.
- Tongliang Liu and Dacheng Tao. 2015. Classification with noisy labels by importance reweighting. IEEE Transactions on pattern analysis and machine intelligence 38, 3 (2015), 447–461.
- Eran Malach and Shai Shalev-Shwartz. 2017. Decoupling” when to update” from” how to update”. Advances in Neural Information Processing Systems 30 (2017).
- UP-fall detection dataset: A multimodal approach. Sensors 19, 9 (2019), 1988.
- A survey on fall detection: Principles and approaches. Neurocomputing 100 (2013), 144–152.
- Confident learning: Estimating uncertainty in dataset labels. Journal of Artificial Intelligence Research 70 (2021), 1373–1411.
- WHO global report on falls prevention in older age. In Ageing and Life Course, Family and Community Health. World Health Organization.
- Anita Ramachandran and Anupama Karuppiah. 2020. A survey on recent advances in wearable fall detection systems. BioMed research international 2020 (2020).
- Fall detection and activity recognition using human skeleton features. IEEE Access 9 (2021), 33532–33542.
- Lingmei Ren and Yanjun Peng. 2019. Research of fall detection and fall prevention technologies: A systematic review. IEEE Access 7 (2019), 77702–77722.
- Learning to reweight examples for robust deep learning. In International conference on machine learning. PMLR, 4334–4343.
- Robust video surveillance for fall detection based on human shape deformation. IEEE Transactions on circuits and systems for video Technology 21, 5 (2011), 611–622.
- Cross-platform e-management for smart care facilities using deep interpretation of patient surveillance videos. In 2018 25th National and 3rd International Iranian Conference on Biomedical Engineering (ICBME). IEEE, 1–6.
- Francy Shu and Jeff Shu. 2021. An eight-camera fall detection system using human fall pattern recognition via machine learning by a low-cost android box. Scientific reports 11, 1 (2021), 1–17.
- A wearable airbag to prevent fall injuries. IEEE Transactions on Information Technology in Biomedicine 13, 6 (2009), 910–914.
- Elderly fall detection systems: A literature survey. Frontiers in Robotics and AI 7 (2020), 71.
- Combating noisy labels by agreement: A joint training method with co-regularization. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 13726–13735.
- Privacy Preserving Multi-Class Fall Classification Based on Cascaded Learning and Noisy Labels Handling. In 2022 IEEE 25th International Conference on Information Fusion (FUSION). IEEE.
- Skeleton-based Fall Events Classification with Data Fusion. In 2021 IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems (MFI). IEEE, 1–6.
- New advances and challenges of fall detection systems: A survey. Applied Sciences 8, 3 (2018), 418.
- Learning from multiple annotators with varying expertise. Machine learning 95, 3 (2014), 291–327.
- Kun Yi and Jianxin Wu. 2019. Probabilistic end-to-end noise correction for learning with noisy labels. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 7017–7025.
- A Posture Recognition-Based Fall Detection System for Monitoring an Elderly Person in a Smart Home Environment. IEEE Transactions on Information Technology in Biomedicine 16, 6 (2012), 1274–1286. https://doi.org/10.1109/TITB.2012.2214786
- An Online One Class Support Vector Machine-Based Person-Specific Fall Detection System for Monitoring an Elderly Individual in a Room Environment. IEEE Journal of Biomedical and Health Informatics 17, 6 (2013), 1002–1014. https://doi.org/10.1109/JBHI.2013.2274479
- How does disagreement help generalization against label corruption?. In International Conference on Machine Learning. PMLR, 7164–7173.
- Learning with biased complementary labels. In Proceedings of the European conference on computer vision (ECCV). 68–83.
- Understanding deep learning (still) requires rethinking generalization. Commun. ACM 64, 3 (2021), 107–115.