Improving Robustness of Spectrogram Classifiers with Neural Stochastic Differential Equations (2409.01532v1)
Abstract: Signal analysis and classification is fraught with high levels of noise and perturbation. Computer-vision-based deep learning models applied to spectrograms have proven useful in the field of signal classification and detection; however, these methods aren't designed to handle the low signal-to-noise ratios inherent within non-vision signal processing tasks. While they are powerful, they are currently not the method of choice in the inherently noisy and dynamic critical infrastructure domain, such as smart-grid sensing, anomaly detection, and non-intrusive load monitoring.
- “Improved speech emotion recognition using transfer learning and spectrogram augmentation,” in Proceedings of the 2021 international conference on multimodal interaction, 2021, pp. 645–652.
- “Special session on cutting edge approaches in data analytics for nonproliferation.,” Tech. Rep., Sandia National Lab.(SNL-NM), Albuquerque, NM (United States), 2022.
- “Workshop report for next-gen ai for proliferation detection: Accelerating the development and use of explainability methods to design ai systems suitable for nonproliferation mission applications,” Tech. Rep., Brookhaven National Lab.(BNL), Upton, NY (United States); Idaho National Lab …, 2020.
- “Testing and evaluation of data analytic approaches for nonproliferation,” Tech. Rep., Oak Ridge National Laboratory (ORNL), Oak Ridge, TN (United States), 2023.
- “Jamming detection and classification in ofdm-based uavs via feature- and spectrogram-tailored machine learning,” Ieee Access, 2022.
- “Recognizing semi-natural and spontaneous speech emotions using deep neural networks,” Ieee Access, 2022.
- “Radar-spectrogram-based uav classification using convolutional neural networks,” Sensors, vol. 21, no. 1, pp. 210, 2020.
- “Shaping noise for robust attributions in neural stochastic differential equations,” in Proceedings of the AAAI Conference on Artificial Intelligence, 2022, vol. 36, pp. 9567–9574.
- “Convnext v2: Co-designing and scaling convnets with masked autoencoders,” in Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2023, pp. 16133–16142.
- “On learning optimized reaction diffusion processes for effective image restoration,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 5261–5269.
- Ee Weinan, “A proposal on machine learning via dynamical systems,” Communications in Mathematics and Statistics, vol. 1, no. 5, pp. 1–11, 2017.
- “Beyond finite layer neural networks: Bridging deep architectures and numerical differential equations,” in International Conference on Machine Learning. PMLR, 2018, pp. 3276–3285.
- “Resnets ensemble via the feynman-kac formalism to improve natural and robust accuracies,” Advances in Neural Information Processing Systems, vol. 32, 2019.
- “Explanation of unintended radiated emission classification via lime,” arXiv preprint arXiv:2009.02418, 2020.
- “Explainable ai (xai)-driven vibration sensing scheme for surface quality monitoring in a smart surface grinding process,” Journal of Manufacturing Processes, vol. 99, pp. 184–194, 2023.
- “Methodology for interpretable reinforcement learning model for hvac energy control,” in 2020 IEEE International Conference on Big Data (Big Data). IEEE, 2020, pp. 1555–1564.
- “Explainable deep learning for the analysis of mhd spectrograms in nuclear fusion,” Machine Learning: Science and Technology, vol. 3, no. 1, pp. 015015, 2021.
- “Review on interpretable machine learning in smart grid,” Energies, vol. 15, no. 12, pp. 4427, 2022.
- “Trustworthy machine learning in smart grids,” .
- “Iscada: Towards a framework for interpretable fault prediction in smart electrical grids,” in IFIP Conference on Human-Computer Interaction. Springer, 2021, pp. 270–274.
- “Explainable signature-based machine learning approach for identification of faults in grid-connected photovoltaic systems,” in 2022 IEEE Texas Power and Energy Conference (TPEC). IEEE, 2022, pp. 1–6.
- X. Liu, “Neural sde: stabilizing neural ode networks with stochastic noise,” 2019.
- “On smoother attributions using neural stochastic differential equations,” 2021.
- “Wandering bumps in stochastic neural fields,” SIAM Journal on Applied Dynamical Systems, vol. 12, no. 1, pp. 61–94, 2013.
- “Deep residual learning for image recognition,” in Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 770–778.
- “Captum: A unified and generic model interpretability library for pytorch,” arXiv preprint arXiv:2009.07896, 2020.
- “Axiomatic attribution for deep networks,” in International conference on machine learning. PMLR, 2017, pp. 3319–3328.
- “Smoothgrad: removing noise by adding noise,” arXiv preprint arXiv:1706.03825, 2017.
- “Attribution-based confidence metric for deep neural networks,” Advances in Neural Information Processing Systems, vol. 32, 2019.
- “Harmonic signals dataset,” Tech. Rep., Oak Ridge National Lab.(ORNL), Oak Ridge, TN (United States). Oak Ridge …, 2023.
Paper Prompts
Sign up for free to create and run prompts on this paper using GPT-5.
Top Community Prompts
Collections
Sign up for free to add this paper to one or more collections.