Unraveling Complex Data Diversity in Underwater Acoustic Target Recognition through Convolution-based Mixture of Experts (2402.11919v2)
Abstract: Underwater acoustic target recognition is a difficult task owing to the intricate nature of underwater acoustic signals. The complex underwater environments, unpredictable transmission channels, and dynamic motion states greatly impact the real-world underwater acoustic signals, and may even obscure the intrinsic characteristics related to targets. Consequently, the data distribution of underwater acoustic signals exhibits high intra-class diversity, thereby compromising the accuracy and robustness of recognition systems.To address these issues, this work proposes a convolution-based mixture of experts (CMoE) that recognizes underwater targets in a fine-grained manner. The proposed technique introduces multiple expert layers as independent learners, along with a routing layer that determines the assignment of experts according to the characteristics of inputs. This design allows the model to utilize independent parameter spaces, facilitating the learning of complex underwater signals with high intra-class diversity. Furthermore, this work optimizes the CMoE structure by balancing regularization and an optional residual module. To validate the efficacy of our proposed techniques, we conducted detailed experiments and visualization analyses on three underwater acoustic databases across several acoustic features. The experimental results demonstrate that our CMoE consistently achieves significant performance improvements, delivering superior recognition accuracy when compared to existing advanced methods.
- Network of experts for large-scale image categorization, in: Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, October 11–14, 2016, Proceedings, Part VII 14, Springer. pp. 516–532.
- Underwater target recognition based on multi-decision lofar spectrum enhancement: A deep-learning approach. Future Internet 13, 265.
- Underwater acoustic target classification with joint learning framework and data augmentation, in: 2022 5th International Conference on Artificial Intelligence and Big Data (ICAIBD), IEEE. pp. 23–28.
- A parallel mixture of svms for very large scale problems. Neural computation 14, 1105–1114.
- Scaling large learning problems with hard parallel mixtures. International Journal of pattern recognition and artificial intelligence 17, 349–365.
- Marine vessel classification based on passive sonar data: The cepstrum-based approach. IET Radar, Sonar & Navigation 7, 87–93.
- The effects of ship noise on marine mammals—a review. Frontiers in Marine Science 6, 606.
- Improving classification performance of sonar targets by applying general regression neural network with pca. Expert Systems with Applications 35, 472–475.
- Switch transformers: Scaling to trillion parameter models with simple and efficient sparsity. The Journal of Machine Learning Research 23, 1–40.
- Sonar data classification by using few-shot learning and concept extraction. Applied Acoustics 195, 108856.
- Hard mixtures of experts for large scale weakly supervised vision, in: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 6865–6873.
- Deep residual learning for image recognition, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 770–778.
- Marine acoustics: The physics of sound in underwater environments. Peninsula publishing Los Altos, CA.
- Searching for mobilenetv3, in: Proceedings of the IEEE/CVF international conference on computer vision, pp. 1314–1324.
- Squeeze-and-excitation networks, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7132–7141.
- Deepship: An underwater acoustic benchmark dataset and a separable convolution based autoencoder for classification. Expert Systems with Applications 183, 115270.
- Adaptive mixtures of local experts. Neural computation 3, 79–87.
- Deep cepstrum-wavelet autoencoder: A novel intelligent sonar classifier. Expert Systems with Applications 202, 117295.
- Integrated optimization of underwater acoustic ship-radiated noise recognition based on two-dimensional feature fusion. Applied Acoustics 159, 107057.
- Drw-ae: A deep recurrent-wavelet autoencoder for underwater target recognition. IEEE Journal of Oceanic Engineering 47, 1083–1098.
- Passive sonar target classification using multi-layer perceptron trained by salp swarm algorithm. Ocean Engineering 181, 98–108.
- Classification of underwater acoustical dataset using neural network trained by chimp optimization algorithm. Applied Acoustics 157, 107005.
- Deep learning. nature 521, 436–444.
- Denoising and feature extraction algorithms using npe combined with vmd and their applications in ship-radiated noise. Symmetry 9, 256.
- Underwater target recognition using convolutional recurrent neural networks with 3-d mel-spectrogram and data augmentation. Applied Acoustics 178, 107989.
- Decoupled weight decay regularization. arXiv preprint arXiv:1711.05101 .
- Deepspeed-moe: Advancing mixture-of-experts inference and training to power next-generation ai scale, in: International Conference on Machine Learning, PMLR. pp. 18332–18346.
- Feature analysis of passive underwater targets recognition based on deep neural network, in: OCEANS 2019-Marseille, IEEE. pp. 1–5.
- Ualf: A learnable front-end for intelligent underwater acoustic classification system. Ocean Engineering 264, 112394.
- Scaling vision with sparse mixture of experts. Advances in Neural Information Processing Systems 34, 8583–8595.
- Fuzzy whale optimisation algorithm: a new hybrid approach for automatic sonar target recognition. Journal of Experimental & Theoretical Artificial Intelligence 35, 309–325.
- Shipsear: An underwater vessel noise database. Applied Acoustics 113, 64–69.
- K-centroids-based supervised classification of texture images: Handling the intra-class diversity, in: 2013 IEEE International Conference on Acoustics, Speech and Signal Processing, IEEE. pp. 1498–1502.
- Outrageously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538 .
- Acoustic recognition of noise-like environmental sounds by using artificial neural network. Expert Systems with Applications 184, 115484.
- Stevens passive acoustic system for underwater surveillance, in: 2010 International WaterSide Security Conference, IEEE. pp. 1–6.
- Attention is all you need. Advances in neural information processing systems 30, 2017.
- Robust underwater noise targets classification using auditory inspired time-frequency analysis. Applied Acoustics 78, 68–76.
- Non-local neural networks, in: Proceedings of the IEEE conference on computer vision and pattern recognition, pp. 7794–7803.
- Deep mixture of experts via shallow embedding, in: Uncertainty in artificial intelligence, PMLR. pp. 552–562.
- Moec: Mixture of expert clusters. arXiv preprint arXiv:2207.09094 .
- Adaptive ship-radiated noise recognition with learnable fine-grained wavelet transform. Ocean Engineering 265, 112626.
- Underwater-art: Expanding information perspectives with text templates for underwater acoustic target recognition. The Journal of the Acoustical Society of America 152, 2641–2651.
- Guiding the underwater acoustic target recognition with interpretable contrastive learning, in: OCEANS 2023-Limerick, IEEE. pp. 1–6.
- Underwater acoustic target recognition based on smoothness-inducing regularization and spectrogram-based data augmentation. Ocean Engineering 281, 114926.
- Feature extraction of underwater target signal using mel frequency cepstrum coefficients based on acoustic vector sensor. Journal of Sensors 2016, 7864213.
- Integrated neural networks based on feature fusion for underwater target recognition. Applied Acoustics 182, 108261.