Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
139 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
46 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Acoustic Identification of Ae. aegypti Mosquitoes using Smartphone Apps and Residual Convolutional Neural Networks (2306.10091v1)

Published 16 Jun 2023 in cs.SD, cs.AI, cs.LG, and eess.AS

Abstract: In this paper, we advocate in favor of smartphone apps as low-cost, easy-to-deploy solution for raising awareness among the population on the proliferation of Aedes aegypti mosquitoes. Nevertheless, devising such a smartphone app is challenging, for many reasons, including the required maturity level of techniques for identifying mosquitoes based on features that can be captured using smartphone resources. In this paper, we identify a set of (non-exhaustive) requirements that smartphone apps must meet to become an effective tooling in the fight against Ae. aegypti, and advance the state-of-the-art with (i) a residual convolutional neural network for classifying Ae. aegypti mosquitoes from their wingbeat sound, (ii) a methodology for reducing the influence of background noise in the classification process, and (iii) a dataset for benchmarking solutions for detecting Ae. aegypti mosquitoes from wingbeat sound recordings. From the analysis of accuracy and recall, we provide evidence that convolutional neural networks have potential as a cornerstone for tracking mosquito apps for smartphones.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (59)
  1. On the use of uncertainty in classifying aedes albopictus mosquitoes. IEEE Journal of Selected Topics in Signal Processing 16, 224–233. doi:10.1109/JSTSP.2021.3122886.
  2. Managing biological invasions: the cost of inaction. Biological Invasions 24, 1927–1946.
  3. Mosquito classification using convolutional neural network with data augmentation, in: Vasant, P., Zelinka, I., Weber, G.W. (Eds.), Intelligent Computing and Optimization, Springer International Publishing, Cham. pp. 865–879. doi:10.1007/978-3-030-68154-8_74.
  4. Accurate and efficient mosquito genus classification algorithm using candidate-elimination and nearest centroid on extracted features of wingbeat acoustic properties. Computers in Biology and Medicine 139, 104973. doi:10.1016/j.compbiomed.2021.104973.
  5. Classifying mosquito presence and genera using median and interquartile values from 26-filter wingbeat acoustic properties. Procedia Computer Science 193, 453–463. URL: https://www.sciencedirect.com/science/article/pii/S1877050921020883, doi:https://doi.org/10.1016/j.procs.2021.10.047. 10th International Young Scientists Conference in Computational Science, YSC2021, 28 June – 2 July, 2021.
  6. Cnn architectures performance evaluation for image classification of mosquito in indonesia, in: 2020 International Seminar on Intelligent Technology and Its Applications (ISITIA), pp. 223–227. doi:10.1109/ISITIA49792.2020.9163732.
  7. A sound trap for aedes albopictus (skuse) male surveillance: response analysis to acoustic and visual stimuli. Acta tropica 164, 448–454.
  8. Massive yet grossly underestimated global costs of invasive insects. Nature communications 7, 12986.
  9. Harmonic convergence in the love songs of the dengue vector mosquito. Science 323, 1077–1079.
  10. Flying insect classification with inexpensive sensors. Journal of Insect Behavior 27, 657–677.
  11. Noise-robust sound-event classification system with texture analysis. Symmetry 10, 402. doi:10.3390/sym10090402.
  12. High and rising economic costs of biological invasions worldwide. Nature 592, 571–576.
  13. Detecting aedes aegypti mosquitoes through audio classification with convolutional neural networks. Computers in Biology and Medicine 129, 104152.
  14. Detecting aedes aegypti mosquitoes through audio classification with convolutional neural networks. Computers in Biology and Medicine 129, 104152. URL: https://www.sciencedirect.com/science/article/pii/S0010482520304832, doi:https://doi.org/10.1016/j.compbiomed.2020.104152.
  15. Source reduction with a purpose: Mosquito ecology and community perspectives offer insights for improving household mosquito management in coastal kenya. PLoS neglected tropical diseases 14, e0008239.
  16. Ast: Audio spectrogram transformer, in: Proc. Interspeech 2021, pp. 571–575. doi:10.21437/Interspeech.2021-698.
  17. Deep residual learning for image recognition, in: 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770–778. doi:10.1109/CVPR.2016.90.
  18. Identity mappings in deep residual networks, in: Leibe, B., Matas, J., Sebe, N., Welling, M. (Eds.), Computer Vision – ECCV 2016, Springer International Publishing, Cham. pp. 630–645.
  19. Densely connected convolutional networks, in: 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2261–2269. doi:10.1109/CVPR.2017.243.
  20. Comparison of time-frequency representations for environmental sound classification using convolutional neural networks. arXiv preprint arXiv:1706.07156 .
  21. The siren’s song: Exploitation of female flight tones to passively capture male aedes aegypti (diptera: Culicidae). Journal of medical entomology 53, 245–248.
  22. Recording of sounds produced by certain disease-carrying mosquitoes. Science (Washington) , 335–6.
  23. The identification of certain west african mosquitoes by sound. The American journal of tropical medicine and hygiene 29, 827–836.
  24. Infrared light sensors permit rapid recording of wingbeat frequency and bioacoustic species identification of mosquitoes. Scientific Reports 11. doi:10.1038/s41598-021-89644-z.
  25. Bioacoustic detection with wavelet-conditioned convolutional neural networks. Neural Computing and Applications 32, 915–927.
  26. Citywide integrated aedes aegypti mosquito surveillance as early warning system for arbovirus transmission, brazil. Emerging Infectious Diseases 28, 707.
  27. Automated identification of mosquito (diptera: Culicidae) wingbeat waveform by artificial neural network, in: IFIP International Conference on Artificial Intelligence Applications and Innovations, Springer. pp. 483–489.
  28. A convnet for the 2020s, in: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pp. 11966–11976. doi:10.1109/CVPR52688.2022.01167.
  29. Application of convolutional neural networks for classification of adult mosquitoes in the field. PLOS ONE 14, 1–18. URL: https://doi.org/10.1371/journal.pone.0210829, doi:10.1371/journal.pone.0210829.
  30. Using mobile phones as acoustic sensors for high-throughput mosquito surveillance. Elife 6, e27854.
  31. Mosquito vector monitoring system based on optical wingbeat classification. Computers and Electronics in Agriculture 118, 47–55.
  32. A new approach to improve acoustic trapping effectiveness for aedes aegypti (diptera: Culicidae). Journal of Vector Ecology 44, 216–222.
  33. ESC: Dataset for Environmental Sound Classification, in: Proceedings of the 23rd Annual ACM Conference on Multimedia, ACM Press. pp. 1015–1018. URL: http://dl.acm.org/citation.cfm?doid=2733373.2806390, doi:10.1145/2733373.2806390.
  34. Measuring the fundamental frequency and the harmonic properties of the wingbeat of a large number of mosquitoes in flight using 2d optoacoustic sensors. Applied Acoustics 109, 54–60.
  35. Insect biometrics: Optoacoustic signal processing and its applications to remote monitoring of mcphail type traps. PloS One 10, e0140474.
  36. Chapter 2 - mosquito-borne diseases, in: Qureshi, A.I. (Ed.), Zika Virus Disease. Academic Press, pp. 27–45. URL: https://www.sciencedirect.com/science/article/pii/B9780128123652000032, doi:https://doi.org/10.1016/B978-0-12-812365-2.00003-2.
  37. Machine vision for low-cost remote control of mosquitoes by power laser. Journal of Real-Time Image Processing 18. doi:10.1007/s11554-021-01079-x.
  38. Deep convolutional neural networks for image classification: A comprehensive review. Neural Comput. 29, 2352–2449. URL: https://doi.org/10.1162/neco_a_00990, doi:10.1162/neco_a_00990.
  39. Waterproof, low-cost, long-battery-life sound trap for surveillance of male aedes aegypti for rear-and-release mosquito control programmes. Parasites & vectors 12, 417.
  40. Audio noise reduction using low pass filters. OALib 04, 1–7. doi:10.4236/oalib.1103709.
  41. Grad-cam: Visual explanations from deep networks via gradient-based localization, in: 2017 IEEE International Conference on Computer Vision (ICCV), pp. 618–626. doi:10.1109/ICCV.2017.74.
  42. Communication in the presence of noise. Proceedings of the IRE 37, 10–21. URL: https://doi.org/10.1109/jrproc.1949.232969, doi:10.1109/jrproc.1949.232969.
  43. Natural tts synthesis by conditioning wavenet on mel spectrogram predictions, in: 2018 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), pp. 4779–4783. doi:10.1109/ICASSP.2018.8461368.
  44. Applying machine learning and audio analysis techniques to insect recognition in intelligent traps, in: 2013 12th International Conference on Machine Learning and Applications, IEEE. pp. 99–104.
  45. Exploring low cost laser sensors to identify flying insect species. Journal of Intelligent & Robotic Systems 80, 313–330.
  46. Dropout: A simple way to prevent neural networks from overfitting. Journal of Machine Learning Research 15, 1929–1958.
  47. A low-powered and highly selective trap for male aedes (diptera: Culicidae) surveillance: the male aedes sound trap. Journal of Medical Entomology .
  48. A deep learning-based pipeline for mosquito detection and classification from wingbeat sounds. Multimedia Tools and Applications 2022. doi:10.1007/s11042-022-13367-0.
  49. LSTM-Based Mosquito Genus Classification Using Their Wingbeat Sound. chapter Chapter 2. Software Systems Security and Techniques. pp. 293–302. doi:10.3233/FAIA210028.
  50. Exploiting the potential of vector control for disease prevention. Bulletin of the World Health Organization 83, 942–947.
  51. Designing a lightweight convolutional neural network for bird audio detection, in: 2022 Panhellenic Conference on Electronics & Telecommunications (PACET), pp. 1–5. doi:10.1109/PACET56979.2022.9976355.
  52. Locomobis: a low-cost acoustic-based sensing system to monitor and classify mosquitoes, in: 2019 16th IEEE Annual Consumer Communications & Networking Conference (CCNC), IEEE. pp. 1–6.
  53. The impact of temperature and body size on fundamental flight tone variation in the mosquito vector aedes aegypti (diptera: Culicidae): implications for acoustic lures. Journal of medical entomology 54, 1116–1121.
  54. First genetically modified mosquitoes released in the united states. Nature 593, 175–176.
  55. A resnet attention model for classifying mosquitoes from wing-beating sounds. Scientific Reports 12, 10334. doi:10.1038/s41598-022-14372-x.
  56. A lightweight deep learning approach to mosquito classification from wingbeat sounds, in: Proceedings of the Conference on Information Technology for Social Good, Association for Computing Machinery, New York, NY, USA. p. 37–42. URL: https://doi.org/10.1145/3462203.3475908, doi:10.1145/3462203.3475908.
  57. Noisy training for deep neural networks in speech recognition. EURASIP Journal on Audio, Speech, and Music Processing 2015. doi:10.1186/s13636-014-0047-0.
  58. A survey of deep learning on mobile devices: Applications, optimizations, challenges, and research opportunities. Proceedings of the IEEE 110, 334–354. doi:10.1109/JPROC.2022.3153408.
  59. Connecting the dots between audio and text without parallel data through visual knowledge transfer, in: Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Association for Computational Linguistics, Seattle, United States. pp. 4492–4507. URL: https://aclanthology.org/2022.naacl-main.333, doi:10.18653/v1/2022.naacl-main.333.
Citations (2)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
Github Logo Streamline Icon: https://streamlinehq.com

GitHub

  1. GitHub - ComputerNetworks-UFRGS/Aedes_Detector_Smartphone_App_Paper (3 stars)