Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
194 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Histogram Layers for Neural Engineered Features (2403.17176v1)

Published 25 Mar 2024 in cs.CV

Abstract: In the computer vision literature, many effective histogram-based features have been developed. These engineered features include local binary patterns and edge histogram descriptors among others and they have been shown to be informative features for a variety of computer vision tasks. In this paper, we explore whether these features can be learned through histogram layers embedded in a neural network and, therefore, be leveraged within deep learning frameworks. By using histogram features, local statistics of the feature maps from the convolution neural networks can be used to better represent the data. We present neural versions of local binary pattern and edge histogram descriptors that jointly improve the feature representation and perform image classification. Experiments are presented on benchmark and real-world datasets.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (55)
  1. Timo Ojala, Matti Pietikainen and David Harwood “Performance evaluation of texture measures with classification based on Kullback discrimination of distributions” In Proceedings of 12th International Conference on Pattern Recognition 1, 1994, pp. 582–585 IEEE
  2. Bangalore S Manjunath, Philippe Salembier and Thomas Sikora “Introduction to MPEG-7: multimedia content description interface” John Wiley & Sons, 2002
  3. “Histogram Layers for Synthetic Aperture Sonar Imagery” In 2022 21st IEEE International Conference on Machine Learning and Applications (ICMLA), 2022, pp. 176–182 IEEE
  4. “Deepface: Closing the gap to human-level performance in face verification” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2014, pp. 1701–1708
  5. “Patch attention layer of embedding handcrafted features in cnn for facial expression recognition” In Sensors 21.3 MDPI, 2021, pp. 833
  6. Felix Juefei-Xu, Vishnu Naresh Boddeti and Marios Savvides “Local binary convolutional neural networks” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2017, pp. 19–28
  7. “Texture analysis with local binary patterns” In Handbook of pattern recognition and computer vision World Scientific, 2005, pp. 197–216
  8. “From BoW to CNN: Two decades of texture representation for texture classification” In International Journal of Computer Vision 127.1 Springer, 2019, pp. 74–109
  9. Katherine Hermann, Ting Chen and Simon Kornblith “The origins and prevalence of texture bias in convolutional neural networks” In Advances in Neural Information Processing Systems 33, 2020, pp. 19000–19015
  10. Joshua Peeples, Weihuang Xu and Alina Zare “Histogram Layers for Texture Analysis” In IEEE Transactions on Artificial Intelligence 3.4, 2022, pp. 541–552 DOI: 10.1109/TAI.2021.3135804
  11. “Structural and Statistical Texture Knowledge Distillation for Semantic Segmentation” In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 2022, pp. 16876–16885
  12. “Local binary features for texture classification: Taxonomy and experimental study” In Pattern Recognition 62 Elsevier, 2017, pp. 135–160
  13. “Histograms of oriented gradients for human detection” In international Conference on computer vision & Pattern Recognition (CVPR’05) 1, 2005, pp. 886–893 IEEE Computer Society
  14. “Detection and discrimination of land mines in ground-penetrating radar based on edge histogram descriptors and a possibilistic k𝑘kitalic_k-nearest neighbor classifier” In IEEE Transactions on Fuzzy Systems 17.1 IEEE, 2008, pp. 185–199
  15. Robert M Haralick and Karthikeyan Shanmugam “Textural features for image classification” In IEEE Transactions on systems, man, and cybernetics Ieee, 1973, pp. 610–621
  16. “Face Recognition Method Based on Multi-Threshold Local Binary Pattern” In Computer Engineering 35.17, 2009, pp. 167–169
  17. “An adaptive threshold LBP algorithm for face recognition”, 2016
  18. Zhenhua Guo, Lei Zhang and David Zhang “A completed modeling of local binary pattern operator for texture classification” In IEEE transactions on image processing 19.6 IEEE, 2010, pp. 1657–1663
  19. Timo Ojala, Matti Pietikäinen and David Harwood “A comparative study of texture measures with classification based on featured distributions” In Pattern recognition 29.1 Elsevier, 1996, pp. 51–59
  20. Anne Humeau-Heurtier “Texture feature extraction methods: A survey” In IEEE Access 7 IEEE, 2019, pp. 8975–9000
  21. Antonio Fernández, Marcos X Álvarez and Francesco Bianconi “Texture description through histograms of equivalent patterns” In Journal of mathematical imaging and vision 45.1 Springer, 2013, pp. 76–102
  22. “A 3x3 isotropic gradient operator for image processing” In a talk at the Stanford Artificial Project in, 1968, pp. 271–272
  23. “Possibilistic fuzzy local information C-means with automated feature selection for seafloor segmentation” In Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XXIII 10628, 2018, pp. 1062812 International Society for OpticsPhotonics
  24. “Comparison of possibilistic fuzzy local information C-means and possibilistic K-nearest neighbors for synthetic aperture sonar image segmentation” In Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XXIV 11012, 2019, pp. 110120T International Society for OpticsPhotonics
  25. Loris Nanni, Stefano Ghidoni and Sheryl Brahnam “Handcrafted vs. non-handcrafted features for computer vision classification” In Pattern Recognition 71 Elsevier, 2017, pp. 158–172
  26. Joshua Peeples “Connecting the Past and the Present: Histogram Layers for Texture Analysis”, 2022
  27. “Evaluating Deep Convolutional Neural Networks as Texture Feature Extractors” In International Conference on Image Analysis and Processing, 2019, pp. 192–202 Springer
  28. Sadiq Sani, Nirmalie Wiratunga and Stewart Massie “Learning deep features for kNN-based human activity recognition.”, 2017 CEUR Workshop Proceedings
  29. Lei Zhang, David Zhang and Fengchun Tian “SVM and ELM: Who Wins? Object recognition with deep convolutional features from ImageNet” In Proceedings of ELM-2015 Volume 1 Springer, 2016, pp. 249–263
  30. “Invariant scattering convolution networks” In IEEE transactions on pattern analysis and machine intelligence 35.8 IEEE, 2013, pp. 1872–1886
  31. “PCANet: A simple deep learning baseline for image classification?” In IEEE transactions on image processing 24.12 IEEE, 2015, pp. 5017–5032
  32. “Improving the histogram of oriented gradient feature for threat detection in ground penetrating radar by implementing it as a trainable convolutional neural network” In Detection and Sensing of Mines, Explosive Objects, and Obscured Targets XXIII 10628, 2018, pp. 106280D International Society for OpticsPhotonics
  33. “CNN-Based Refactoring of Hand-Designed Filters for Texture Analysis: A Classic Revisited” In IEEE Access 7 IEEE, 2019, pp. 173076–173085
  34. “Pixel Difference Networks for Efficient Edge Detection” In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 5117–5127
  35. “Tex-nets: Binary patterns encoded convolutional neural networks for texture recognition” In Proceedings of the 2017 ACM on International Conference on Multimedia Retrieval, 2017, pp. 125–132
  36. “Binary patterns encoded convolutional neural networks for texture recognition and remote sensing scene classification” In ISPRS journal of photogrammetry and remote sensing 138 Elsevier, 2018, pp. 74–85
  37. Duc Phan Van Hoai and Vinh Truong Hoang “Feeding Convolutional Neural Network by hand-crafted features based on Enhanced Neighbor-Center Different Image for color texture classification” In 2019 International Conference on Multimedia Analysis and Pattern Recognition (MAPR), 2019, pp. 1–6 IEEE
  38. “Combining deep and handcrafted image features for presentation attack detection in face recognition systems using visible-light camera sensors” In Sensors 18.3 Multidisciplinary Digital Publishing Institute, 2018, pp. 699
  39. “Combining deep neural network and traditional image features to improve survival prediction accuracy for lung cancer patients from diagnostic CT” In 2016 IEEE International Conference on Systems, Man, and Cybernetics (SMC), 2016, pp. 002570–002575 IEEE
  40. Jianlong Wu, Zhouchen Lin and Hongbin Zha “Multi-view common space learning for emotion recognition in the wild” In Proceedings of the 18th ACM International Conference on Multimodal Interaction, 2016, pp. 464–471 ACM
  41. Mircea Cimpoi, Subhransu Maji and Andrea Vedaldi “Deep filter banks for texture recognition and segmentation” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2015, pp. 3828–3836
  42. Hang Zhang, Jia Xue and Kristin Dana “Deep ten: Texture encoding network” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2017, pp. 708–717
  43. “Locally-transferred fisher vectors for texture classification” In Proceedings of the IEEE International Conference on Computer Vision, 2017, pp. 4912–4920
  44. Jia Xue, Hang Zhang and Kristin Dana “Deep texture manifold for ground terrain recognition” In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 2018, pp. 558–567
  45. Yuting Hu, Zhiling Long and Ghassan AlRegib “Multi-level texture encoding and representation (multer) based on deep neural networks” In 2019 IEEE International Conference on Image Processing (ICIP), 2019, pp. 4410–4414 IEEE
  46. “Interpretable machine learning: Fundamental principles and 10 grand challenges” In Statistics Surveys 16 Amer. Statist. Assoc., the Bernoulli Soc., the Inst. Math. Statist.,the …, 2022, pp. 1–85
  47. Han Xiao, Kashif Rasul and Roland Vollgraf “Fashion-mnist: a novel image dataset for benchmarking machine learning algorithms” In arXiv preprint arXiv:1708.07747, 2017
  48. Alice Porebski, Nicolas Vandenbroucke and Ludovic Macaire “Haralick feature extraction from LBP images for color texture classification” In 2008 First Workshops on Image Processing Theory, Tools and Applications, 2008, pp. 1–8 IEEE
  49. “PRMI: A Dataset of Minirhizotron Images for Diverse Plant Root Study” In Proceedings of the AAAI Conference on Artificial Intelligence AI for Agriculture and Food Systems (AIAFS) Workshops, 2022, pp. 838–839
  50. Jiancheng Yang, Rui Shi and Bingbing Ni “MedMNIST Classification Decathlon: A Lightweight AutoML Benchmark for Medical Image Analysis” In IEEE 18th International Symposium on Biomedical Imaging (ISBI), 2021, pp. 191–195
  51. “MedMNIST v2-A large-scale lightweight benchmark for 2D and 3D biomedical image classification” In Scientific Data 10.1 Nature Publishing Group UK London, 2023, pp. 41
  52. “A dataset of microscopic peripheral blood cell images for development of automatic recognition systems” In Data in Brief 30, 2020, pp. 105474
  53. Matthew Rocklin “Dask: Parallel computation with blocked algorithms and task scheduling” In Proceedings of the 14th python in science conference 130, 2015, pp. 136 SciPy Austin, TX
  54. “Divergence regulated encoder network for joint dimensionality reduction and classification” In IEEE Geoscience and Remote Sensing Letters 19 IEEE, 2022, pp. 1–5
  55. Anne Humeau-Heurtier “Color texture analysis: A survey” In IEEE Access 10 IEEE, 2022, pp. 107993–108003
Citations (1)
View on Semantic Scholar

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now
X Twitter Logo Streamline Icon: https://streamlinehq.com

Tweets