PCB-Vision: A Multiscene RGB-Hyperspectral Benchmark Dataset of Printed Circuit Boards (2401.06528v1)
Abstract: Addressing the critical theme of recycling electronic waste (E-waste), this contribution is dedicated to developing advanced automated data processing pipelines as a basis for decision-making and process control. Aligning with the broader goals of the circular economy and the United Nations (UN) Sustainable Development Goals (SDG), our work leverages non-invasive analysis methods utilizing RGB and hyperspectral imaging data to provide both quantitative and qualitative insights into the E-waste stream composition for optimizing recycling efficiency. In this paper, we introduce 'PCB-Vision'; a pioneering RGB-hyperspectral printed circuit board (PCB) benchmark dataset, comprising 53 RGB images of high spatial resolution paired with their corresponding high spectral resolution hyperspectral data cubes in the visible and near-infrared (VNIR) range. Grounded in open science principles, our dataset provides a comprehensive resource for researchers through high-quality ground truths, focusing on three primary PCB components: integrated circuits (IC), capacitors, and connectors. We provide extensive statistical investigations on the proposed dataset together with the performance of several state-of-the-art (SOTA) models, including U-Net, Attention U-Net, Residual U-Net, LinkNet, and DeepLabv3+. By openly sharing this multi-scene benchmark dataset along with the baseline codes, we hope to foster transparent, traceable, and comparable developments of advanced data processing across various scientific communities, including, but not limited to, computer vision and remote sensing. Emphasizing our commitment to supporting a collaborative and inclusive scientific community, all materials, including code, data, ground truth, and masks, will be accessible at https://github.com/hifexplo/PCBVision.
- “Remanufacturing strategies: A solution for WEEE problem” In Journal of Cleaner Production 149 Elsevier, 2017, pp. 126–136
- “Towards a national circular economy indicator system in China: an evaluation and critical analysis” In Journal of cleaner production 23.1 Elsevier, 2012, pp. 216–224
- “Recycling of WEEEs: An economic assessment of present and future e-waste streams” In Renewable and sustainable energy reviews 51 Elsevier, 2015, pp. 263–272
- “The Global E-waste Monitor 2020: Quantities, flows and the circular economy potential” United Nations University/United Nations Institute for TrainingResearch …, 2020
- “Towards circular economy implementation: a comprehensive review in context of manufacturing industry” In Journal of Cleaner Production 115, 2016, pp. 36–51 DOI: 10.1016/J.JCLEPRO.2015.12.042
- “Sustainable Development Goals (SDGs)” United Nations (UNDP), 2023 URL: https://sdgs.un.org/goals
- “Recycling waste circuit board efficiently and environmentally friendly through small-molecule assisted dissolution” In Scientific Reports 9.1 Nature Publishing Group UK London, 2019, pp. 17902
- Jiuyong Guo, Jie Guo and Zhenming Xu “Recycling of non-metallic fractions from waste printed circuit boards: a review.” In Journal of hazardous materials 168 2-3, 2009, pp. 567–90 DOI: 10.1016/j.jhazmat.2009.02.104
- Qin Ling and Nor Ashidi Mat Isa “Printed Circuit Board Defect Detection Methods Based on Image Processing, Machine Learning and Deep Learning: A Survey” In IEEE Access IEEE, 2023
- “A review on deep learning in machining and tool monitoring: methods, opportunities, and challenges” In The International Journal of Advanced Manufacturing Technology 115, 2021, pp. 2683–2709 DOI: 10.1007/s00170-021-07325-7
- Tom Pearson “Hardware-based image processing for high-speed inspection of grains” In Computers and electronics in agriculture 69.1 Elsevier, 2009, pp. 12–18
- “A survey and evaluation of promising approaches for automatic image-based defect detection of bridge structures” In Structure and Infrastructure Engineering 5, 2009, pp. 455–486 URL: https://api.semanticscholar.org/CorpusID:11723887
- Daniel Herchenbach, Wei Li and Matthias Breier “Segmentation and classification of THCs on PCBAs” In 2013 11th IEEE International Conference on Industrial Informatics (INDIN), 2013, pp. 59–64 IEEE
- Wei Li, Bernhard Esders and Matthias Breier “SMD segmentation for automated PCB recycling” In 2013 11th IEEE International Conference on Industrial Informatics (INDIN), 2013, pp. 65–70 IEEE
- “Text recognition for information retrieval in images of printed circuit boards” In IECON 2014-40th Annual Conference of the IEEE Industrial Electronics Society, 2014, pp. 3487–3493 IEEE
- “Printed circuit board defect detection using deep learning via a skip-connected convolutional autoencoder” In Sensors 21.15 MDPI, 2021, pp. 4968
- “TDD-net: a tiny defect detection network for printed circuit boards” In CAAI Transactions on Intelligence Technology 4.2 Wiley Online Library, 2019, pp. 110–116
- “Defect detection in printed circuit boards using you-only-look-once convolutional neural networks” In Electronics 9.9 MDPI, 2020, pp. 1547
- “You only look once: Unified, real-time object detection” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 779–788
- “Fics-pcb: A multi-modal image dataset for automated printed circuit board visual inspection” In Cryptology ePrint Archive, 2020
- “FICS PCB X-ray: A dataset for automated printed circuit board inter-layers inspection” In Cryptology ePrint Archive, 2022
- “A PCB dataset for defects detection and classification” In arXiv preprint arXiv:1901.08204, 2019
- “Online PCB defect detector on a new PCB defect dataset” In arXiv preprint arXiv:1902.06197, 2019
- “A dataset for computer-vision-based PCB analysis” In 2015 14th IAPR International Conference on Machine Vision Applications (MVA), 2015, pp. 378–381 IEEE
- Gayathri Mahalingam, Kevin Gay and Karl Ricanek “PCB-METAL: A PCB Image Dataset for Advanced Computer Vision Machine Learning Component Analysis” In 2019 16th International Conference on Machine Vision Applications (MVA), 2019, pp. 1–5 URL: https://api.semanticscholar.org/CorpusID:195885553
- “Sparsity and Structure in Hyperspectral Imaging : Sensing, Reconstruction, and Target Detection” In IEEE Signal Processing Magazine 31, 2014, pp. 116–126 DOI: 10.1109/MSP.2013.2279507
- “Use of hyperspectral imaging for the quantification of organic contaminants on copper surfaces for electronic applications” In Sensors 21.16 MDPI, 2021, pp. 5595
- “Laser-induced breakdown spectroscopy (LIBS) combined with hyperspectral imaging for the evaluation of printed circuit board composition” In Talanta 134, 2015, pp. 278–283 DOI: https://doi.org/10.1016/j.talanta.2014.11.019
- Roberta Palmieri, Giuseppe Bonifazi and Silvia Serranti “Recycling-oriented characterization of plastic frames and printed circuit boards from mobile phones by electronic and chemical imaging” In Waste Management 34.11 Elsevier, 2014, pp. 2120–2130
- “Experimental stand for sorting components dismantled from printed circuit boards” In Minerals 11.11 MDPI, 2021, pp. 1292
- “Object detection routine for material streams combining RGB and hyperspectral reflectance data based on guided object localization” In IEEE Sensors Journal 20.19 IEEE, 2020, pp. 11490–11498
- Songuel Polat, Alain Tremeau and Frank Boochs “Combined use of 3D and HSI for the classification of printed circuit board components” In Applied Sciences 11.18 MDPI, 2021, pp. 8424
- Alex Krizhevsky, Ilya Sutskever and Geoffrey E Hinton “Imagenet classification with deep convolutional neural networks” In Advances in neural information processing systems 25, 2012
- “Rethinking the inception architecture for computer vision” In Proceedings of the IEEE conference on computer vision and pattern recognition, 2016, pp. 2818–2826
- “Application of hyperspectral imaging in food safety inspection and control: a review” In Critical reviews in food science and nutrition 52.11 Taylor & Francis, 2012, pp. 1039–1058
- “Hyperspectral imaging in the medical field: Present and future” In Applied Spectroscopy Reviews 49.6 Taylor & Francis, 2014, pp. 435–447
- “HybridSN: Exploring 3-D–2-D CNN feature hierarchy for hyperspectral image classification” In IEEE Geoscience and Remote Sensing Letters 17.2 IEEE, 2019, pp. 277–281
- “Small sample hyperspectral image classification based on the random patches network and recursive filtering” In Sensors 23.5 MDPI, 2023, pp. 2499
- “Landslide4sense: Reference benchmark data and deep learning models for landslide detection” In arXiv preprint arXiv:2206.00515, 2022
- “Cross-city matters: A multimodal remote sensing benchmark dataset for cross-city semantic segmentation using high-resolution domain adaptation networks” In Remote Sensing of Environment 299 Elsevier, 2023, pp. 113856
- “Resource efficiency and waste” European Environment Agency (EEA), 2018 URL: https://www.eea.europa.eu/themes/waste/intro
- “Multi-scale, multi-sensor data integration for automated 3-D geological mapping” In Ore Geology Reviews 136 Elsevier, 2021, pp. 104252
- Viet Anh Nguyen “AnyLabeling: Effortless AI-assisted data labeling with AI support from YOLO, Segment Anything, MobileSAM!!” URL: https://github.com/vietanhdev/anylabeling
- “Masking Hyperspectral Imaging Data with Pretrained Models”, 2023 arXiv:2311.03053 [cs.CV]
- Olaf Ronneberger, Philipp Fischer and Thomas Brox “U-net: Convolutional networks for biomedical image segmentation” In Medical Image Computing and Computer-Assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, October 5-9, 2015, Proceedings, Part III 18, 2015, pp. 234–241 Springer
- “Encoder-decoder with atrous separable convolution for semantic image segmentation” In Proceedings of the European conference on computer vision (ECCV), 2018, pp. 801–818
- “Attention u-net: Learning where to look for the pancreas” In arXiv preprint arXiv:1804.03999, 2018
- “ResUNet-a: A deep learning framework for semantic segmentation of remotely sensed data” In ISPRS Journal of Photogrammetry and Remote Sensing 162 Elsevier, 2020, pp. 94–114
- “Linknet: Exploiting encoder representations for efficient semantic segmentation” In 2017 IEEE visual communications and image processing (VCIP), 2017, pp. 1–4 IEEE
- Connor Shorten and Taghi M Khoshgoftaar “A survey on image data augmentation for deep learning” In Journal of big data 6.1 SpringerOpen, 2019, pp. 1–48
- “Albumentations: Fast and Flexible Image Augmentations” In Information 11.2, 2020 DOI: 10.3390/info11020125
- “The effectiveness of data augmentation in image classification using deep learning” In arXiv preprint arXiv:1712.04621, 2017