Q-Seg: Quantum Annealing-Based Unsupervised Image Segmentation (2311.12912v4)
Abstract: We present Q-Seg, a novel unsupervised image segmentation method based on quantum annealing, tailored for existing quantum hardware. We formulate the pixel-wise segmentation problem, which assimilates spectral and spatial information of the image, as a graph-cut optimization task. Our method efficiently leverages the interconnected qubit topology of the D-Wave Advantage device, offering superior scalability over existing quantum approaches and outperforming several tested state-of-the-art classical methods. Empirical evaluations on synthetic datasets have shown that Q-Seg has better runtime performance than the state-of-the-art classical optimizer Gurobi. The method has also been tested on earth observation image segmentation, a critical area with noisy and unreliable annotations. In the era of noisy intermediate-scale quantum, Q-Seg emerges as a reliable contender for real-world applications in comparison to advanced techniques like Segment Anything. Consequently, Q-Seg offers a promising solution using available quantum hardware, especially in situations constrained by limited labeled data and the need for efficient computational runtime.
- Quantum optimization of complex systems with a quantum annealer. Phys. Rev. A, 106:042607, 2022.
- On the index of gracefulness of a graph and the gracefulness of two-dimensional square lattice graphs. Indian J. Math, 23(81-94):14, 1981.
- Inverse quantum fourier transform inspired algorithm for unsupervised image segmentation. arXiv preprint arXiv:2301.04705, 2023.
- Self-supervised learning for remote sensing scene classification under the few shot scenario. Scientific Reports, 13(1):433, 2023.
- Hierarchical graph-based segmentation for extracting road networks from high-resolution satellite images. ISPRS journal of photogrammetry and remote sensing, 126:245–260, 2017.
- Qubo formulations of three np problems. Journal of Information and Optimization Sciences, 42(7):1625–1648, 2021.
- Quantum motion segmentation. In Computer Vision – ECCV 2022, pages 506–523, Cham, 2022. Springer Nature Switzerland.
- Mayowa Ayodele. Penalty weights in qubo formulations: Permutation problems. In Evolutionary Computation in Combinatorial Optimization, pages 159–174, Cham, 2022. Springer International Publishing.
- Cut, glue, & cut: A fast, approximate solver for multicut partitioning. In 2014 IEEE Conference on Computer Vision and Pattern Recognition, pages 73–80, 2014.
- Q-match: Iterative shape matching via quantum annealing. In 2021 IEEE/CVF International Conference on Computer Vision (ICCV), pages 7566–7576, 2021.
- Ccuantumm: Cycle-consistent quantum-hybrid matching of multiple shapes. In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023.
- Object-oriented image processing in an integrated gis/remote sensing environment and perspectives for environmental applications. Environmental information for planning, politics and the public, 2:555–570, 2000.
- Image segmentation methods for object-based analysis and classification. Remote sensing image analysis: Including the spatial domain, pages 211–236, 2004.
- Computational multiqubit tunnelling in programmable quantum annealers. Nature Communications, 7(1):10327, 2016.
- Sen1floods11: A georeferenced dataset to train and test deep learning flood algorithms for sentinel-1. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2020.
- Next-generation topology of d-wave quantum processors. arXiv preprint arXiv:2003.00133, 2020.
- Beweis des adiabatensatzes. Zeitschrift für Physik, 51(3):165–180, 1928.
- Commercial applications of quantum computing. EPJ Quantum Technology, 8(1):2, 2021.
- Ulrik Brandes and Thomas Erlebach, editors. Network Analysis: Methodological Foundations. Springer Berlin Heidelberg, 1 edition, 2005.
- A practical heuristic for finding graph minors. arXiv preprint arXiv:1406.2741, 2014.
- Bo cai Gao. Ndwi—a normalized difference water index for remote sensing of vegetation liquid water from space. Remote Sensing of Environment, 58(3):257–266, 1996.
- A review on graph based segmentation. International Journal of Image, Graphics and Signal Processing, 4(5):1, 2012.
- Image segmentation on a quantum computer. Quantum Information Processing, 14, 2015.
- Quantum computers: A review on how quantum computing can boom ai. In 2022 2nd International Conference on Advance Computing and Innovative Technologies in Engineering (ICACITE), pages 559–563, 2022.
- U-net plus: Deep semantic segmentation for esophagus and esophageal cancer in computed tomography images. IEEE Access, 7:82867–82877, 2019.
- Color image segmentation: advances and prospects. Pattern recognition, 34(12):2259–2281, 2001.
- Robust analysis of feature spaces: color image segmentation. In Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, pages 750–755, 1997.
- Revisiting the isoperimetric graph partitioning problem. IEEE Access, 7:50636–50649, 2019.
- Deepglobe 2018: A challenge to parse the earth through satellite images. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2018.
- Experimental study on graph-based image segmentation methods in the classification of satellite images. EARSeL eProceedings, 11(1):12–24, 2012.
- Quantum image edge extraction based on laplacian operator and zero-cross method. Quantum Information Processing, 18(1):27, 2018.
- Efficient graph-based image segmentation. International Journal of Computer Vision, 59(2):167–181, 2004a.
- Efficient graph-based image segmentation. International journal of computer vision, 59:167–181, 2004b.
- Hyperspectral image segmentation using spatial-spectral graphs. In Algorithms and Technologies for Multispectral, Hyperspectral, and Ultraspectral Imagery XVIII, page 83901Q. International Society for Optics and Photonics, SPIE, 2012.
- A tutorial on formulating and using qubo models. arXiv preprint arXiv:1811.11538, 2018.
- Applications and computational advances for solving the qubo model. In The Quadratic Unconstrained Binary Optimization Problem: Theory, Algorithms, and Applications, pages 39–56. Springer, 2022.
- Values of games with weighted graphs. European Journal of Operational Research, 243(1):248–257, 2015.
- Region-based segmentation and object detection. In Advances in Neural Information Processing Systems. Curran Associates, Inc., 2009.
- Hierarchical quantum classifiers. npj Quantum Information, 4(1):65, 2018.
- On the importance of feature representation for flood mapping using classical machine learning approaches. arXiv preprint arXiv:2303.00691, 2023.
- Multiple resolution residually connected feature streams for automatic lung tumor segmentation from ct images. IEEE Transactions on Medical Imaging, 38(1):134–144, 2019.
- Number plate recognition from enhanced super-resolution using generative adversarial network. Multimedia Tools and Applications, 82(9):13837–13853, 2023.
- Computational complexity continuum within ising formulation of np problems. Communications Physics, 5(1):20, 2022.
- A new approach to the minimum cut problem. J. ACM, 43(4):601–640, 1996.
- Richard M. Karp. Reducibility Among Combinatorial Problems, pages 219–241. Springer Berlin Heidelberg, Berlin, Heidelberg, 2010.
- Unsupervised learning of image segmentation based on differentiable feature clustering. IEEE Transactions on Image Processing, 29:8055–8068, 2020.
- Performance benefits of increased qubit connectivity in quantum annealing 3-dimensional spin glasses. arXiv preprint arXiv:2009.12479, 2020.
- Remote sensing image segmentation advances: A meta-analysis. ISPRS Journal of Photogrammetry and Remote Sensing, 173:309–322, 2021.
- Trends of quantum computing applications to computer vision. In 2022 International Conference on Platform Technology and Service (PlatCon), pages 7–12, 2022.
- Andrew Lucas. Ising formulations of many np problems. Frontiers in Physics, 2:5, 2014. Edited by Jacob Biamonte, ISI Foundation, Italy.
- S. K. McFEETERS. The use of the normalized difference water index (ndwi) in the delineation of open water features. International Journal of Remote Sensing, 17(7):1425–1432, 1996.
- The d-wave advantage system: An overview. D-Wave Systems Inc., Burnaby, BC, Canada, Tech. Rep, 2020.
- D-wave hybrid solver service+ advantage: Technology update. Tech. Rep., 2020.
- A comprehensive survey of image segmentation: clustering methods, performance parameters, and benchmark datasets. Multimedia Tools and Applications, 81(24):35001–35026, 2022.
- Kumar Navulur. Multispectral image analysis using the object-oriented paradigm. CRC press, 2006.
- Training a binary classifier with the quantum adiabatic algorithm. arXiv preprint arXiv:0811.0416, 2008a.
- Image recognition with an adiabatic quantum computer i. mapping to quadratic unconstrained binary optimization. arXiv preprint arXiv:0804.4457, 2008b.
- Nips 2009 demonstration: Binary classification using hardware implementation of quantum annealing. Quantum, 4:1, 2009.
- On spectral clustering: Analysis and an algorithm. In Advances in Neural Information Processing Systems. MIT Press, 2001.
- Quantum annealing approach: Feature extraction and segmentation of synthetic aperture radar image. In IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, pages 3692–3695, 2020.
- Nobuyuki Otsu. A threshold selection method from gray-level histograms. IEEE transactions on systems, man, and cybernetics, 9(1):62–66, 1979.
- Spineparsenet: Spine parsing for volumetric mr image by a two-stage segmentation framework with semantic image representation. IEEE Transactions on Medical Imaging, 40(1):262–273, 2021.
- S Prasad et al. Remotely sensed data characterization, classification, and accuracies. CRC Press, 1(6):7, 2015.
- Synthetic aperture radar image segmentation with quantum annealing. arXiv preprint arXiv:2305.17954, 2023.
- U-net: Convolutional networks for biomedical image segmentation. In Medical Image Computing and Computer-Assisted Intervention (MICCAI), pages 234–241. Springer, 2015. (available on arXiv:1505.04597 [cs.CV]).
- Color classification based on pixel intensity values. In 2018 19th IEEE/ACIS International Conference on Software Engineering, Artificial Intelligence, Networking and Parallel/Distributed Computing (SNPD), pages 302–306, 2018.
- Enhanced Approaches to Rectify the Noise, Illumination and Shadow Artifacts. International Journal of Information, Control and Computer Sciences, 6.0(10), 2018.
- Survey over image thresholding techniques and quantitative performance evaluation. Journal of Electronic Imaging, 13(1):146 – 165, 2004.
- Unifying maximum cut and minimum cut of a planar graph. IEEE Transactions on Computers, 39(5):694–697, 1990.
- A 3x3 isotropic gradient operator for image processing. Presentation at Stanford A.I. Project 1968, pages 271–272, 1968.
- Performance evaluation of thresholding techniques on modi script. In 2018 International Conference on Advanced Computation and Telecommunication (ICACAT), pages 1–6, 2018.
- Segmentation and histogram generation using the hsv color space for image retrieval. In Proceedings. International Conference on Image Processing, pages II–II, 2002.
- Graph cut segmentation methods revisited with a quantum algorithm. arXiv preprint arXiv:1812.03050, 2018.
- Bilp-q: Quantum coalition structure generation. In Proceedings of the 19th ACM International Conference on Computing Frontiers, page 189–192, New York, NY, USA, 2022. Association for Computing Machinery.
- Gcs-q: Quantum graph coalition structure generation. In Computational Science – ICCS 2023, pages 138–152, Cham, 2023. Springer Nature Switzerland.
- Graph cut based image segmentation with connectivity priors. In 2008 IEEE Conference on Computer Vision and Pattern Recognition, pages 1–8, 2008.
- FVP: Fourier visual prompting for source-free unsupervised domain adaptation of medical image segmentation. IEEE Transactions on Medical Imaging, pages 1–1, 2023.
- Auto-cm: Unsupervised deep learning for satellite imagery composition and cloud masking using spatio-temporal dynamics. In Proceedings of the Thirty-Seventh AAAI Conference on Artificial Intelligence and Thirty-Fifth Conference on Innovative Applications of Artificial Intelligence and Thirteenth Symposium on Educational Advances in Artificial Intelligence. AAAI Press, 2023.
- Quantum image processing algorithm using edge extraction based on kirsch operator. Opt. Express, 28(9):12508–12517, 2020.
- Compound figure separation of biomedical images with side loss. In Deep Generative Models, and Data Augmentation, Labelling, and Imperfections, pages 173–183, Cham, 2021. Springer International Publishing.
- Quantum image processing and its application to edge detection: Theory and experiment. Phys. Rev. X, 7:031041, 2017.
- Image segmentation: A survey of graph-cut methods. In 2012 international conference on systems and informatics (ICSAI2012), pages 1936–1941. IEEE, 2012.
- Techniques and challenges of image segmentation: A review. Electronics, 12(5), 2023.
- Adiabatic quantum computing for multi object tracking. In 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), pages 8801–8812, 2022.
- Segmentation quality evaluation using region-based precision and recall measures for remote sensing images. ISPRS Journal of Photogrammetry and Remote Sensing, 102:73–84, 2015.