Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
156 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Real-World Efficient Blind Motion Deblurring via Blur Pixel Discretization (2404.12168v1)

Published 18 Apr 2024 in cs.CV and cs.AI

Abstract: As recent advances in mobile camera technology have enabled the capability to capture high-resolution images, such as 4K images, the demand for an efficient deblurring model handling large motion has increased. In this paper, we discover that the image residual errors, i.e., blur-sharp pixel differences, can be grouped into some categories according to their motion blur type and how complex their neighboring pixels are. Inspired by this, we decompose the deblurring (regression) task into blur pixel discretization (pixel-level blur classification) and discrete-to-continuous conversion (regression with blur class map) tasks. Specifically, we generate the discretized image residual errors by identifying the blur pixels and then transform them to a continuous form, which is computationally more efficient than naively solving the original regression problem with continuous values. Here, we found that the discretization result, i.e., blur segmentation map, remarkably exhibits visual similarity with the image residual errors. As a result, our efficient model shows comparable performance to state-of-the-art methods in realistic benchmarks, while our method is up to 10 times computationally more efficient.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (41)
  1. Defocus deblurring using dual-pixel data. The European Conference on Computer Vision (ECCV), pages 111–126, 2020.
  2. The fast fourier transform. IEEE spectrum, 4(12):63–70, 1967.
  3. Non-uniform blur kernel estimation via adaptive basis decomposition. arXiv preprint arXiv:2102.01026, 2021.
  4. Ayan Chakrabarti. A neural approach to blind motion deblurring. The European Conference on Computer Vision (ECCV), pages 221–235, 2016.
  5. Hinet: Half instance normalization network for image restoration. The IEEE Conference on Computer Vision and Pattern Recognition Workshop (CVPRW), pages 182–192, 2021.
  6. Simple baselines for image restoration. The European Conference on Computer Vision (ECCV), 2022.
  7. The cepstrum: A guide to processing. Proceedings of the IEEE, 65(10):1428–1443, 1977.
  8. Rethinking coarse-to-fine approach in single image deblurring. The IEEE International Conference on Computer Vision (ICCV), pages 4641–4650, 2021.
  9. Revisiting global statistics aggregation for improving image restoration. The European Conference on Computer Vision (ECCV), 2022.
  10. Deep wiener deconvolution: Wiener meets deep learning for image deblurring. Advances in Neural Information Processing Systems (NeurIPS), 33:1048–1059, 2020.
  11. Self-supervised non-uniform kernel estimation with flow-based motion prior for blind image deblurring. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 18105–18114, 2023.
  12. Blind deconvolution by means of the richardson–lucy algorithm. JOSA A, 12(1):58–65, 1995.
  13. From motion blur to motion flow: A deep learning solution for removing heterogeneous motion blur. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 2319–2328, 2017.
  14. Convolutional neural networks for direct text deblurring. The British Machine Vision Conference (BMVC), 10(2), 2015.
  15. Efficient frequency domain-based transformers for high-quality image deblurring, 2023.
  16. Fast image deconvolution using hyper-laplacian priors. Advances in neural information processing systems (NIPS), 22, 2009.
  17. Deblurgan: Blind motion deblurring using conditional adversarial networks. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 8183–8192, 2018.
  18. Deblurgan-v2: Deblurring (orders-of-magnitude) faster and better. The IEEE International Conference on Computer Vision (ICCV), pages 8878–8887, 2019.
  19. Learning degradation representations for. The European Conference on Computer Vision (ECCV), pages 736–753, 2022.
  20. Real-world deep local motion deblurring. Association for the Advancement of Artificial Intelligence (AAAI), 2023a.
  21. Efficient and explicit modelling of image hierarchies for image restoration. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2023b.
  22. Sgdr: Stochastic gradient descent with warm restarts. arXiv preprint arXiv:1608.03983, 2016.
  23. Decoupled weight decay regularization. International Conference on Learning Representations (ICLR), 2019.
  24. Intriguing findings of frequency selection for image deblurring. Association for the Advancement of Artificial Intelligence (AAAI), 2023.
  25. Deep multi-scale convolutional neural network for dynamic scene deblurring. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 3883–3891, 2017.
  26. Clean images are hard to reblur: Exploiting the ill-posed inverse task for dynamic scene deblurring. International Conference on Learning Representations (ICLR), 2022.
  27. Real-world blur dataset for learning and benchmarking deblurring algorithms. The European Conference on Computer Vision (ECCV), pages 184–201, 2020.
  28. Realistic blur synthesis for learning image deblurring. The European Conference on Computer Vision (ECCV), 2022.
  29. U-net: Convolutional networks for biomedical image segmentation. International Conference on Medical image computing and computer-assisted intervention, pages 234–241, 2015.
  30. Learning to deblur. IEEE transactions on pattern analysis and machine intelligence, 38(7):1439–1451, 2015.
  31. Learning a convolutional neural network for non-uniform motion blur removal. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 769–777, 2015.
  32. Scale-recurrent network for deep image deblurring. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 8174–8182, 2018.
  33. Explore image deblurring via encoded blur kernel space. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 11956–11965, 2021.
  34. Stripformer: Strip transformer for fast image deblurring. The European Conference on Computer Vision (ECCV), 2022.
  35. Maxim: Multi-axis mlp for image processing. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 5769–5780, 2022.
  36. Edvr: Video restoration with enhanced deformable convolutional networks. The IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW), 2019.
  37. Image quality assessment: from error visibility to structural similarity. IEEE transactions on image processing, 13(4):600–612, 2004.
  38. Uformer: A general u-shaped transformer for image restoration. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 17683–17693, 2022.
  39. Multi-stage progressive image restoration. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 14821–14831, 2021.
  40. Restormer: Efficient transformer for high-resolution image restoration. The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pages 5728–5739, 2022.
  41. Exposure trajectory recovery from motion blur. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(11):7490–7504, 2021.
Citations (2)

Summary

We haven't generated a summary for this paper yet.