Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
169 tokens/sec
GPT-4o
7 tokens/sec
Gemini 2.5 Pro Pro
45 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
38 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

MIPI 2024 Challenge on Demosaic for HybridEVS Camera: Methods and Results (2405.04867v1)

Published 8 May 2024 in eess.IV and cs.CV

Abstract: The increasing demand for computational photography and imaging on mobile platforms has led to the widespread development and integration of advanced image sensors with novel algorithms in camera systems. However, the scarcity of high-quality data for research and the rare opportunity for in-depth exchange of views from industry and academia constrain the development of mobile intelligent photography and imaging (MIPI). Building on the achievements of the previous MIPI Workshops held at ECCV 2022 and CVPR 2023, we introduce our third MIPI challenge including three tracks focusing on novel image sensors and imaging algorithms. In this paper, we summarize and review the Nighttime Flare Removal track on MIPI 2024. In total, 170 participants were successfully registered, and 14 teams submitted results in the final testing phase. The developed solutions in this challenge achieved state-of-the-art performance on Nighttime Flare Removal. More details of this challenge and the link to the dataset can be found at https://mipi-challenge.org/MIPI2024/.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (28)
  1. Simple baselines for image restoration. In European Conference on Computer Vision, pages 17–33. Springer, 2022.
  2. Activating more pixels in image super-resolution transformer. In IEEE Conference on Computer Vision and Pattern Recognition, pages 22367–22377, 2023.
  3. Real-time under-display cameras image restoration and hdr on mobile devices. In Computer Vision–ECCV 2022 Workshops. Springer, 2022.
  4. Mipi 2023 challenge on nighttime flare removal: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2852–2862, 2023.
  5. Event-based vision: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 44(1):154–180, 2020.
  6. New color filter patterns and demosaic for sub-micron pixel arrays. In Proceedings of the International Image Sensor Workshop, pages 8–11, 2015.
  7. Yolo-spd: Tiny objects localization on remote sensing based on you only look once and space-to-depth convolution. In 2024 IEEE International Conference on Consumer Electronics (ICCE), pages 1–3. IEEE, 2024.
  8. High-sensitivity pixels with a quad-wrgb color filter and spatial deep-trench isolation. Sensors, 19(21):4653, 2019.
  9. 1.22 μ𝜇\muitalic_μm 35.6 mpixel rgb hybrid event-based vision sensor with 4.88 μ𝜇\muitalic_μm-pitch event pixels and up to 10k event frame rate by adaptive control on event sparsity. In 2023 IEEE International Solid-State Circuits Conference (ISSCC), pages 92–94. IEEE, 2023.
  10. Efficient and explicit modelling of image hierarchies for image restoration. In IEEE Conference on Computer Vision and Pattern Recognition, pages 18278–18289, 2023.
  11. SwinIR: Image restoration using swin transformer. In IEEE International Conference on Computer Vision, pages 1833–1844, 2021.
  12. Enhanced deep residual networks for single image super-resolution. In The IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops, 2017.
  13. Video swin transformer. In IEEE Conference on Computer Vision and Pattern Recognition, pages 3202–3211, 2022.
  14. End-to-end depth-guided relighting using lightweight deep learning-based method. Journal of Imaging, pages 9, 175.
  15. U-net and its variants for medical image segmentation: A review of theory and applications. IEEE ACCESS, 9:82031–82057, 2021.
  16. A 640×\times× 480 dynamic vision sensor with a 9 um pixel and 300 meps address-event representation. In IEEE International Conference on Solid-State Circuits, San Francisco, CA, USA, pages 5–9, 2017.
  17. Mipi 2023 challenge on rgbw remosaic: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2877–2884, 2023a.
  18. Mipi 2023 challenge on rgbw fusion: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2870–2876, 2023b.
  19. Swift parameter-free attention network for efficient super-resolution. arXiv preprint arXiv:2311.12770, 2023.
  20. Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600–612, 2004.
  21. End-to-end learning for joint image demosaicing, denoising and super-resolution. In IEEE International Conference on Computer Vision, 2021.
  22. Mipi 2022 challenge on quad-bayer re-mosaic: Dataset and report. In European Conference on Computer Vision, pages 21–35. Springer, 2022.
  23. K Yonemoto. Principles and applications of ccd/cmos image sensors, 2003.
  24. Cycleisp: Real image restoration via improved data synthesis. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2696–2705, 2020.
  25. Restormer: Efficient transformer for high-resolution image restoration. In IEEE Conference on Computer Vision and Pattern Recognition, pages 5728–5739, 2022.
  26. Practical blind image denoising via swin-conv-unet and data synthesis. Machine Intelligence Research, 20(6):822–836, 2023.
  27. Mipi 2023 challenge on rgb+ tof depth completion: Methods and results. In IEEE Conference on Computer Vision and Pattern Recognition, pages 2863–2869, 2023.
  28. Self-calibrated efficient transformer for lightweight super-resolution. In IEEE International Conference on Computer Vision, pages 3507–3516, 2021.
Citations (2)

Summary

We haven't generated a summary for this paper yet.