Accelerating local laplacian filters on FPGAs (2402.12407v1)
Abstract: Images when processed using various enhancement techniques often lead to edge degradation and other unwanted artifacts such as halos. These artifacts pose a major problem for photographic applications where they can denude the quality of an image. There is a plethora of edge-aware techniques proposed in the field of image processing. However, these require the application of complex optimization or post-processing methods. Local Laplacian Filtering is an edge-aware image processing technique that involves the construction of simple Gaussian and Laplacian pyramids. This technique can be successfully applied for detail smoothing, detail enhancement, tone mapping and inverse tone mapping of an image while keeping it artifact-free. The problem though with this approach is that it is computationally expensive. Hence, parallelization schemes using multi-core CPUs and GPUs have been proposed. As is well known, they are not power-efficient, and a well-designed hardware architecture on an FPGA can do better on the performance per watt metric. In this paper, we propose a hardware accelerator, which exploits fully the available parallelism in the Local Laplacian Filtering algorithm, while minimizing the utilization of on-chip FPGA resources. On Virtex-7 FPGA, we obtain a 7.5x speed-up to process a 1 MB image when compared to an optimized baseline CPU implementation. To the best of our knowledge, we are not aware of any other hardware accelerators proposed in the research literature for the Local Laplacian Filtering problem.
- P. Burt and E. Adelson, “The laplacian pyramid as a compact image code,” IEEE Transactions on communications, vol. 31, no. 4, pp. 532–540, 1983.
- H. Tsutsui, S. Yoshikawa, H. Okuhata, and T. Onoye, “Halo artifacts reduction method for variational based realtime retinex image enhancement,” in Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference, pp. 1–6, IEEE, 2012.
- Springer Science & Business Media, 2006.
- P. Perona and J. Malik, “Scale-space and edge detection using anisotropic diffusion,” IEEE Transactions on pattern analysis and machine intelligence, vol. 12, no. 7, pp. 629–639, 1990.
- C. Tomasi and R. Manduchi, “Bilateral filtering for gray and color images,” in Sixth international conference on computer vision (IEEE Cat. No. 98CH36271), pp. 839–846, IEEE, 1998.
- R. Fattal, “Edge-avoiding wavelets and their applications,” ACM Transactions on Graphics (TOG), vol. 28, no. 3, pp. 1–10, 2009.
- P. Bhat, C. L. Zitnick, M. Cohen, and B. Curless, “Gradientshop: A gradient-domain optimization framework for image and video filtering,” ACM Transactions on Graphics (TOG), vol. 29, no. 2, pp. 1–14, 2010.
- Z. Farbman, R. Fattal, D. Lischinski, and R. Szeliski, “Edge-preserving decompositions for multi-scale tone and detail manipulation,” ACM Transactions on Graphics (TOG), vol. 27, no. 3, pp. 1–10, 2008.
- S. Paris, S. W. Hasinoff, and J. Kautz, “Local laplacian filters: Edge-aware image processing with a laplacian pyramid.,” ACM Trans. Graph., vol. 30, no. 4, p. 68, 2011.
- M. Aubry, S. Paris, S. W. Hasinoff, J. Kautz, and F. Durand, “Fast local laplacian filters: Theory and applications,” ACM Transactions on Graphics (TOG), vol. 33, no. 5, pp. 1–14, 2014.
- S. D. Dabhade, G. Rathna, and K. N. Chaudhury, “A reconfigurable and scalable fpga architecture for bilateral filtering,” IEEE Transactions on Industrial Electronics, vol. 65, no. 2, pp. 1459–1469, 2017.
- A. Gabiger-Rose, M. Kube, R. Weigel, and R. Rose, “An fpga-based fully synchronized design of a bilateral filter for real-time image denoising,” IEEE Transactions on Industrial Electronics, vol. 61, no. 8, pp. 4093–4104, 2014.
- Shashwat Khandelwal (11 papers)
- Ziaul Choudhury (2 papers)
- Shashwat Shrivastava (1 paper)
- Suresh Purini (2 papers)