Bayesian multi-exposure image fusion for robust high dynamic range ptychography (2403.11344v4)
Abstract: The limited dynamic range of the detector can impede coherent diffractive imaging (CDI) schemes from achieving diffraction-limited resolution. To overcome this limitation, a straightforward approach is to utilize high dynamic range (HDR) imaging through multi-exposure image fusion (MEF). This method involves capturing measurements at different exposure times, spanning from under to overexposure and fusing them into a single HDR image. The conventional MEF technique in ptychography typically involves subtracting the background noise, ignoring the saturated pixels and then merging the acquisitions. However, this approach is inadequate under conditions of low signal-to-noise ratio (SNR). Additionally, variations in illumination intensity significantly affect the phase retrieval process. To address these issues, we propose a Bayesian MEF modeling approach based on a modified Poisson distribution that takes the background and saturation into account. To infer the model parameters, the expectation-maximization (EM) algorithm is employed. As demonstrated with synthetic and experimental data, our approach outperforms the conventional MEF method, offering superior phase retrieval under challenging experimental conditions. This work underscores the significance of robust multi-exposure image fusion for ptychography, particularly in imaging shot-noise-dominated weakly scattering specimens or in cases where access to HDR detectors with high SNR is limited. Furthermore, the applicability of the Bayesian MEF approach extends beyond CDI to any imaging scheme that requires HDR treatment. Given this versatility, we provide the implementation of our algorithm as a Python package.
- Wide-field broadband extreme ultraviolet transmission ptychography using a high-harmonic source. Opt. Lett., 41(7):1317–1320, Apr 2016.
- Maximum likelihood from incomplete data via the em algorithm. Journal of the Royal Statistical Society: Series B (Methodological), 39(1):1–22, 1977.
- Ptychographic coherent diffractive imaging of weakly scattering specimens. New Journal of Physics, 12(3):035017, Mar 2010.
- Structured illumination ptychography and at-wavelength characterization with an euv diffuser at 13.5 nm wavelength. Opt. Express, 32(3):3480–3491, Jan 2024.
- Bayesian Data Analysis. Chapman and Hall/CRC, November 2013.
- Using automatic differentiation as a general framework for ptychographic reconstruction. Opt. Express, 27(13):18653–18672, Jun 2019.
- Supplementary software and data: Bayesian multi-exposure image fusion for robust high dynamic range preprocessing in ptychography, March 2024.
- Large dynamic range dark-field imaging based on microscopic images fusion. Optics Communications, 528:128966, 2023. ISSN 0030-4018.
- In situ coherent diffractive imaging. Nature Communications, 9(1):1826, May 2018. ISSN 2041-1723.
- Advances in laboratory-scale ptychography using high harmonic sources [invited]. Opt. Express, 30(3):4133–4164, Jan 2022.
- Ptylab.m/py/jl: a cross-platform, open-source inverse modeling toolbox for conventional and fourier ptychography. Opt. Express, 31(9):13763–13797, Apr 2023.
- Further improvements to the ptychographical iterative engine. Optica, 4(7):736–745, Jul 2017.
- An improved ptychographical phase retrieval algorithm for diffractive imaging. Ultramicroscopy, 109(10):1256–1262, 2009. ISSN 0304-3991.
- Ptychographic coherent diffractive imaging with orthogonal probe relaxation. Opt. Express, 24(8):8360–8369, Apr 2016.
- Towards optimized illumination for high-resolution ptychography. Opt. Express, 27(10):14981–14997, May 2019.
- Plackett, R. L. The truncated poisson distribution. Biometrics, 9(4):485, December 1953.
- Ptychography, pp. 819–904. Springer International Publishing, Cham, 2019. ISBN 978-3-030-00069-1.
- Quantitative ptychographic bio-imaging in the water window. Opt. Express, 26(2):1237–1254, Jan 2018.
- Maximum-likelihood estimation in ptychography in the presence of poisson–gaussian noise statistics. Opt. Lett., 48(22):6027–6030, Nov 2023.
- Non-linearity in wide dynamic range CMOS image sensors utilizing a partial charge transfer technique. Sensors (Basel), 9(12):9452–9467, Nov 2009.
- Multi-exposure microscopic image fusion-based detail enhancement algorithm. Ultramicroscopy, 236:113499, 2022. ISSN 0304-3991.
- Maximum-likelihood refinement for coherent diffractive imaging. New Journal of Physics, 14(6):063004, Jun 2012.
- High-resolution scanning x-ray diffraction microscopy. Science, 321(5887):379–382, 2008.
- scikit-image: image processing in python. PeerJ, 2:e453, 2014.
- Image quality assessment: from error visibility to structural similarity. IEEE Transactions on Image Processing, 13(4):600–612, 2004.
- Multi-exposure image fusion techniques: A comprehensive review. Remote Sensing, 14(3), 2022. ISSN 2072-4292.
- Cell-sensitive phase contrast microscopy imaging by multiple exposures. Medical Image Analysis, 25(1):111–121, 2015. ISSN 1361-8415.
- Phase retrieval by coherent modulation imaging. Nature Communications, 7(1):13367, Nov 2016. ISSN 2041-1723.
- Zhang, X. Benchmarking and comparing multi-exposure image fusion algorithms. Information Fusion, 74:111–131, 2021. ISSN 1566-2535.