Papers
Topics
Authors
Recent
Gemini 2.5 Flash
Gemini 2.5 Flash
126 tokens/sec
GPT-4o
47 tokens/sec
Gemini 2.5 Pro Pro
43 tokens/sec
o3 Pro
4 tokens/sec
GPT-4.1 Pro
47 tokens/sec
DeepSeek R1 via Azure Pro
28 tokens/sec
2000 character limit reached

Multi-View Neural 3D Reconstruction of Micro-/Nanostructures with Atomic Force Microscopy (2401.11541v1)

Published 21 Jan 2024 in cs.CV and cond-mat.mtrl-sci

Abstract: Atomic Force Microscopy (AFM) is a widely employed tool for micro-/nanoscale topographic imaging. However, conventional AFM scanning struggles to reconstruct complex 3D micro-/nanostructures precisely due to limitations such as incomplete sample topography capturing and tip-sample convolution artifacts. Here, we propose a multi-view neural-network-based framework with AFM (MVN-AFM), which accurately reconstructs surface models of intricate micro-/nanostructures. Unlike previous works, MVN-AFM does not depend on any specially shaped probes or costly modifications to the AFM system. To achieve this, MVN-AFM uniquely employs an iterative method to align multi-view data and eliminate AFM artifacts simultaneously. Furthermore, we pioneer the application of neural implicit surface reconstruction in nanotechnology and achieve markedly improved results. Extensive experiments show that MVN-AFM effectively eliminates artifacts present in raw AFM images and reconstructs various micro-/nanostructures including complex geometrical microstructures printed via Two-photon Lithography and nanoparticles such as PMMA nanospheres and ZIF-67 nanocrystals. This work presents a cost-effective tool for micro-/nanoscale 3D analysis.

Definition Search Book Streamline Icon: https://streamlinehq.com
References (77)
  1. Gates, B. et al. New approaches to nanofabrication: Molding, printing, and other techniques. Chemical Reviews 105, 1171–1196 (2005).
  2. From micro- to nanofabrication with soft materials. Science 290, 1536–1540 (2000).
  3. A logic-gated nanorobot for targeted transport of molecular payloads. Science 335, 831–834 (2012).
  4. Li, S. et al. A DNA nanorobot functions as a cancer therapeutic in response to a molecular trigger in vivo. Nature Biotechnology 36, 258+ (2018).
  5. Gratton, S. E. A. et al. The effect of particle design on cellular internalization pathways. Proceedings of the National Academy of Sciences 105, 11613–11618 (2008).
  6. More effective nanomedicines through particle design. small 7, 1919–1931 (2011).
  7. Seiler, H. Secondary-electron emission in the scanning electron-microscope. Journal of Applied Physics 54, R1–R18 (1983).
  8. Radiation damage in the TEM and SEM. Micron 35, 399–409 (2004).
  9. Atomic force microscope. Physical Review Letters 56, 930–933 (1986).
  10. AFM image artifacts. Applied Surface Science 304, 11–19 (2014).
  11. AFM imaging artifacts due to bacterial cell height and AFM tip geometry. Langmuir 19, 851–857 (2003).
  12. Tip artifacts in atomic-force microscope imaging of thin-film surfaces. Journal of Applied Physics 74, 3608–3610 (1993).
  13. Method for imaging sidewalls by atomic-force microscopy. Applied Physics Letters 64, 2498–2500 (1994).
  14. Higher order tip effects in traceable CD-AFM-based linewidth measurements. Measurement Science and Technology 18, 448–455 (2007).
  15. True 3D-AFM sensor for nanometrology. Measurement Science and Technology 31, 074012 (2020).
  16. Sidewall imaging of microarray-based biosensor using an orthogonal cantilever probe. IEEE Transactions on Instrumentation and Measurement 70, 1–8 (2021).
  17. Nguyen, C. et al. Carbon nanotube scanning probe for profiling of deep-ultraviolet and 193 nm photoresist patterns. Applied Physics Letters 81, 901–903 (2002).
  18. Cho, S.-J. et al. Three-dimensional imaging of undercut and sidewall structures by atomic force microscopy. Review of Scientific Instruments 82 (2011).
  19. Development of a metrological atomic force microscope with a tip-tilting mechanism for 3D nanometrology. Measurement Science and Technology 29, 075005 (2018).
  20. Development of three-dimensional atomic force microscope for sidewall structures imaging with controllable scanning density. IEEE/ASME Transactions on Mechatronics 21, 316–328 (2016).
  21. Wu, J.-W. et al. Effective tilting angles for a dual probes AFM system to achieve high-precision scanning. IEEE/ASME Transactions on Mechatronics 21, 2512–2521 (2016).
  22. Atomic force microscope caliper for critical dimension measurements of micro and nanostructures through sidewall scanning. Ultramicroscopy 158, 8–16 (2015).
  23. An image stitching method to eliminate the distortion of the sidewall in linewidth measurement. In Metrology, Inspection, and Process Control for Microlithography XVIII, vol. 5375, 363–373 (2004).
  24. Precision measurement of sub-50 nm linewidth by stitching double-tilt images. Japanese Journal of Applied Physics 49, 06GK06 (2010).
  25. Finer features for functional microdevices - micromachines can be created with higher resolution using two-photon absorption. Nature 412, 697–698 (2001).
  26. Jaiswal, A. et al. Two decades of two-photon lithography: Materials science perspective for additive manufacturing of 2D/3D nano-microstructures. Iscience 26 (2023).
  27. 3D printing of functional microrobots. Chemical Society Reviews 50, 2794–2838 (2021).
  28. Dabbagh, S. R. et al. 3D-printed microrobots from design to translation. Nature Communications 13 (2022).
  29. Shape control of semiconductor and metal oxide nanocrystals through nonhydrolytic colloidal routes. Angewandte Chemie International Edition 45, 3414–3439 (2006).
  30. Izadi, S. et al. Kinectfusion: Real-time 3D reconstruction and interaction using a moving depth camera. In Proceedings of the 24th annual ACM symposium on User interface software and technology, 559–568 (2011).
  31. A volumetric method for building complex models from range images. In Proceedings of the 23rd annual conference on Computer graphics and interactive techniques, 303–312 (1996).
  32. Real-time 3D reconstruction at scale using voxel hashing. ACM Transactions on Graphics (ToG) 32, 1–11 (2013).
  33. Xie, Y. et al. Neural fields in visual computing and beyond. Computer Graphics Forum 41, 641–676 (2022).
  34. NeuralFusion: Online depth fusion in latent space. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 3162–3172 (2021).
  35. BNV-Fusion: Dense 3D reconstruction using bi-level neural volume fusion. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 6166–6175 (2022).
  36. Mildenhall, B. et al. NeRF: Representing scenes as neural radiance fields for view synthesis. Communications of the ACM 65, 99–106 (2021).
  37. UNISURF: Unifying neural implicit surfaces and radiance fields for multi-view reconstruction. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 5589–5599 (2021).
  38. Yariv, L. et al. Multiview neural surface reconstruction by disentangling geometry and appearance. Advances in Neural Information Processing Systems 33, 2492–2502 (2020).
  39. Volume rendering of neural implicit surfaces. Advances in Neural Information Processing Systems 34, 4805–4815 (2021).
  40. iMAP: Implicit mapping and positioning in real-time. In Proceedings of the IEEE/CVF International Conference on Computer Vision, 6229–6238 (2021).
  41. Wang, P. et al. NeuS: Learning neural implicit surfaces by volume rendering for multi-view reconstruction. arXiv preprint arXiv:2106.10689 (2021).
  42. Poly(methyl methacrylate) particulate carriers in drug delivery. Journal of microencapsulation 29, 353–367 (2012).
  43. Synthesis of nano-ZnO/poly(methyl methacrylate) composite microsphere through emulsion polymerization and its UV-shielding property. Colloid and Polymer Science 284, 422–428 (2006).
  44. Synthesis of core-shell PMMA-SiO2 nanoparticles with suspension-dispersion-polymerization in an aqueous system and its effect on mechanical properties of PVC composites. Polymer testing 27, 540–547 (2008).
  45. The application of ZIF-67 and its derivatives: Adsorption, separation, electrochemistry and catalysts. Journal of Materials Chemistry A 6, 1887–1899 (2018).
  46. Hydrothermal synthesis of zeolitic imidazolate framework-67 (ZIF-67) nanocrystals. Materials Letters 82, 220–223 (2012).
  47. Wang, L. et al. Flexible solid-state supercapacitor based on a metal-organic framework interwoven by electrochemically-deposited PANI. Journal of the American Chemical Society 137, 4920–4923 (2015).
  48. Yang, J. et al. Hollow Zn/Co ZIF particles derived from core-shell ZIF-67@ZIF-8 as selective catalyst for the semi-hydrogenation of acetylene. Angewandte Chemie-international Edition 54, 10889–10893 (2015).
  49. Efficient variants of the ICP algorithm. In Proceedings third international conference on 3-D digital imaging and modeling, 145–152 (2001).
  50. What is the expectation maximization algorithm? Nature Biotechnology 26, 897–899 (2008).
  51. Moon, T. The expectation-maximization algorithm. IEEE Signal Processing Magazine 13, 47–60 (1996).
  52. Implicit geometric regularization for learning shapes. arXiv preprint arXiv:2002.10099 (2020).
  53. Hecht-Nielsen, R. Theory of the backpropagation neural network. In Neural networks for perception, 65–93 (1992).
  54. Instant neural graphics primitives with a multiresolution hash encoding. ACM Transactions on Graphics (ToG) 41, 1–15 (2022).
  55. Marching cubes: A high resolution 3D surface construction algorithm. In Seminal graphics: pioneering efforts that shaped the field, 347–353 (1998).
  56. Direct laser writing: Principles and materials for scaffold 3D printing. Microelectronic Engineering 132, 83–89 (2015).
  57. AFM tip-sample convolution effects for cylinder protrusions. Applied Surface Science 422, 482–491 (2017).
  58. Lee, J. H. et al. Electrically pumped sub-wavelength metallo-dielectric pedestal pillar lasers. Optics Express 19, 21524–21531 (2011).
  59. State-of-art review of past research on manufacturing of meso and micro cylindrical gears. Precision engineering 51, 702–728 (2018).
  60. Community, B. O. Blender - a 3D modelling and rendering package. Blender Foundation, Stichting Blender Foundation, Amsterdam. http://www.blender.org (2018).
  61. Nanoencapsulation I. Methods for preparation of drug-loaded polymeric nanoparticles. Nanomedicine: Nanotechnology, Biology and Medicine 2, 8–21 (2006).
  62. Crystal growth of ZIF-8, ZIF-67, and their mixed-metal derivatives. Journal of the American Chemical Society 140, 1812–1823 (2018).
  63. The impact of ZIF-8 particle size and heat treatment on CO 2/CH 4 separation using asymmetric mixed matrix membrane. RSC Advances 4, 52530–52541 (2014).
  64. Shape-controlled synthesis of metal nanocrystals: simple chemistry meets complex physics? Angewandte Chemie International Edition 48, 60–103 (2009).
  65. BioAFMviewer: An interactive interface for simulated AFM scanning of biomolecular structures and dynamics. PLoS computational biology 16 (2020).
  66. Implicit neural representations with periodic activation functions. Advances in neural information processing systems 33, 7462–7473 (2020).
  67. Learning continuous image representation with local implicit image function. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, 8628–8638 (2021).
  68. D-NeRF: Neural radiance fields for dynamic scenes. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, 10318–10327 (2021).
  69. Guide to video recording of structure dynamics and dynamic processes of proteins by high-speed atomic force microscopy. Nature Protocols 7, 1193–1206 (2012).
  70. Open3D: A modern library for 3D data processing. arXiv:1801.09847 (2018).
  71. Guo, Y.-C. Instant neural surface reconstruction. Github. https://github.com/bennyguo/instant-nsr-pl (2022).
  72. Paszke, A. et al. PyTorch: An imperative style, high-performance deep learning library. Advances in neural information processing systems 32 (2019).
  73. Identifying locations on a substrate for the repeated positioning of AFM samples. Ultramicroscopy 68, 215–221 (1997).
  74. A new approach for repeated tip-sample relocation for AFM imaging of nano and micro sized particles and cells in liquid environment. Ultramicroscopy 211 (2020).
  75. Liu, Z. et al. Mechanically engraved mica surface using the atomic force microscope tip facilitates return to a specific sample location. Microscopy research and technique 66, 156–162 (2005).
  76. Grupp, M. evo: Python package for the evaluation of odometry and SLAM. Github. https://github.com/MichaelGrupp/evo (2017).
  77. Zeng, A. et al. Volumetric TSDF Fusion of RGB-D images in python. Github. https://github.com/andyzeng/tsdf-fusion-python (2017).

Summary

We haven't generated a summary for this paper yet.

Ai Sparkles Streamline Icon: https://streamlinehq.com Summarize Now