Instruct-NeRF2NeRF is a method for editing NeRF scenes using text instructions.
It uses an image-conditioned diffusion model to edit input images while optimizing the underlying scene.
NeRF: A neural radiance field that represents a 3D scene.
Instruct-NeRF2NeRF: A method for editing NeRF scenes using text instructions.
Image-conditioned diffusion model: A model that iteratively edits input images while optimizing the underlying scene.
InstructPix2Pix: A diffusion model used by Instruct-NeRF2NeRF to edit images based on text instructions.
Iterative updating: The process of gradually updating a reconstructed NeRF scene by updating dataset images while training the NeRF.
2D diffusion model
optimizing 3D scenes
Large Scale Scenes
Global Text Instruction