Single-Image Depth From Defocus With Coded Aperture and Diffusion Posterior Sampling

概要

We propose a single-snapshot coded-aperture depth-from-defocus (DFD) method that reconstructs RGBD by posterior-guided diffusion, combining a learned RGBD diffusion prior with a differentiable DFD forward model. Given a measurement, we approximately sample from the posterior induced by the forward model (data fidelity) and the diffusion prior, using a denoise–correct–renoise procedure that applies data-consistency updates in the denoised domain. Unlike U-Net–style regressors, our approach requires no paired defocus–RGBD training data and does not couple training to a specific camera configuration. Experiments on comprehensive simulations and a prototype camera show stable RGBD reconstructions across noise levels, outperforming U-Net baselines and a classical coded-aperture DFD method.Our implementation and experimental configuration will be released publicly upon publication.

発表文献
IEEE Transactions on Computational Imaging
長原一
長原一
教授

コンピューテーショナルフォトグラフィ、コンピュータビジョンを専門とし実世界センシングや情報処理技術、画像認識技術の研究を行う。さらに、画像センシングにとどまらず様々なセンサに拡張したコンピュテーショナルセンシング手法の開発や高次元で冗長な実世界ビッグデータから意味のある情報を計測するスパースセンシングへの転換を目指す。