Gradient Flow Evolution for 3D Fusion From a Single Depth Sensor
Citations

WEB OF SCIENCE

17
Citations

SCOPUS

17

초록

We present a novel real-time framework for non-rigid 3D reconstruction that is robust to noise, camera poses, and large deformation from a single depth camera. KinectFusion has achieved high-quality 3D object reconstructions in real-time by implicitly representing an object’s surface with a signed distance field (SDF) representation from a single depth camera. Many studies for incremental reconstruction have been presented since then, with the surface estimation improving over time. Previous works primarily focused on improving conventional SDF matching and deformation schemes. In contrast to these works, the proposed framework tackles the problem of temporal inconsistency caused by SDF approximation and fusion to manipulate SDFs and reconstruct a target more accurately over time. In our reconstruction pipeline, we introduce a refinement evolution method, where an erroneous SDF from a depth sensor is recovered more accurately in a few iterations by propagating erroneous SDF values from the surface. Reliable gradients of refined SDFs enable more accurate non-rigid tracking of a target object. Furthermore, we propose a level-set evolution for SDF fusion, enabling SDFs to be manipulated stably in the reconstruction pipeline over time. The proposed methods are fully parallelizable and can be executed in real-time. Q

키워드

Three-dimensional displaysSurface reconstructionPipelinesStrainCamerasReliabilityReal-time systems3D reconstructionsigned distance fieldimplicit representationnon-rigid deformationincremental reconstructionLEVEL SET EVOLUTIONSCENE FLOWREGISTRATIONSTEREOREINITIALIZATIONOPTIMIZATIONSPARSEFIELDSSHAPE
제목
Gradient Flow Evolution for 3D Fusion From a Single Depth Sensor
저자
Kang, JiwooLee, SeongminJang, MingyuLee, Sanghoon
DOI
10.1109/tcsvt.2021.3089695
발행일
2022-04
저널명
IEEE Transactions on Circuits and Systems for Video Technology
32
4
페이지
2211 ~ 2225