Mohamed, Mirgahney; Agapito, Lourdes; (2023) DynamicSurf: Dynamic Neural RGB-D Surface Reconstruction with an Optimizable Feature Grid. arXiv.org: Ithaca (NY), USA.

Preview

PDF De Agapito Vicente_Dynamic Neural RGB-D Surface Reconstruction with an Optimizable Feature Grid_Pre-print.pdf - Submitted Version Download (13MB) | Preview

Abstract

We propose DynamicSurf, a model-free neural implicit surface reconstruction method for high-fidelity 3D modelling of non-rigid surfaces from monocular RGB-D video. To cope with the lack of multi-view cues in monocular sequences of deforming surfaces, one of the most challenging settings for 3D reconstruction, DynamicSurf exploits depth, surface normals, and RGB losses to improve reconstruction fidelity and optimisation time. DynamicSurf learns a neural deformation field that maps a canonical representation of the surface geometry to the current frame. We depart from current neural non-rigid surface reconstruction models by designing the canonical representation as a learned feature grid which leads to faster and more accurate surface reconstruction than competing approaches that use a single MLP. We demonstrate DynamicSurf on public datasets and show that it can optimize sequences of varying frames with 6× speedup over pure MLP-based approaches while achieving comparable results to the state-of-the-art methods.

Download activity - last month

Export as CSVJSONXML

Download activity - last 12 months

Export as CSVJSONXML

Downloads by country - last 12 months

Export as CSVXMLJSON

Archive Staff Only

View Item