NeuralSRNF: Neural Square-Root Normal Fields for the Statistical Analysis and Generation of Nonrigid 3D Objects

Abstract

We introduce NeuralSRNF, a novel framework for the statistical shape analysis and generation of genus-zero 3D objects that undergo non-rigid deformations. Traditional methods rely on complex and computationally expensive nonlinear elastic metrics that measure bending and stretching. Recent advances in elastic shape analysis achieve computational efficiency by mapping input 3D shapes to the space of Square Root Normal Fields (SRNFs) where the complex elastic metric becomes an L2 metric, significantly facilitating the process of computing geodesics and summary statistics. SRNFs, however, are not invertible and the numerical algorithms used to map SRNFs back to the original space of surfaces remain computationally very expensive and often lead to approximate results. This paper addresses this fundamental SRNF inversion problem using a novel neural representation, termed NeuralSRNF. Unlike the commonly used numerical SRNF, NeuralSRNF is (1) continuous, and thus resolution agnostic enabling full functional shape analysis, (2) more accurate, and (3) computationally more efficient as it can compute inverse SRNF maps in less than 3 secs compared to over 10 mins in the numerical SRNF. We demonstrate, using various datasets, the utility and efficiency of the proposed NeuralSRNF in multiple elastic 3D shape analysis tasks such as geodesic computation, deformation transfer, statistical summaries computation, and 3D shape generation. We show that it outperforms the state of the art by a wide margin in both accuracy and computational efficiency.


Neural SRNF inversion results for 3D humans, animals, and faces

Neural SRNF network architecture teaser

NeuralSRNF inversion of 3D shapes

Geodesics videos for animals

Geodesics videos for humans


Neural SRNF network architecture

Neural SRNF network architecture teaser

The website template was borrowed from Michaël Gharbi and Ref-NeRF.