3D Face Reconstruction with the Geometric Guidance of Facial Part Segmentation

arXiv:2312.00311v3 Announce Type: replace
Abstract: 3D Morphable Models (3DMMs) provide promising 3D face reconstructions in various applications. However, existing methods struggle to reconstruct faces with extreme expressions due to deficiencies in supervisory signals, such as sparse or inaccurate landmarks. Segmentation information contains effective geometric contexts for face reconstruction. Certain attempts intuitively depend on differentiable renderers to compare the rendered silhouettes of reconstruction with segmentation, which is prone to issues like local optima and gradient instability. In this paper, we fully …

arxiv cs.cv face guidance part segmentation type