3D corrective nose reconstruction from a single image

查看全文 作　　者：Yanlong [1]Tang;Yun [2]Zhang;Xiaoguang [3]Han;Fang-Lue [4]Zhang;Yu-Kun [5]Lai;Ruofeng [6]Tong 机构地区：[1]Tencent Games Lightspeed&Quantum Studios,Shenzhen,China;[2]Communication University of Zhejiang,Hangzhou,China;[3]Shenzhen Research Institute of Big Data,the Chinese University of Hong Kong(Shenzhen),Shenzhen,China;[4]Victoria University of Wellington,Wellington,New Zealand;[5]Cardiff University,Wales,UK;[6]Zhejiang University,Hangzhou,China 出　　处：《Computational Visual Media》索引2022年第8卷第2期,共13页 基　　金：supported by the National Natural Science Foundation of China(Grant Nos.61972342,61602402,and 61902334);Zhejiang Provincial Basic Public Welfare Research(Grant No.LGG19F020001);Shenzhen Fundamental Research(General Project)(Grant No.JCYJ20190814112007258);the Royal Society(Grant No.IES\R1\180126). 摘　　要：There is a steadily growing range of applications that can benefit from facial reconstruction techniques,leading to an increasing demand for reconstruction of high-quality 3D face models.While it is an important expressive part of the human face,the nose has received less attention than other expressive regions in the face reconstruction literature.When applying existing reconstruction methods to facial images,the reconstructed nose models are often inconsistent with the desired shape and expression.In this paper,we propose a coarse-to-fine 3D nose reconstruction and correction pipeline to build a nose model from a single image,where 3D and 2D nose curve correspondences are adaptively updated and refined.We first correct the reconstruction result coarsely using constraints of 3D-2D sparse landmark correspondences,and then heuristically update a dense 3D-2D curve correspondence based on the coarsely corrected result.A final refinement step is performed to correct the shape based on the updated 3D-2D dense curve constraints.Experimental results show the advantages of our method for 3D nose reconstruction over existing methods. 关 键 词：nose shape recovery single image 3D reconstruction contour correspondence Laplacian deformation