Abstract
In this paper, we propose a robust method for monocular face shape reconstruction (MFSR) using a sparse set of facial landmarks that are detected by most of the off-the-shelf landmark detectors. Different from the classical shape-from-shading framework, we formulate the MFSR problem as a Two-Fold Coupled Structure Learning (2FCSL) process, which consists of learning a regression between two subspaces spanned by 3D sparse landmarks and 2D sparse landmarks, and a coupled dictionary learned on 3D sparse and dense shape using K-SVD. To handle variations in face pose, we explicitly incorporate pose estimation in our method. Extensive experiments on both synthetic and real data from two challenging datasets using manual and automatic landmarks indicate that our method achieves promising performance and is robust to pose variations and landmark localization noise.
Original language | English (US) |
---|---|
State | Published - 2014 |
Event | 25th British Machine Vision Conference, BMVC 2014 - Nottingham, United Kingdom Duration: Sep 1 2014 → Sep 5 2014 |
Conference
Conference | 25th British Machine Vision Conference, BMVC 2014 |
---|---|
Country/Territory | United Kingdom |
City | Nottingham |
Period | 9/1/14 → 9/5/14 |
ASJC Scopus subject areas
- Computer Vision and Pattern Recognition