Stabilized Temporal 3D Face Alignment Using Landmark Displacement Learningopen access
- Authors
- Lee, Seongmin; Yoon, Hyunse; Park, Sohyun; Lee, Sanghoon; Kang, Jiwoo
- Issue Date
- Sep-2023
- Publisher
- Multidisciplinary Digital Publishing Institute (MDPI)
- Keywords
- face alignment; face displacement; face tracking; temporal stability; video-based alignment
- Citation
- Electronics (Switzerland), v.12, no.17
- Journal Title
- Electronics (Switzerland)
- Volume
- 12
- Number
- 17
- URI
- https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/151597
- DOI
- 10.3390/electronics12173735
- ISSN
- 2079-9292
2079-9292
- Abstract
- One of the most crucial aspects of 3D facial models is facial reconstruction. However, it is unclear if face shape distortion is caused by identity or expression when the 3D morphable model (3DMM) is fitted into largely expressive faces. In order to overcome the problem, we introduce neural networks to reconstruct stable and precise faces in time. The reconstruction network extracts the 3DMM parameters from video sequences to represent 3D faces in time. Meanwhile, our displacement networks learn the changes in facial landmarks. In particular, the networks learn changes caused by facial identity, facial expression, and temporal cues, respectively. The proposed facial alignment network exhibits reliable and precise performance in reconstructing static and dynamic faces by leveraging these displacement networks. The 300 Videos in the Wild (300VW) dataset is utilized for qualitative and quantitative evaluations to confirm the effectiveness of our method. The results demonstrate the considerable advantages of our method in reconstructing 3D faces from video sequences. © 2023 by the authors.
- Files in This Item
-
Go to Link
- Appears in
Collections - ICT융합공학부 > IT공학전공 > 1. Journal Articles
Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.