Detailed Information

Cited 0 time in webofscience Cited 0 time in scopus
Metadata Downloads

DeepFake detection algorithm based on improved vision transformer

Authors
Heo, Young-JinYeo, Woon-HaKim, Byung-Gyu
Issue Date
1-Apr-2023
Publisher
SPRINGER
Keywords
Deep learning; Deepfake detection; Distillation; Generative adversarial network; Vision transformer
Citation
APPLIED INTELLIGENCE, v.53, no.7, pp 7512 - 7527
Pages
16
Journal Title
APPLIED INTELLIGENCE
Volume
53
Number
7
Start Page
7512
End Page
7527
URI
https://scholarworks.sookmyung.ac.kr/handle/2020.sw.sookmyung/151897
DOI
10.1007/s10489-022-03867-9
ISSN
0924-669X
1573-7497
Abstract
A DeepFake is a manipulated video made with generative deep learning technologies, such as generative adversarial networks or auto encoders that anyone can utilize. With the increase in DeepFakes, classifiers consisting of convolutional neural networks (CNN) that can distinguish them have been actively created. However, CNNs have a problem with overfitting and cannot consider the relation between local regions as global feature of image, resulting in misclassification. In this paper, we propose an efficient vision transformer model for DeepFake detection to extract both local and global features. We combine vector-concatenated CNN feature and patch-based positioning to interact with all positions to specify the artifact region. For the distillation token, the logit is trained using binary cross entropy through the sigmoid function. By adding this distillation, the proposed model is generalized to improve performance. From experiments, the proposed model outperforms the SOTA model by 0.006 AUC and 0.013 f1 score on the DFDC test dataset. For 2,500 fake videos, the proposed model correctly predicts 2,313 as fake, whereas the SOTA model predicts 2,276 in the best performance. With the ensemble method, the proposed model outperformed the SOTA model by 0.01 AUC. For Celeb-DF (v2) dataset, the proposed model achieves a high performance of 0.993 AUC and 0.978 f1 score, respectively.
Files in This Item
There are no files associated with this item.
Appears in
Collections
ETC > 1. Journal Articles

qrcode

Items in ScholarWorks are protected by copyright, with all rights reserved, unless otherwise indicated.

Related Researcher

Researcher Kim, Byung Gyu photo

Kim, Byung Gyu
공과대학 (인공지능공학부)
Read more

Altmetrics

Total Views & Downloads

BROWSE