Fighting Deepfakes by Detecting GAN DCT Anomalies

被引:62
作者
Giudice, Oliver [1 ]
Guarnera, Luca [1 ,2 ]
Battiato, Sebastiano [1 ,2 ]
机构
[1] Univ Catania, Dept Math & Comp Sci, I-95125 Catania, Italy
[2] iCTLab Srl, Univ Catania, Spinoff, I-95125 Catania, Italy
关键词
deepfake detection; Generative Adversarial Networks; multimedia forensics; image forensics; COEFFICIENT DISTRIBUTIONS; FACE;
D O I
10.3390/jimaging7080128
中图分类号
TB8 [摄影技术];
学科分类号
081602 [摄影测量与遥感];
摘要
To properly contrast the Deepfake phenomenon the need to design new Deepfake detection algorithms arises; the misuse of this formidable A.I. technology brings serious consequences in the private life of every involved person. State-of-the-art proliferates with solutions using deep neural networks to detect a fake multimedia content but unfortunately these algorithms appear to be neither generalizable nor explainable. However, traces left by Generative Adversarial Network (GAN) engines during the creation of the Deepfakes can be detected by analyzing ad-hoc frequencies. For this reason, in this paper we propose a new pipeline able to detect the so-called GAN Specific Frequencies (GSF) representing a unique fingerprint of the different generative architectures. By employing Discrete Cosine Transform (DCT), anomalous frequencies were detected. The beta statistics inferred by the AC coefficients distribution have been the key to recognize GAN-engine generated data. Robustness tests were also carried out in order to demonstrate the effectiveness of the technique using different attacks on images such as JPEG Compression, mirroring, rotation, scaling, addition of random sized rectangles. Experiments demonstrated that the method is innovative, exceeds the state of the art and also give many insights in terms of explainability.
引用
收藏
页数:17
相关论文
共 47 条
[1]
[Anonymous], 2017, IEEE I CONF COMP VIS, DOI DOI 10.1109/ICCV.2017.244
[2]
Bishop C. M., 2006, Pattern recognition and machine learning
[3]
Image-to-Image Translation via Group-wise Deep Whitening-and-Coloring Transformation [J].
Cho, Wonwoong ;
Choi, Sungha ;
Park, David Keetae ;
Shin, Inkyu ;
Choo, Jaegul .
2019 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR 2019), 2019, :10631-10639
[4]
StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translation [J].
Choi, Yunjey ;
Choi, Minje ;
Kim, Munyoung ;
Ha, Jung-Woo ;
Kim, Sunghun ;
Choo, Jaegul .
2018 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION (CVPR), 2018, :8789-8797
[5]
Durall Ricard, 2019, Unmasking DeepFakes with simple Features
[6]
Representing scenes for real-time context classification on mobile devices [J].
Farinella, G. M. ;
Ravi, D. ;
Tomaselli, V. ;
Guarnera, M. ;
Battiato, S. .
PATTERN RECOGNITION, 2015, 48 (04) :1086-1100
[7]
Goodfellow I., COMMUN ACM, P2672
[8]
DeepFake Detection by Analyzing Convolutional Traces [J].
Guarnera, Luca ;
Giudice, Oliver ;
Battiato, Sebastiano .
2020 IEEE/CVF CONFERENCE ON COMPUTER VISION AND PATTERN RECOGNITION WORKSHOPS (CVPRW 2020), 2020, :2841-2850
[9]
Fighting Deepfake by Exposing the Convolutional Traces on Images [J].
Guarnera, Luca ;
Giudice, Oliver ;
Battiato, Sebastiano .
IEEE ACCESS, 2020, 8 :165085-165098
[10]
Guarnera Luca, 2020, 2020 AEIT INT ANN C, P1