Awesome-FAS (Face Authentication Security)

A curated list of Face Authentication Security (including face anti-spoofing/face presentation attack/face liveness detection, face attack models, etc.) and related resources. This is inspired by Awesome-deep-vision, Awesome-adversarial-machine-learning, Awesome-deep-learning-papers, Awesome-NAS and Awesome-Pruing

Please feel free to pull requests or open an issue to add papers.

Contents

• Awesome-FAS (Face Authentication Security)
  • Contents
  • Databases
  • Learning-based Methods
    • Year 2021
    • Year 2020
    • Year 2019-2018
    • Before 2018
  • System / Mobile Applications
  • Attack
  • Notes

Databases

Name	Release year	Attacks	Modalities	#subjects	#videos
Ambient-Flash	2021	2D attacks	VIS, additional light flashing
3DMA	2019	3D Mask	VIS,NIR	67 genuine + 48masks	920
CASIA-SURF 3D HiFi Mask	2020	3D Mask	VIS
CASIA-SURF 3D Mask, paper	2020	3D Mask	VIS
CUHK MMLab CelebA-Spoof	2020	2D Print, Replay (Derived from CelbeA dataset)	VIS
CASIA-SURF Cross-ethnicity Face Anti-spoofing (CeFA), paper	2019	2D Print, Replay; 3D print, silica gel mask	VIS, Depth, Infrared (IR)	8	192
IDIAP WMCA	2019	2D Print, Replay and 3D Rigid Mask, Flexible Mask, Paper Mask attacks	VIS, depth, infrared and thermal	72	6716
CASIA-SURF, paper	2018	2D Print/Cut	VIS, Depth, Infrared (IR)	1000	21000
IDIAP CSMAD, paper	2018	Custom Silicone Mask Attack	VIS, near-infrared (NIR), Thermal from long-wave infrared (LWIR),
ROSE-YOUTU	2018	2D Replay, Print, Paper Mask	VIS	25	4225
MSU SiW-M（unavailable now）	2019	2D Replay, Print & 3D Mask	VIS
MSU SiW (Spoofing in the Wild)	2018	2D Replay, Print	VIS	165	4620
HKBU-MARs	2016	3D MASK	VIS	12	1008
OULU-NPU	2017	2D Replay, Print	VIS	55	5940
IDIAP Multispectral-Spoof Dataset	2015	2D Print	VIS, Near-Infrared	21	4704 images
IDIAP 3D Mask Attack Dataset (3DMAD), paper	2013	3D Mask	VIS, Depth	17	255
IDIAP Replay Attack	2012	2D Replay, Print	VIS
CASIA MFSD (FASD)	2012	2D Replay, Print	VIS	50	600

Learning-based methods

Year 2022

Title	Venue	Note
Learning Meta Pattern for Face Anti-Spoofing	TIFS 2022	MetaPattern, Code
Benchmarking Joint Face Spoofing and Forgery Detection with Visual and Physiological Cues	ArXiv 2022	DeepFake and FAS
Adaptive Transformers for Robust Few-shot Cross-domain Face Anti-spoofing	ECCV 2022	-
Face Anti-Spoofing Using Transformers with Relation-Aware Mechanism	T-BIOM 2022
Domain Generalization via Shuffled Style Assembly for Face Anti-Spoofing	Preprint 2022	Probabilistic Modeling
Robust Face Anti-Spoofing with Dual Probabilistic Modeling	CVPR 2022	Style transfer
Feature Generation and Hypothesis Verification for Reliable Face Anti-Spoofing	AAAI 2022	Hypothesis Verification?

Year 2021

Title	Venue	Note
Asymmetric Modality Translation For Face Presentation Attack Detection	TMM 2021
Consistency Regularization for Deep Face Anti-Spoofing	ArXiv 2021
Dual-Branch Meta-learning Network with Distribution Alignment for Face Anti-spoofing	TIFS 2021	Code
Dual Spoof Disentanglement Generation for Face Anti-spoofing with Depth Uncertainty Learning	ArXiv 2021
Unified Detection of Digital and Physical Face Attacks	ArXiv 2021
Attention-Based Spatial-Temporal Multi-Scale Network for Face Anti-Spoofing	T-BIOM 2021
Self-Domain Adaptation for Face Anti-Spoofing	AAAI 2021	DA
Detection and Continual Learning of Novel Face Presentation Attacks	ICCV 2021	Continual Learning; New attack types
Deep Learning for Face Anti-Spoofing: A Survey	ArXiv 2021	Survey; Under review
Meta-teacher for Face Anti-Spoofing	T-PAMI 2021	MetaTeacher
Dual-Cross Central Difference Network for Face Anti-Spoofing	IJCAI 2021	Based on CDCN
Learning One Class Representations for Face Presentation Attack Detection Using Multi-Channel Convolutional Neural Networks	T-IFS 2021	Multi-modality
Face Anti-Spoofing via Adversarial Cross-Modality Translation	T-IFS 2021	Multi-modality
Cross Modal Focal Loss for RGBD Face Anti-Spoofing	CVPR 2021	Multi-modality
Data Fusion based Two-stage Cascade Framework for Multi-Modality Face Anti-Spoofing	T-DSC 2021	Multi-modality
Improved Detection of Face Presentation Attacks Using Image Decomposition	ArXiv 2021	Albedo
Contrastive Context-Aware Learning for 3D High-Fidelity Mask Face Presentation Attack Detection	ArXiv 2021	CASIA-SURF 3DHiFi Dataset
TransRPPG: Remote Photoplethysmography Transformer for 3D Mask Face Presentation Attack Detection	ArXiv 2021	rPPG
Structure Destruction and Content Combination for Face Anti-Spoofing	IJCB 2021
Adaptive Normalized Representation Learning for Generalizable Face Anti-Spoofing	ACM MM 2021

Year 2020

Title	Venue	Note
Revisiting Pixel-Wise Supervision for Face Anti-Spoofing	T-BIOM 2020	-
Cross-domain face presentation attack detection via multi-domain disentangled representation learning	CVPR 2020	DG, Disentangledment learning
Rethinking Shape From Shading for Spoofing Detection	T-IP 2020	-
Camera Invariant Feature Learning for Generalized Face Anti-spoofing	T-IFS 2020	Domain generalization
NAS-FAS: Static-Dynamic Central Difference Network Search for Face Anti-Spoofing	T-PAMI 2020	NAS; Domain generalization;
3DPC-Net: 3D Point Cloud Network for Face Anti-spoofing	IJCB 2020	Pseudo Point Cloud
DRL-FAS: A Novel Framework Based on Deep Reinforcement Learning for Face Anti-Spoofing	T-IFS 2020	Reinforcement learning
Face spoofing detection based on local ternary label supervision in fully convolutional networks	T-IFS 2020	Using a map of Ones is the same as a depth map!
Face Anti-Spoofing via Disentangled Representation Learning	ECCV 2020	Disentanglement learning
On Disentangling Spoof Trace for Generic Face Anti-Spoofing	ECCV 2020	Similar idea as the DeSpoofing method
CelebA-Spoof: Large-Scale Face Anti-Spoofing Dataset with Rich Annotations	ECCV 2020	Contribute a dataset
Face Anti-Spoofing with Human Material Perception	ECCV 2020	2D Attacks
Leveraging Shape, Reflectance and Albedo from Shading for Face Presentation Attack Detection	T-IFS 2020	SfS for albedo, reflectance, and depth map
Deep Spatial Gradient and Temporal Depth Learning for Face Anti-spoofing	CVPR 2020	RGB, Depth-contrastive loss, Code
Searching Central Difference Convolutional Networks for Face Anti-Spoofing	CVPR 2020	RGB, NAS, CDCN, Code
Regularized Fine-grained Meta Face Anti-spoofing	AAAI 2020	RGB, 2D Attack, Meta Learning, Code; Meta learning
Unsupervised Adversarial Domain Adaptation for Cross-Domain Face Presentation Attack Detection	T-IFS 2020	Domain adaptation
Face Anti-Spoofing with Deep Neural Network Distillation	IEEE Journal of Selected Topics in Signal Processing 2020	Domain knowledge distillation
Single-Side Domain Generalization for Face Anti-Spoofing	CVPR 2020	RGB, Code
Domain Agnostic Feature Learning for Image and Video Based Face Anti-Spoofing	CVPRW 2020	RGB, 2D Attack
Learning Generalized Spoof Cues for Face Anti-spoofing	ArXiv 2020	RGB, 2D Attack, Code;
Learning Meta Model for Zero- and Few-shot Face Anti-spoofing	AAAI 2020	RGB, 2D Presentation Attack, Meta Learning, Code; few-shot
Learning to Learn Face-PAD: a lifelong learning approach	IJCB 2020	Life-long learning
Learning Generalizable and Identity-Discriminative Representations for Face Anti-Spoofing	ACM TIST 2020	DA

Year 2019-2018

Title	Venue	Note
Attention-Based Two-Stream Convolutional Networks for Face Spoofing Detection	T-IFS 2019	RGB, 2D Attack
Biometric Face Presentation Attack Detection with Multi-Channel Convolutional Neural Network	T-IFS 2019	RGB+IR+Depth, 2D Presentation Attack
Face Anti-Spoofing: Model Matters, So Does Data	CVPR 2019	RGB, 2D Attack,data augmentation
A Dataset and Benchmark for Large-scale Multi-modal Face Anti-spoofing	CVPR 2019	RGB+IR+Depth, 2D Attack
Deep Tree Learning for Zero-shot Face Anti-Spoofing	CVPR 2019	RGB, 2D Attack
Deep Anomaly Detection for Generalized Face Anti Spoofing	CVPRW 2019	RGB, 2D Attack
Joint Discriminative Learning of Deep Dynamic Textures for 3D Mask Face Anti-Spoofing	T-IFS 2019	VIS, 3D Attack
Multi-adversarial Discriminative Deep Domain Generalization for Face Presentation Attack Detection	CVPR 2019	RGB, 2D Attack,
Exploiting temporal and depth information for multi-frame face anti-spoofing	ArXiv 2018	RGB, 2D Presentation Attack, Multi-frame
Face De-Spoofing: Anti-Spoofing via Noise Modeling	ECCV 2018	RGB, 2D Attack, pseudo depth, Code
Learning Deep Models for Face Anti-Spoofing: Binary or Auxiliary Supervision	CVPR 2018	RGB, 2D Attack, pseudo depth+rPPG
Learning generalized deep feature representation for face anti-spoofing	T-IFS 2018	RGB, 2D Presentation Attack,
Unsupervised domain adaptation for face anti-spoofing	T-IFS 2018	RGB, 2D Attack, unsupervised domain adaptation

Before 2018

Title	Venue	Note
Face Anti-Spoofing Using Patch and Depth-Based CNNs	IJCB 2017	RGB, 2D Attack, pseudo depth
Face Spoofing Detection Using Colour Texture Analysis	T-IFS 2016	RGB, 2D Attack, Color LBP
Spoofing Face Recognition With 3D Masks	T-IFS 2014	3D Mask
Face Spoofing Detection Through Visual Codebooks of Spectral Temporal Cubes	IEEE TIP 2015	RGB, 2D Attack,
Person-Specific Face Anti-Spoofing With Subject Domain Adaptation	T-IFS 2015	RGB, 2D Attack, Person-specific
Face Spoof Detection with Image Distortion Analysis	T-IFS 2015	RGB, 2D Attack, IDA
Using Visual Rhythms for Detecting Video-Based Facial Spoof Attacks	T-IFS 2015	VIS, 2D Replay
Face spoofing detection from single images using texture and local shape analysis	IJCB 2011	RGB, 2D Presentation Attack, LBP

System / Mobile Applications

Title	Venue	Note
Efficient Face Spoofing Detection With Flash	T-BIOM	Flash
RFace: Anti-Spoofing Facial Authentication Using COTS RFID	INFOCOM 2021	RFID; privacy preserved
FaceRevelio: A Face Liveness Detection System for Smartphones with a Single Front Camera	MobiCom 2020	RGB+Flashing
EchoPrint: Two-factor Authentication using Acoustics and Vision on Smartphones	MobiCom 2018	Acoustic+Vision
Face Flashing: a Secure Liveness Detection Protocol based on Light Reflections	NDSS 2018	RGB+Flashing
Light Field-Based Face Presentation Attack Detection: Reviewing, Benchmarking and One Step Further	T-IFS 2018	Light Filed-Based
rtCaptcha: A Real-Time CAPTCHA Based Liveness Detection System	NDSS 2018	RGB, Captcha
Face Liveness Detection Using a Flash Against 2D Spoofing Attack	T-IFS 2017	RGB+Flashing, 2D Attack
Your face your heart: Secure mobile face authentication with photoplethysmograms	INFORCOM 2017	RGB, rPPG
Seeing your face is not enough: An inertial sensor-based liveness detection for face authentication	ACM CCS 2015	RGB+Accelerometer
Sensor-assisted facial recognition: an enhanced biometric authentication system for smartphones	Mobisys 2014	RGB+ Sensors

Attack

Title	Venue	Note
Light Can Hack Your Face! Black-box Backdoor Attack on Face Recognition Systems	ArXiv 2020	Face Recognition Attack
Virtual U: Defeating Face Liveness Detection by Building Virtual Models from Your Public Photos	USENIX SS 2018	VR tech for spoofing

Notes

• T-PAMI: IEEE Transactions on Pattern Analysis and Machine Intelligence
• T-IFS: IEEE Transactions on Information Forensics and Security
• T-IP: IEEE Transactions on Image Processing
• T-DSC: IEEE Transactions on Cognitive and Developmental Systems
• T-BIOM IEEE Transactions on Biometrics, Behavior, and Identity Science
• CVPR: Conference on Computer Vision and Pattern Recognition
• ICCV: International Conference on Computer Vision
• ECCV: European Conference on Computer Vision (Springer)
• USENIX SS: Proceedings of USENIX Security Symposium
• NDSS: The Network and Distributed System Security Symposium
• Infocom: IEEE International Conference on Computer Communications
• MobiCom: International Conference On Mobile Computing And Networking
• CCS: ACM Computer and Communications Security Conference
• MobiSys: International Conference on Mobile Systems, Applications, and Services
• IJCB: International Joint Conference on Biometrics
• ArXiv: Papers that only appear in ArXiv are regarded not published, but they are collected here for reference only.

---

If you feel useful about this repo, we would be happy you are also interested in our works and use our papers your work's reference.

@article{cai2020drlfas, title={DRL-FAS: A Novel Framework Based on Deep Reinforcement Learning for Face Anti-Spoofing},
author={Cai, Rizhao and Li, Haoliang and Wang, Shiqi and Chen, Changsheng and Kot, Alex C},
journal={IEEE Transactions on Information Forensics and Security},
volume={16},
pages={937--951},
year={2020},
publisher={IEEE}, doi={10.1109/TIFS.2020.3026553}

@ARTICLE{cai2022MP, author={Cai, Rizhao and Li, Zhi and Wan, Renjie and Li, Haoliang and Hu, Yongjian and Kot, Alex C.}, journal={IEEE Transactions on Information Forensics and Security}, title={Learning Meta Pattern for Face Anti-Spoofing}, year={2022}, volume={}, number={}, pages={1-1}, doi={10.1109/TIFS.2022.3158551}} }

@article{li2022one, title={One-Class Knowledge Distillation for Face Presentation Attack Detection}, author={Li, Zhi and Cai, Rizhao and Li, Haoliang and Lam, Kwok-Yan and Hu, Yongjian and Kot, Alex C}, journal={IEEE Transactions on Information Forensics and Security}, year={2022}, publisher={IEEE} }