Felix Juefei Xu     

{ { { Deep Learning } Machine Learning, Computer Vision } AI } Researcher

Ph.D. in Electrical and Computer Engineering, Carnegie Mellon University

M.S. in Machine Learning, Carnegie Mellon University

M.S. in Electrical and Computer Engineering, Carnegie Mellon University

B.S. in Electronic Engineering, Shanghai Jiao Tong University

During his Ph.D. studies in CMU, Felix Juefei Xu (publish under F. Juefei-Xu) was working in a research group specializing in pattern recognition, machine learning, computer vision, and image processing, especially as applied to the field of biometrics, in Carnegie Mellon CyLab Biometrics Center under the supervision of Prof. Marios Savvides.

Email  /  CV  /  Bio  /  Google Scholar  /  Twitter  /  Photo

Research

Deep Learning, Computer Vision, Machine Learning, Adversarial Robustness, Artificial Intelligence.

My current research is focused on a fuller understanding of deep learning where I am actively exploring new methods in deep learning that are statistically efficient and adversarially robust. Through these efforts, I am investigating under what conditions deep learning starts to work and under what conditions deep learning starts to fail. My Ph.D. work is primarily focused on tackling the Pose, Expression, Resolution, Illumination, and Occlusion (Perio) challenges for unconstrained periocular face recognition using both shallow and deep discriminative and generative methods, especially under the dome of self-supervised predictive learning. I also have broader interests in pattern recognition, computer vision, machine learning, optimization, statistics, compressive sensing, and image processing.

I am the recipient of multiple best/distinguished paper awards, including the Best Poster Paper Award of the IEEE/IAPR International Joint Conference on Biometrics (IJCB) in 2011, the Best Paper Award of the IEEE Seventh International Conference on Biometrics: Theory, Applications and Systems (BTAS) in 2015, the Best Student Paper Award of the IEEE Eighth International Conference on Biometrics: Theory, Applications and Systems (BTAS) in 2016, the ACM SIGSOFT Distinguished Paper Award of the IEEE/ACM International Conference on Automated Software Engineering (ASE) in 2018, and the Best Student Paper Award of the 14th Asian Conference on Computer Vision (ACCV) in 2018.

Research Highlights & Preprints
prl

Watch out! Motion is Blurring the Vision of Your Deep Neural Networks
Qing Guo, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Jian Wang, Bing Yu, Wei Feng, Yang Liu
Advances in Neural Information Processing Systems (NeurIPS), 2020
arxiv / bibtex / code / proceedings


We newly identify an attacking method termed motion-based adversarial blur attack (ABBA) that can generate visually natural motion-blurred adversarial examples.

prl

SPARK: Spatial-Aware Online Incremental Attack Against Visual Tracking
Qing Guo*, Xiaofei Xie*, Felix Juefei-Xu, Lei Ma, Zhongguo Li, Wanli Xue, Wei Feng, Yang Liu
European Conference on Computer Vision (ECCV), 2020
arxiv / bibtex / proceedings


We propose a novel adversarial attack on visual tracking: online generating imperceptible perturbations that mislead trackers along an incorrect (untargeted attack) or specified trajectory (targeted attack).

prl

Amora: Black-box Adversarial Morphing Attack
Run Wang, Felix Juefei-Xu, Qing Guo, Yihao Huang, Xiaofei Xie, Lei Ma, Yang Liu
ACM International Conference on Multimedia (ACM MM), 2020
[Oral Presentation]
arxiv / bibtex / proceedings


In contrast to adversarial noise attack that perturbs pixel intensity values by adding human-imperceptible noise, our proposed adversarial morphing attack is a semantic attack that perturbs pixels spatially in a coherent manner.

prl

FakePolisher: Making DeepFakes More Detection-Evasive by Shallow Reconstruction
Yihao Huang, Felix Juefei-Xu, Run Wang, Qing Guo, Lei Ma, Xiaofei Xie, Jianwei Li, Weikai Miao, Yang Liu, Geguang Pu
ACM International Conference on Multimedia (ACM MM), 2020
[Oral Presentation]
arxiv / bibtex / proceedings


We have successfully shown that simple shallow reconstruction can very effectively reduce the artifacts introduced during DeepFake image synthesis, making it more detection-evasive.

prl

DeepSonar: Towards Effective and Robust Detection of AI-Synthesized Fake Voices
Run Wang, Felix Juefei-Xu, Yihao Huang, Qing Guo, Xiaofei Xie, Lei Ma, Yang Liu
ACM International Conference on Multimedia (ACM MM), 2020
[Oral Presentation]
arxiv / bibtex / proceedings


This is the first attempt to robustly detect AI-synthesized fake voices based on monitoring neural behaviors.

prl

DeepRhythm: Exposing DeepFakes with Attentional Visual Heartbeat Rhythms
Hua Qi*, Qing Guo*, Felix Juefei-Xu, Xiaofei Xie, Lei Ma, Wei Feng, Yang Liu, Jianjun Zhao
ACM International Conference on Multimedia (ACM MM), 2020
arxiv / bibtex / proceedings


This is the first attempt to robustly detect DeepFakes based on monitoring remote visual photoplethysmography (PPG) signals with the aid of dual-spatial-temporal attention mechanism.

prl

Pasadena: Perceptually Aware and Stealthy Adversarial Denoise Attack
Yupeng Cheng*, Qing Guo*, Felix Juefei-Xu, Xiaofei Xie, Shang-Wei Lin, Weisi Lin, Wei Feng, Yang Liu
arXiv Preprint, 2020
arxiv / bibtex


We investigate a new task, adversarial denoise attack, that stealthily embeds the attacks inside the image denoising operation.

prl

FakeLocator: Robust Localization of GAN-Based Face Manipulations
Yihao Huang, Felix Juefei-Xu, Run Wang, Qing Guo, Xiaofei Xie, Lei Ma, Jianwen Li, Weikai Miao, Yang Liu, Geguang Pu
arXiv Preprint, 2020
arxiv / bibtex


This is the very first attempt to robustly solve the GAN-based fake localization problem with a semantic segmentation map.

prl

FakeSpotter: A Simple yet Robust Baseline for Spotting AI-Synthesized Fake Faces
Run Wang, Felix Juefei-Xu, Lei Ma, Xiaofei Xie, Yihao Huang, Jian Wang, Yang Liu
International Joint Conference on Artificial Intelligence (IJCAI), 2020
arxiv / bibtex / proceedings

Media Coverage: Synced Review


Monitoring neuron behavior can serve as an asset in detecting AI-synthesized fake faces since layer-by-layer neuron activation patterns may capture more subtle features that are important for the fake detector.

prl

DeepHunter: A Coverage-Guided Fuzz Testing Framework for Deep Neural Networks
Xiaofei Xie, Lei Ma, Felix Juefei-Xu, Minhui Xue, Hongxu Chen, Yang Liu, Jianjun Zhao, Bo Li, Jianxiong Yin, Simon See
ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA), 2019
arxiv / bibtex / proceedings


An automated fuzz testing framework for hunting potential defects of general-purpose DNNs. It performs metamorphic mutation to generate new semantically preserved tests, and leverages multiple plugable coverage criteria as feedback to guide the test generation.

prl

SSR2: Sparse Signal Recovery for Single-Image Super-Resolution on Faces with Extreme Low Resolutions
Ramzi Abiantun*, Felix Juefei-Xu*, Utsav Prabhu, Marios Savvides
Pattern Recognition, 2019
bibtex / proceedings


Extreme low-resolution face super-resolution based on traditional methods and its application to a real-world scenario.

prl

Secure Deep Learning Engineering: A Software Quality Assurance Perspective
Lei Ma, Felix Juefei-Xu, Minhui Xue, Qiang Hu, Sen Chen, Bo Li, Yang Liu, Jianjun Zhao, Jianxiong Yin, Simon See
arXiv Preprint, 2018
arxiv / bibtex


From a software quality assurance perspective, this work pinpoints challenges and future opportunities towards universal secure deep learning engineering.

prl

RankGAN: A Maximum Margin Ranking GAN for Generating Faces
Felix Juefei-Xu*, Rahul Dey*, Vishnu Naresh Boddeti, Marios Savvides
Asian Conference on Computer Vision (ACCV), 2018
[Oral Presentation][Best Student Paper Award]
arxiv / supplementary / bibtex


Progressive training of multiple GAN stages with maximum margin ranking loss for generating faces with improved fidelity.

prl

Metamorphic Relation Based Adversarial Attacks on Differentiable Neural Computer
Alvin Chan, Lei Ma, Felix Juefei-Xu, Xiaofei Xie, Yang Liu, Yew Soon Ong
arXiv Preprint, 2018
arxiv / bibtex


First adversarial attack on differentiable neural computer.

prl

DeepCT: Tomographic Combinatorial Testing for Deep Learning Systems
Lei Ma, Felix Juefei-Xu, Minhui Xue, Bo Li, Li Li, Yang Liu, Jianjun Zhao
IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), 2019
bibtex


A set of combinatorial testing criteria specialized for deep learning systems, as well as a combinatorial testing coverage guided test generation technique.

DeepMutation: Mutation Testing of Deep Learning Systems
Lei Ma, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Felix Juefei-Xu, Chao Xie, Li Li, Yang Liu, Jianjun Zhao, Yadong Wang
IEEE International Symposium on Software Reliability Engineering (ISSRE), 2018
arxiv / bibtex


A mutation testing framework specialized for deep learning systems to measure the quality of test data.

DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, Jianjun Zhao, Yadong Wang
ACM/IEEE International Conference on Automated Software Engineering (ASE), 2018
[Oral Presentation][ACM SIGSOFT Distinguished Paper Award]
arxiv / bibtex


A set of multi-granularity testing criteria for deep learning systems, which aims at rendering a multi-faceted portrayal of the testbed.

prl

Perturbative Neural Networks
Felix Juefei-Xu, Vishnu Naresh Boddeti, Marios Savvides
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
arxiv / project / bibtex


The new perturbation layer does away with convolution in the traditional sense and instead computes its response as a weighted linear combination of non-linearly activated additive noise perturbed inputs.

prl

Local Binary Convolutional Neural Networks
Felix Juefei-Xu, Vishnu Naresh Boddeti, Marios Savvides
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
[Spotlight Oral Presentation]
arxiv / project / bibtex


Convolutional neural network architecture with fixed randomized sparse binary convolutional kernels.

prl

Gang of GANs: Generative Adversarial Networks with Maximum Margin Ranking
Felix Juefei-Xu, Vishnu Naresh Boddeti, Marios Savvides
arXiv Preprint, 2017
arxiv / project / bibtex


A progressive training paradigm involving multiple GANs to contribute to the maximum margin ranking loss so that the GAN at later stages will improve upon early stages.

Dissertation

Unconstrained Periocular Face Recognition: From Reconstructive Dictionary Learning to Generative Deep Learning and Beyond
Felix Juefei-Xu
Advisor: Marios Savvides
Ph.D. Dissertation, Carnegie Mellon University, 2018
bibtex

Selected Publications [Google Scholar]
prl

DeepHunter: A Coverage-Guided Fuzz Testing Framework for Deep Neural Networks
Xiaofei Xie, Lei Ma, Felix Juefei-Xu, Minhui Xue, Hongxu Chen, Yang Liu, Jianjun Zhao, Bo Li, Jianxiong Yin, Simon See
ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA), 2019
bibtex

prl

SSR2: Sparse Signal Recovery for Single-Image Super-Resolution on Faces with Extreme Low Resolutions
Ramzi Abiantun*, Felix Juefei-Xu*, Utsav Prabhu, Marios Savvides
Pattern Recognition, 2019
bibtex

prl

Secure Deep Learning Engineering: A Software Quality Assurance Perspective
Lei Ma, Felix Juefei-Xu, Minhui Xue, Qiang Hu, Sen Chen, Bo Li, Yang Liu, Jianjun Zhao, Jianxiong Yin, Simon See
arXiv Preprint, 2018
arxiv / bibtex

prl

RankGAN: A Maximum Margin Ranking GAN for Generating Faces
Felix Juefei-Xu*, Rahul Dey*, Vishnu Naresh Boddeti, Marios Savvides
Asian Conference on Computer Vision (ACCV), 2018
[Oral Presentation][Best Student Paper Award]
arxiv / supplementary / bibtex

prl

Metamorphic Relation Based Adversarial Attacks on Differentiable Neural Computer
Alvin Chan, Lei Ma, Felix Juefei-Xu, Xiaofei Xie, Yang Liu, Yew Soon Ong
arXiv Preprint, 2018
arxiv / bibtex

prl

DeepCT: Tomographic Combinatorial Testing for Deep Learning Systems
Lei Ma, Felix Juefei-Xu, Minhui Xue, Bo Li, Li Li, Yang Liu, Jianjun Zhao
IEEE International Conference on Software Analysis, Evolution and Reengineering (SANER), 2019
draft / bibtex

DeepMutation: Mutation Testing of Deep Learning Systems
Lei Ma, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Felix Juefei-Xu, Chao Xie, Li Li, Yang Liu, Jianjun Zhao, Yadong Wang
IEEE International Symposium on Software Reliability Engineering (ISSRE), 2018
arxiv / bibtex

DeepGauge: Multi-Granularity Testing Criteria for Deep Learning Systems
Lei Ma, Felix Juefei-Xu, Fuyuan Zhang, Jiyuan Sun, Minhui Xue, Bo Li, Chunyang Chen, Ting Su, Li Li, Yang Liu, Jianjun Zhao, Yadong Wang
ACM/IEEE International Conference on Automated Software Engineering (ASE), 2018
[Oral Presentation][ACM SIGSOFT Distinguished Paper Award]
arxiv / bibtex

prl

Perturbative Neural Networks
Felix Juefei-Xu, Vishnu Naresh Boddeti, Marios Savvides
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2018
arxiv / project / bibtex

prl

Local Binary Convolutional Neural Networks
Felix Juefei-Xu, Vishnu Naresh Boddeti, Marios Savvides
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017
[Spotlight Oral Presentation]
arxiv / project / bibtex

DeepGender2: A Generative Approach Toward Occlusion and Low Resolution Robust Facial Gender Classification via Progressively Trained Attention Shift Convolutional Neural Networks (PTAS-CNN) and Deep Convolutional Generative Adversarial Networks (DCGAN)
Felix Juefei-Xu, Eshan Verma, Marios Savvides
Book Chapter, Deep Learning for Biometrics, Springer, 2017
bibtex

Learning to Invert Local Binary Patterns
Felix Juefei-Xu, Marios Savvides
British Machine Vision Conference (BMVC), 2016
bibtex

Fastfood Dictionary Learning for Periocular-Based Full Face Hallucination
Felix Juefei-Xu, Marios Savvides
IEEE 8th International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2016
[Oral Presentation][Best Student Paper Award]
bibtex

Simultaneous Forgery Identification and Localization in Paintings Using Advanced Correlation Filters
Paul Buchana*, Irina Cazan*, Manuel Diaz-Granados*, Felix Juefei-Xu, Marios Savvides
IEEE International Conference on Image Processing (ICIP), 2016
[Oral Presentation]
bibtex

Discriminative Invariant Kernel Features: A Bells-and-Whistles-Free Approach to Unsupervised Face Recognition and Pose Estimation
Dipan K. Pal, Felix Juefei-Xu, Marios Savvides
IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
[Spotlight Oral Presentation]
slides / poster / bibtex

DeepGender: Occlusion and Low Resolution Robust Facial Gender Classification via Progressively Trained Convolutional Neural Networks with Attention
Felix Juefei-Xu*, Eshan Verma*, Parag Goel, Anisha Cherodian, Marios Savvides
Biometrics Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016
[Oral Presentation]
slides / poster / bibtex

Multi-class Fukunaga Koontz Discriminant Analysis for Enhanced Face Recognition
Felix Juefei-Xu, Marios Savvides
Pattern Recognition, 2016
bibtex

Spartans: Single-sample Periocular-based Alignment-robust Recognition Technique Applied to Non-frontal Scenarios
Felix Juefei-Xu, Khoa Luu, Marios Savvides
IEEE Transactions on Image Processing (TIP), 2015
bibtex

Pokerface: Partial Order Keeping and Energy Repressing Method for Extreme Face Illumination Normalization
Felix Juefei-Xu, Marios Savvides
IEEE 7th International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2015
[Oral Presentation][Best Paper Award]
slides / bibtex

Investigating the Feasibility of Image-Based Nose Biometrics
Niv Zehngut, Felix Juefei-Xu, Rishabh Bardia, Dipan K. Pal, Chandrasekhar Bhagavatula, Marios Savvides
IEEE International Conference on Image Processing (ICIP), 2015
[Oral Presentation]
bibtex

NIR-VIS Heterogeneous Face Recognition via Cross-Spectral Joint Dictionary Learning and Reconstruction
Felix Juefei-Xu, Dipan K. Pal, Marios Savvides
Perception Beyond the Visual Spectrum (PBVS) Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
bibtex

Driver Cell Phone Usage Detection on Strategic Highway Research Program (SHRP2) Face View Videos
Keshav Seshadri, Felix Juefei-Xu, Dipan K. Pal, Marios Savvides
Computer Vision in Vehicle Technology (CVVT) Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
bibtex

Electromyograph and Keystroke Dynamics for Spoof-Resistant Biometric Authentication
Shreyas Venugopalan*, Felix Juefei-Xu*, Benjamin Cowley, Marios Savvides
Biometrics Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
bibtex

A Preliminary Investigation on the Sensitivity of COTS Face Recognition Systems to Forensic Analyst-style Face Processing for Occlusions
Felix Juefei-Xu*, Dipan K. Pal*, Karanhaar Singh*, Marios Savvides
Biometrics Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015
bibtex

Hallucinating the Full Face from the Periocular Region via Dimensionally Weighted K-SVD
Felix Juefei-Xu, Dipan K. Pal, Marios Savvides
Biometrics Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014
bibtex

Subspace Based Discrete Transform Encoded Local Binary Patterns Representations for Robust Periocular Matching on NIST's Face Recognition Grand Challenge
Felix Juefei-Xu, Marios Savvides
IEEE Transactions on Image Processing (TIP), 2014
bibtex

An Image Statistics Approach towards Efficient and Robust Refinement for Landmarks on Facial Boundary
Felix Juefei-Xu, Marios Savvides
IEEE 6th International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2013
bibtex

An Augmented Linear Discriminant Analysis Approach for Identifying Identical Twins with the Aid of Facial Asymmetry Features
Felix Juefei-Xu, Marios Savvides
Biometrics Workshop, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013
bibtex

Gait-ID on the Move: Pace Independent Human Identification Using Cell Phone Accelerometer Dynamics
Felix Juefei-Xu, Chandrasekhar Bhagavatula, Aaron Jaech, Unni Prasad, Marios Savvides
IEEE 5th International Conference on Biometrics: Theory, Applications and Systems (BTAS), 2012
[Oral Presentation]
bibtex

Unconstrained Periocular Biometric Acquisition and Recognition Using COTS PTZ Camera for Uncooperative and Non-Cooperative Subjects
Felix Juefei-Xu, Marios Savvides
IEEE Workshop on the Applications of Computer Vision (WACV), 2012
bibtex

Investigating Age Invariant Face Recognition Based on Periocular Biometrics
Felix Juefei-Xu*, Khoa Luu*, Marios Savvides, Tien Bui, Ching Y. Suen
IEEE/IAPR International Joint Conference on Biometrics (IJCB), 2011
[Best Poster Paper Award]
bibtex

Miscellaneous
 
 

I like this page :-)