Canonical Saliency Maps: Decoding Deep Face Models

John, Thrupthi Ann and Balasubramanian, Vineeth N and Jawahar, C. V. (2021) Canonical Saliency Maps: Decoding Deep Face Models. IEEE Transactions on Biometrics, Behavior, and Identity Science, 3 (4). pp. 561-572. ISSN 2637-6407

[img] Text
IEEE_Transactions.pdf - Published Version
Available under License Creative Commons Attribution.

Download (10MB)


As Deep Neural Network models for face processing tasks approach human-like performance, their deployment in critical applications such as law enforcement and access control has seen an upswing, where any failure may have far-reaching consequences. We need methods to build trust in deployed systems by making their working as transparent as possible. Existing visualization algorithms are designed for object recognition and do not give insightful results when applied' to the face domain. In this work, we present 'Canonical Saliency Maps', a new method which highlights relevant facial areas by projecting saliency maps onto a canonical face model. We present two kinds of Canonical Saliency Maps: image-level maps and model-level maps. Image-level maps highlight facial features responsible for the decision made by a deep face model on a given image, thus helping to understand how a DNN made a prediction on the image. Model-level maps provide an understanding of what the entire DNN model focuses on in each task, and thus can be used to detect biases in the model. Our qualitative and quantitative results show the usefulness of the proposed canonical saliency maps, which can be used on any deep face model regardless of the architecture. © 2019 IEEE.

[error in script]
IITH Creators:
IITH CreatorsORCiD
Balasubramanian, Vineeth N
Item Type: Article
Uncontrolled Keywords: canonical model; Deep neural networks; explainability/accountability/transparency; face understanding
Subjects: Computer science
Divisions: Department of Computer Science & Engineering
Depositing User: . LibTrainee 2021
Date Deposited: 08 Aug 2022 07:26
Last Modified: 08 Aug 2022 07:26
Publisher URL:
OA policy:
Related URLs:

Actions (login required)

View Item View Item
Statistics for RAIITH ePrint 10142 Statistics for this ePrint Item