Plug-and-pipeline: Efficient regularization for single-step adversarial training

Vivek, BS and Revanur, A and Venkat, N and Babu, RV (2020) Plug-and-pipeline: Efficient regularization for single-step adversarial training. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops, CVPRW 2020, 14-19 June 2020, United States, pp. 138-146.

PDF iee_con_com_vis_pat_rec_wor_2020_138-146_2020.pdf - Published Version Restricted to Registered users only Download (464kB) | Request a copy

Abstract

Adversarial Training (AT) is a straight forward solution to learn robust models by augmenting the training mini-batches with adversarial samples. Adversarial attack methods range from simple non-iterative (single-step) methods to computationally complex iterative (multi-step) methods. Although the single-step methods are efficient, the models trained using these methods merely appear to be robust, due to the masked gradients. In this work, we propose a novel regularizer named Plug-And-Pipeline (PAP) for single-step AT. The proposed regularizer attenuates the gradient masking effect by promoting the model to learn similar representations for both single-step and multi-step adversaries. Further, we present a novel pipelined approach that allows an efficient implementation of the proposed regularizer. Plug-And-Pipeline yields robustness comparable to multi-step AT methods, while requiring a low computational overhead, similar to that of single-step AT methods. © 2020 IEEE.

Item Type:	Conference Paper
Publication:	IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops
Publisher:	IEEE Computer Society
Additional Information:	The copyright of this article belongs to IEEE Computer Society
Keywords:	Computer vision; Iterative methods, Attack methods; Computational overheads; Efficient implementation; Non-iterative; Regularizer; Robust models; Single-step; Single-step method, Pipelines
Department/Centre:	Division of Interdisciplinary Sciences > Computational and Data Sciences
Date Deposited:	25 Sep 2020 10:59
Last Modified:	25 Sep 2020 10:59
URI:	http://eprints.iisc.ac.in/id/eprint/66540

Actions (login required)

View Item