Are Deep Neural Networks "Robust"?

Separating outliers from inliers is the definition of robustness in computer vision. This essay delineates how deep neural networks are different than typical robust estimators. Deep neural networks not robust by this traditional definition.

cs.LG cs.CV Anomaly Detection Techniques and Applications Adversarial Robustness in Machine Learning Neural Networks and Applications Computer Science

View graph Source

Paper

References (13)

01A New Approach to Robust Estimation of Parametric StructuresXiang Yang, P. Meer, J. Meer2020 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 7 citations

02Neural-Guided RANSAC: Learning Where to Sample Model HypothesesEric Brachmann, C. Rother2019 · IEEE International Conference on Computer Vision · 288 citations In Library

03Is Robustness the Cost of Accuracy? - A Comprehensive Study on the Robustness of 18 Deep Image Classification ModelsD. Su, Huan Zhang, Hongge Chen et al.2018 · European Conference on Computer Vision · 421 citations In Library

04Deep Hierarchies in the Primate Visual Cortex: What Can We Learn for Computer Vision?N. Krüger, P. Janssen, Sinan Kalkan et al.2013 · IEEE Transactions on Pattern Analysis and Machine Intelligence · 389 citations

05The Changing History of RobustnessS. Stigler2010 · 68 citations

06A survey of robust statisticsS. Morgenthaler2007 · Stat. Methods Appl. · 74 citations

07A History of Parametric Statistical Inference from Bernoulli to Fisher, 1713-1935A. Hald2006 · 105 citations

08The History of Statistics: The Measurement of Uncertainty before 1900D. MacKenzie, S. Stigler1988 · 1.2k citations

09The History of Statistics: The Measurement of Uncertainty before 1900S. Stigler1986 · 20 citations

10Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartographyM. Fischler, R. Bolles1981 · CACM · 30k citations

11Will computers ever think like human beings?2020

12On robust estimation of the location parameterF. Forst1980 · 7.2k citations

Scroll for more · 1 remaining

Similar papers

How Robust are Deep Neural Networks?Biswa Sengupta, Karl Friston2018 · arXiv (Cornell University) · 38 citations In Library

Structural Robustness for Deep Learning ArchitecturesC. Lassance, Vincent Gripon, Jian Tang et al.2019 · Data Science Workshop · 3 citations In Library

A Survey of Neural Network Robustness Assessment in Image RecognitionJie Wang, Jun Ai, Minyan Lu et al.2026 · ACM Computing Surveys In Library

A Survey of Neural Network Robustness Assessment in Image RecognitionJie Wang, Jun Ai, Minyan Lu et al.2024 · ACM Computing Surveys · 7 citations In Library

The Robustness of Deep Networks: A Geometrical PerspectiveAlhussein Fawzi, Seyed-Mohsen Moosavi-Dezfooli, Pascal Frossard2017 · IEEE Signal Processing Magazine In Library

Non-adversarial Robustness of Deep Learning Methods for Computer VisionGorana Gojić, Vladimir Vincan, Ognjen Kundačina et al.2023 In Library

Non-adversarial Robustness of Deep Learning Methods for Computer VisionGorana Gojić, Vladimir Vincan, Ognjen Kundačina et al.2023 · arXiv (Cornell University) · 12 citations In Library

Not So Robust After All: Evaluating the Robustness of Deep Neural Networks to Unseen Adversarial AttacksRoman Garaev, Bader Rasheed, Adil H. Khan2023 · arXiv (Cornell University) · 4 citations In Library

Fast Robustness Prediction for Deep Neural NetworkYue-Huan Wang, Zenan Li, Jingwei Xu et al.2019 · Asia-Pacific Symposium on Internetware · 3 citations In Library

Understanding Local Robustness of Deep Neural Networks under Natural VariationsZiyuan Zhong, Yuchi Tian, Baishakhi Ray2021 · Lecture notes in computer science · 25 citations In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal