Testing and verification of neural-network-based safety-critical control software: A systematic literature review

Context: Neural Network (NN) algorithms have been successfully adopted in a number of Safety-Critical Cyber-Physical Systems (SCCPSs). Testing and Verification (TV no reviewed study focused on precisely defined testing configuration or on defense against common cause failure.

cs.LG cs.SE eess.SY Computer Science Engineering Mathematics

View graph Source

Paper

References (100)

01Continuous IntegrationJ. Taylor, Wayne T. Taylor2021 · Patterns in the Machine · 387 citations

02ValidationF. Grove2020 · The International Encyclopedia of Media Psychology · 605 citations

03LEMNA: Explaining Deep Learning based Security ApplicationsWenbo Guo, Dongliang Mu, Jun Xu et al.2018 · Conference on Computer and Communications Security · 351 citations

04DeepSafe: A Data-Driven Approach for Assessing Robustness of Neural NetworksD. Gopinath, Guy Katz, C. Păsăreanu et al.2018 · Automated Technology for Verification and Analysis · 101 citations

05Learning Global Additive Explanations for Neural Nets Using Model DistillationS. Tan, R. Caruana, G. Hooker et al.2018 · 112 citations

06"Boxing Clever": Practical Techniques for Gaining Insights into Training Data and Monitoring Distribution ShiftRob Ashmore, Matthew Hill2018 · SAFECOMP Workshops · 13 citations

07Peeking Inside the Black-Box: A Survey on Explainable Artificial Intelligence (XAI)Amina Adadi, M. Berrada2018 · IEEE Access · 5.2k citations

08DeepRoad: GAN-Based Metamorphic Testing and Input Validation Framework for Autonomous Driving SystemsMengshi Zhang, Yuqun Zhang, Lingming Zhang et al.2018 · International Conference on Automated Software Engineering · 650 citations

09DLFuzz: differential fuzzing testing of deep learning systemsJianmin Guo, Yu Jiang, Yue Zhao et al.2018 · ESEC/SIGSOFT FSE · 319 citations In Library

10Software Engineering Challenges of Deep LearningAnders Arpteg, B. Brinne, L. Crnkovic-Friis et al.2018 · EUROMICRO Conference on Software Engineering and Advanced Applications · 194 citations In Library

11Experimental Resilience Assessment of an Open-Source Driving AgentA. Rubaiyat, Yongming Qin, H. Alemzadeh2018 · Pacific Rim International Symposium on Dependable Computing · 47 citations In Library

12A Game-Based Approximate Verification of Deep Neural Networks with Provable GuaranteesMin Wu, Matthew Wicker, Wenjie Ruan et al.2018 · Theoretical Computer Science · 118 citations In Library

Scroll for more · 38 remaining

Similar papers

Testing and verification of neural-network-based safety-critical control software: A systematic literature reviewJin Zhang, Jingyue Li2020 · Information and Software Technology In Library

Neural Network Verification in ControlMichael Everett2021 · 2021 60th IEEE Conference on Decision and Control (CDC) In Library

Neural Network Verification in ControlM. Everett2021 · IEEE Conference on Decision and Control · 23 citations In Library

Tutorial: Neural Network and Autonomous Cyber-Physical Systems Formal Verification for Trustworthy AI and Safe AutonomyHoang-Dung Tran, Diego Manzanas Lopez, Taylor T. Johnson2023 · International Conference on Embedded Software · 1 citation In Library

Tutorial: Safe, Secure, and Trustworthy Artificial Intelligence (AI) via Formal Verification of Neural Networks and Autonomous Cyber-Physical Systems (CPS) with NNVTaylor T. Johnson, Diego Manzanas Lopez, Hoang-Dung Tran2024 · 2024 54th Annual IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S) · 1 citation In Library

Reachability Analysis of Neural Network Control SystemsChi Zhang, Wenjie Ruan, Peipei Xu2023 · Proceedings of the AAAI Conference on Artificial Intelligence In Library

Reachability Analysis of Neural Network Control SystemsChi Zhang, Wenjie Ruan, Peipei Xu2023 · arXiv (Cornell University) · 24 citations In Library

Challenges in Using Neural Networks in Safety-Critical ApplicationsHåkan Forsberg, Joakim Lindén, Johan Hjorth et al.2020 · Symposium on Dependable Autonomic and Secure Computing · 22 citations In Library

Verification of Neural Networks for Safety Critical ApplicationsKhaled Ben Khalifa, Mona Safar, M. Watheq El‐Kharashi2020 · International Congress of Mathematicans · 2 citations In Library

NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical SystemsHoang-Dung Tran, Xiaodong Yang, Diego Manzanas Lopez et al.2020 · arXiv (Cornell University) · 287 citations In Library

Source of record

arXiv

44B

Welcome.

This panel sticks with you. Pick anything below and it opens right beside it, so you can dig through 60,000-plus records without ever losing your spot here.

Travel 44B

LibraryPapers, policy, standards, statute LabsEvery organization building AI ModelsIntelligence, price, and speed BenchmarksThe evaluation catalog IncidentsAI failures and harms SearchOne field across everything DashboardThe state of AI accountability in NY 44B RegistryThe Art. 44-B compliance portal