taoArchitecturePreservingProvableRepair2023:
  type: article
  title: Architecture-{Preserving Provable Repair} of {Deep Neural Networks}
  author:
  - Tao, Zhe
  - Nawas, Stephanie
  - Mitchell, Jacqueline
  - Thakur, Aditya V.
  date: 2023-06-06
  page-range: 443-467
  url:
    value: https://dl.acm.org/doi/10.1145/3591238
    date: 2023-11-27
  serial-number:
    doi: 10.1145/3591238
    issn: 2475-1421
  language: en-US
  abstract: 'Deep neural networks (DNNs) are becoming increasingly important components of software, and are considered the state-of-the-art solution for a number of problems, such as image recognition. However, DNNs are far from infallible, and incorrect behavior of DNNs can have disastrous real-world consequences. This paper addresses the problem of architecture-preserving V-polytope provable repair of DNNs. A V-polytope defines a convex bounded polytope using its vertex representation. V-polytope provable repair guarantees that the repaired DNN satisfies the given specification on the infinite set of points in the given V-polytope. An architecture-preserving repair only modifies the parameters of the DNN, without modifying its architecture. The repair has the flexibility to modify multiple layers of the DNN, and runs in polynomial time. It supports DNNs with activation functions that have some linear pieces, as well as fully-connected, convolutional, pooling and residual layers. To the best our knowledge, this is the first provable repair approach that has all of these features. We implement our approach in a tool called APRNN. Using MNIST, ImageNet, and ACAS Xu DNNs, we show that it has better efficiency, scalability, and generalization compared to PRDNN and REASSURE, prior provable repair methods that are not architecture preserving. CCS Concepts: • Computing methodologies → Neural networks; • Theory of computation → Linear programming; • Software and its engineering → Software post-development issues.'
  parent:
    type: periodical
    title: Proceedings of the ACM on Programming Languages
    issue: PLDI
    volume: 7