Reference. Quantitative Linear Logic for Neuro-Symbolic Learning and Verification
Differentiable Logics are deployed in neuro-symbolic learning tasks as a way of embedding logical constraints in the training objective of neural networks. A differentiable logic consists of a syntax to write logical properties and a semantics to interpret them as real-valued functions to be folded in the loss function. A defining trade-off of the field is that between logical properties of the connectives, and analytic concerns for the semantics, with both aspects being relevant in applications. At one extreme we find fuzzy logics, that have well-established algebraic and proof-theoretic foundations, and at the other ad-hoc differentiable logics like Fischer’s DL2, conceived for deep learning applications. However, no satisfactory foundation has emerged yet. We propose a resolution to this long-standing tension via a novel logic, Quantitative Linear Logic (QLL), with foundational ambitions. Our design is driven by naturality – the idea that, since logical constraints are translated to losses, the semantics of the connectives should be pertinent operations used in ML practice (that is, sum and log-sum-exp) on additive quantities (like logits). We then judge the result on two aspects: logical adequacy – that they satisfy most of the standard logical laws of Linear Logic; and empirical effectiveness – test-time performance (as measured by adversarial attacks) is well-correlated to the actual verification of the logical constraints (as measured by off-the-shelf neural network verifiers), which makes QLL stand out among SoTA techniques.
Cite
Cited by (1)
Adequate Losses via Quantitative Linear Logic capucci-2026-adequate
As neural components are increasingly embedded in existing symbolic software – including safety-critical systems – the question arises of how to specify and enforce the safety of the newly introduced neural parts. Unlike traditional logical specifications, these must be amenable not only to the standard Boolean interpretation, but also to training and optimisation. The latter calls for a quantitative interpretation of the logical syntax, subject to further requirements such as smoothness and differentiability. Moreover, the qualitative and quantitative sides of the logic must share a unifying proof-theoretic and categorical semantics. Finally, the new logic should link cleanly to the substructural and program logics that underpin the verification of existing symbolic programs. In this paper, we present a logic that ticks all of these boxes. We introduce a family of calculi, pQLL, indexed by a hardness degree , prove a cut-elimination theorem for them, and establish completeness with respect to enriched residuated ‘soft’ lattices. At , pQLL reduces to multiplicative additive linear logic (MALL), and provability in pQLL converges to provability in MALL as . We express optimisation objectives in the syntax of this logic and prove the quantitative adequacy of neuro-symbolic loss functions – a result that has eluded the neuro-symbolic machine learning community for nearly a decade.
Cites 56 works (3 here)
With notes (3)
Adequate Losses via Quantitative Linear Logic capucci-2026-adequate
As neural components are increasingly embedded in existing symbolic software – including safety-critical systems – the question arises of how to specify and enforce the safety of the newly introduced neural parts. Unlike traditional logical specifications, these must be amenable not only to the standard Boolean interpretation, but also to training and optimisation. The latter calls for a quantitative interpretation of the logical syntax, subject to further requirements such as smoothness and differentiability. Moreover, the qualitative and quantitative sides of the logic must share a unifying proof-theoretic and categorical semantics. Finally, the new logic should link cleanly to the substructural and program logics that underpin the verification of existing symbolic programs. In this paper, we present a logic that ticks all of these boxes. We introduce a family of calculi, pQLL, indexed by a hardness degree , prove a cut-elimination theorem for them, and establish completeness with respect to enriched residuated ‘soft’ lattices. At , pQLL reduces to multiplicative additive linear logic (MALL), and provability in pQLL converges to provability in MALL as . We express optimisation objectives in the syntax of this logic and prove the quantitative adequacy of neuro-symbolic loss functions – a result that has eluded the neuro-symbolic machine learning community for nearly a decade.
On Quantifiers for Quantitative Reasoning capucci-2024-on
We explore a kind of first-order predicate logic with intended semantics in the reals. Compared to other approaches in the literature, we work predominantly in the multiplicative reals , showing they support three generations of connectives, that we call non-linear, linear additive, and linear multiplicative. Means and harmonic means emerge as natural candidates for bounded existential and universal quantifiers, and in fact we see they behave as expected in relation to the other logical connectives. We explain this fact through the well-known fact that min/max and arithmetic mean/harmonic mean sit at opposite ends of a spectrum, that of p-means. We give syntax and semantics for this quantitative predicate logic, and as example applications, we show how softmax is the quantitative semantics of argmax, and Rényi entropy/Hill numbers are additive/multiplicative semantics of the same formula. Indeed, the additive reals also fit into the story by exploiting the Napierian duality , which highlights a formal distinction between ‘additive’ and ‘multiplicative’ quantities. Finally, we describe two attempts at a categorical semantics via enriched hyperdoctrines. We discuss why hyperdoctrines are in fact probably inadequate for this kind of logic.
Linear logic girard_linear_1987
The familiar connective of negation is broken into two operations: linear negation which is the purely negative part of negation and the modality “of course” which has the meaning of a reaffirmation. Following this basic discovery, a completely new approach to the whole area between constructive logics and programmation is initiated.
External (53)
- The Future Is Neuro-Symbolic: Where Has It Been, and Where Is It Going? (2026)
- A Foundation for Differentiable Logics using Dependent Type Theory (2026)
- GradSTL: Comprehensive Signal Temporal Logic for Neurosymbolic Reasoning and Learning (2025)
- A Probabilistic Neuro-symbolic Layer for Algebraic Constraint Satisfaction (2025)
- Beyond the convexity assumption: Realistic tabular data generation under quantifier-free real linear constraints (2025)
- An algebraic investigation of Linear Logic (2025)
- PyRAT: Verifying Neural Networks with Abstract Interpretation (Competition Contribution) (2025)
- Neural Network Verification with PyRAT (2024)
- Marabou 2.0: A Versatile Formal Analyzer of Neural Networks (2024)
- Vehicle: Bridging the Embedding Gap in the Verification of Neuro-Symbolic Programs (2024)
- Solving olympiad geometry without human demonstrations (2024)
- CCN+: A neuro-symbolic framework for deep learning with requirements (2024)
- Compendium of Neurosymbolic Artificial Intelligence (2023)
- NNV 2.0: The Neural Network Verification Tool (2023)
- Semantic Probabilistic Layers for Neuro-Symbolic Learning (2022)
- Deep Learning with Logical Constraints (2022)
- Neural Network Robustness as a Verification Property: A Principled Case Study (2022)
- Analyzing Differentiable Fuzzy Logic Operators (2022)
- Introduction to Neural Network Verification (2021)
- A Review of Formal Methods applied to Machine Learning (2021)
- Beta-CROWN: Efficient Bound Propagation with Per-neuron Split Constraints for Complete and Incomplete Neural Network Verification (2021)
- Fast and Complete: Enabling Complete Neural Network Verification with Rapid and Massively Parallel Incomplete Verifiers (2020)
- NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systems (2020)
- On Robustness Metrics for Learning STL Tasks (2020)
- Reliable evaluation of adversarial robustness with an ensemble of diverse parameter-free attacks (2020)
- Automatic Perturbation Analysis for Scalable Certified Robustness and Beyond (2020)
- A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability (2020)
- PyTorch: An Imperative Style, High-Performance Deep Learning Library (2019)
- The Marabou Framework for Verification and Analysis of Deep Neural Networks (2019)
- DL2: Training and Querying Neural Networks with Logic (2019)
- Scaling up the Randomized Gradient-Free Adversarial Attack Reveals Overestimation of Robustness Using Established Attacks (2019)
- Algorithms for Verifying Deep Neural Networks (2019)
- Logit Pairing Methods Can Fool Gradient-Based Attacks (2018)
- DeepProbLog: Neural Probabilistic Logic Programming (2018)
- Efficient Neural Network Robustness Certification with General Activation Functions (2018)
- A Semantic Loss Function for Deep Learning with Symbolic Knowledge (2017)
- Decoupled Weight Decay Regularization (2017)
- GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networks (2017)
- Fashion-MNIST: a Novel Image Dataset for Benchmarking Machine Learning Algorithms (2017)
- Towards Deep Learning Models Resistant to Adversarial Attacks (2017)
- Semantic-based regularization for learning and inference (2017)
- Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks (2017)
- Guaranteed Bounds on Information-Theoretic Measures of Univariate Mixtures Using Piecewise Log-Sum-Exp Inequalities (2016)
- Logic Tensor Networks: Deep Learning and Logical Reasoning from Data and Knowledge (2016)
- Intriguing properties of neural networks (2013)
- Handbook of Mathematical Fuzzy Logic, Volume 1 (2011)
- Proof Theory for Fuzzy Logics (2009)
- Residuated lattices: An algebraic glimpse at sub-structural logics (2007)
- Gradient-based learning applied to document recognition (1998)
- Linear logic: its syntax and semantics (1995)
- The Semantics and Proof Theory of Linear Logic (1988)
- Metric spaces, generalized logic, and closed categories (1973)
- Analytic Inequalities (1970)