Reference. A Bayesian Interpretation of the Internal Model Principle
The internal model principle, originally proposed in the theory of control of linear systems, nowadays represents a more general class of results in control theory and cybernetics. The central claim of these results is that, under suitable assumptions, if a system (a controller) can regulate against a class of external inputs (from the environment), it is because the system contains a model of the system causing these inputs, which can be used to generate signals counteracting them. Similar claims on the role of internal models appear also in cognitive science, especially in modern Bayesian treatments of cognitive agents, often suggesting that a system (a human subject, or some other agent) models its environment to adapt against disturbances and perform goal-directed behaviour. It is however unclear whether the Bayesian internal models discussed in cognitive science bear any formal relation to the internal models invoked in standard treatments of control theory. Here, we first review the internal model principle and present a precise formulation of it using concepts inspired by categorical systems theory. This leads to a formal definition of “model” generalising its use in the internal model principle. Although this notion of model is not a priori related to the notion of Bayesian reasoning, we show that it can be seen as a special case of possibilistic Bayesian filtering. This result is based on a recent line of work formalising, using Markov categories, a notion of “interpretation”, describing when a system can be interpreted as performing Bayesian filtering on an outside world in a consistent way.
Cite
Cited by (1)
A “good regulator theorem” for embodied agents virgo-2025-a
In a classic paper, Conant and Ashby claimed that “every good regulator of a system must be a model of that system.” Artificial Life has produced many examples of systems that perform tasks with apparently no model in sight; these suggest Conant and Ashby’s theorem doesn’t easily generalise beyond its restricted setup. Nevertheless, here we show that a similar intuition can be fleshed out in a different way: whenever an agent is able to perform a regulation task, it is possible for an observer to interpret it as having “beliefs” about its environment, which it “updates” in response to sensory input. This notion of belief updating provides a notion of model that is more sophisticated than Conant and Ashby’s, as well as a theorem that is more broadly applicable. However, it necessitates a change in perspective, in that the observer plays an essential role in the theory: models are not a mere property of the system but are imposed on it from outside. Our theorem holds regardless of whether the system is regulating its environment in a classic control theory setup, or whether it’s regulating its own internal state; the model is of its environment either way. The model might be trivial, however, and this is how the apparent counterexamples are resolved.
Cites 67 works (2 here)
With notes (2)
Towards Foundations of Categorical Cybernetics capucci-2022-towards
Finite Automata and Their Decision Problems rabinFiniteAutomataTheir1959
Finite automata are considered in this paper as instruments for classifying finite tapes. Each onetape automaton defines a set of tapes, a two-tape automaton defines a set of pairs of tapes, et cetera. The structure of the defined sets is studied. Various generalizations of the notion of an automaton are introduced and their relation to the classical automata is determined. Some decision problems concerning automata are shown to be solvable by effective algorithms; others turn out to be unsolvable by algorithms.
External (65)
- A triviality worry for the internal model principle (2024)
- Probabilistic Programming with Exact Conditions (2024)
- Hidden Markov Models and the Bayes Filter in Categorical Probability (2024)
- World models and predictive coding for cognitive and developmental robotics: frontiers and challenges (2023)
- Unifilar Machines and the Adjoint Structure of Bayesian Models (2023)
- Categorical systems theory (book draft) (2023)
- Markov Categories and Entropy (2022)
- Interpreting systems as solving POMDPs: a step towards a formal understanding of agency (2022)
- Three aspects of representation in neuroscience (2022)
- The d-separation criterion in Categorical Probability (2022)
- DayDreamer: World Models for Physical Robot Learning (2022)
- Interpreting Dynamical Systems as Bayesian Reasoners (2021)
- Internal Models in Control, Bioengineering, and Neuroscience (2021)
- Entropy, Information, and the Updating of Probabilities (2021)
- Perfect adaptation in biology (2021)
- Double Categories of Open Dynamical Systems (Extended Abstract) (2020)
- Dynamical Systems Coupled with Monotone Set-Valued Operators: Formalisms, Applications, Well-Posedness, and Stability (2020)
- Artificial Intelligence A Modern Approach 3rd Edition (2020)
- A synthetic approach to Markov kernels, conditional independence, and theorems on sufficient statistics (2019)
- Internal Models in Biological Control (2019)
- Embedded Agency (2019)
- Supervisory Control of Discrete-Event Systems (2019)
- Internal Models in Control, Biology and Neuroscience (2018)
- World Models (2018)
- Disintegration and Bayesian inversion via string diagrams (2017)
- A channel-based perspective on conjugate priors (2017)
- Picturing Quantum Processes: A First Course in Quantum Theory and Diagrammatic Reasoning (2017)
- Model predictive control: theory, computation, and design (2017)
- Well-Posedness and Output Regulation for Implicit Time-Varying Evolution Variational Inequalities (2016)
- Antithetic Integral Feedback Ensures Robust Perfect Adaptation in Noisy Biomolecular Networks (2016)
- A mathematical theory of resources (2014)
- “The Cybernetic Bayesian Brain,” (2014)
- When does a physical system compute? (2013)
- Viability Theory: New Directions (2011)
- Representing uncertainty on set-valued variables using belief functions (2010)
- Physics, Topology, Logic and Computation: A Rosetta Stone (2010)
- A Survey of Graphical Languages for Monoidal Categories (2009)
- The multiscale coarse-graining method. I. A rigorous bridge between atomistic and coarse-grained models (2008)
- Control of mental activities by internal models in the cerebellum (2008)
- Optimal control theory (2006)
- FINITE MARKOV CHAINS (2005)
- Limit sets, zero dynamics, and internal models in the problem of nonlinear output regulation (2003)
- Adaptation and regulation with signal detection implies internal model (2003)
- State aggregation in Markov decision processes (2002)
- Robust perfect adaptation in bacterial chemotaxis through integral feedback control (2000)
- Internal models for motor control and trajectory planning (1999)
- Perception as Bayesian Inference (1996)
- A dynamical systems perspective on agent-environment interaction (1996)
- What Might Cognition Be, If Not Computation? (1995)
- The hierarchical lattices of a finite machine (1995)
- Handbook of Categorical Algebra: Volume 2, Categories and Structures (1994)
- Untimed and Misrepresented: Connectionism and the Computer Metaphor Untimed and Misrepresented: Connectionism and the Computer Metaphor (1992)
- Requisite Variety and Its Implications for the Control of Complex Systems (1991)
- Output regulation of nonlinear systems (1990)
- Competitive Learning: From Interactive Activation to Adaptive Resonance (1987)
- Structurally stable nonlinear regulation with step inputs (1984)
- Error feedback and internal models on differentiable manifolds (1984)
- The Internal Model Principle of Regulator Theory on Differentiable Manifolds (1981)
- Nonlinear decoupling via feedback: A differential geometric approach (1981)
- Principal component analysis in linear systems: Controllability, observability, and model reduction (1981)
- Towards an abstract internal model principle (1976)
- The internal model principle of control theory (1976)
- Linear Multivariable Control: A Geometric Approach (1974)
- Every good regulator of a system must be a model of that system (1970)
- Aggregation of Variables in Dynamic Systems (1961)