Reference. A “good regulator theorem” for embodied agents
In a classic paper, Conant and Ashby claimed that “every good regulator of a system must be a model of that system.” Artificial Life has produced many examples of systems that perform tasks with apparently no model in sight; these suggest Conant and Ashby’s theorem doesn’t easily generalise beyond its restricted setup. Nevertheless, here we show that a similar intuition can be fleshed out in a different way: whenever an agent is able to perform a regulation task, it is possible for an observer to interpret it as having “beliefs” about its environment, which it “updates” in response to sensory input. This notion of belief updating provides a notion of model that is more sophisticated than Conant and Ashby’s, as well as a theorem that is more broadly applicable. However, it necessitates a change in perspective, in that the observer plays an essential role in the theory: models are not a mere property of the system but are imposed on it from outside. Our theorem holds regardless of whether the system is regulating its environment in a classic control theory setup, or whether it’s regulating its own internal state; the model is of its environment either way. The model might be trivial, however, and this is how the apparent counterexamples are resolved.
Cite
Cites 44 works (1 here)
With notes (1)
A Bayesian Interpretation of the Internal Model Principle baltieri-2025-a
The internal model principle, originally proposed in the theory of control of linear systems, nowadays represents a more general class of results in control theory and cybernetics. The central claim of these results is that, under suitable assumptions, if a system (a controller) can regulate against a class of external inputs (from the environment), it is because the system contains a model of the system causing these inputs, which can be used to generate signals counteracting them. Similar claims on the role of internal models appear also in cognitive science, especially in modern Bayesian treatments of cognitive agents, often suggesting that a system (a human subject, or some other agent) models its environment to adapt against disturbances and perform goal-directed behaviour. It is however unclear whether the Bayesian internal models discussed in cognitive science bear any formal relation to the internal models invoked in standard treatments of control theory. Here, we first review the internal model principle and present a precise formulation of it using concepts inspired by categorical systems theory. This leads to a formal definition of “model” generalising its use in the internal model principle. Although this notion of model is not a priori related to the notion of Bayesian reasoning, we show that it can be seen as a special case of possibilistic Bayesian filtering. This result is based on a recent line of work formalising, using Markov categories, a notion of “interpretation”, describing when a system can be interpreted as performing Bayesian filtering on an outside world in a consistent way.
External (43)
- General agents need world models (2025)
- Formalising the intentional stance 2: a coinductive approach (2025)
- Formalising the intentional stance 1: attributing goals and beliefs to stochastic processes (2024)
- Software in the natural world: A computational approach to hierarchical emergence (2024)
- Deriving The Intrinsic Viability Constraint of an Emergent Individual from First Principles (2024)
- Decomposing Viability Space (2023)
- Categorical systems theory (2023)
- Interpreting systems as solving POMDPs: a step towards a formal understanding of agency (2022)
- The d-separation criterion in Categorical Probability (2022)
- Interpreting Dynamical Systems as Bayesian Reasoners (2021)
- Bayesian mechanics for stationary processes (2021)
- Fixing the good regulator theorem (2021)
- A free energy principle for a particular physics (2019)
- Meta-learning of Sequential Strategies (2019)
- Causal Inference by String Diagram Surgery (2018)
- Being a Beast Machine: The Somatic Basis of Selfhood (2018)
- Semantic information, autonomous agency and non-equilibrium statistical physics (2018)
- Methods for Measuring Viability and Evaluating Viability Indicators (2018)
- A channel-based perspective on conjugate priors (2017)
- Picturing Quantum Processes: A First Course in Quantum Theory and Diagrammatic Reasoning (2017)
- The Bayesian stance: Equations for ‘as-if’ sensorimotor agency (2017)
- A More Basic Version of Agency? As If! (2016)
- The internal model principle (blog post, Azimuth) (2016)
- Causal Theories: A Categorical Perspective on Bayesian Networks (2013)
- Physics, Topology, Logic and Computation: A Rosetta Stone (2010)
- Higher Coordination With Less Control—A Result of Information Maximization in the Sensorimotor Loop (2009)
- A Survey of Graphical Languages for Monoidal Categories (2009)
- Intentional Systems Theory (2009)
- Participatory sensemaking An enactive approach to social cognition (2007)
- Information and closure in systems theory (2006)
- Autopoiesis, Adaptivity, Teleology, Agency (2005)
- Organization of the information flow in the perception-action loop of evolved agents (2004)
- Autopoiesis and Cognition in the Game of Life (2004)
- The Dynamics of Active Categorical Perception in an Evolved Model Agent (2003)
- The dynamics of adaptive behavior: A research program (1997)
- A dynamical systems perspective on agent-environment interaction (1995)
- Real patterns (1991)
- Vehicles: Experiments in Synthetic Psychology (1986)
- Autopoiesis and Cognition: The Realization of the Living (1980)
- The internal model principle of control theory (1976)
- Every good regulator of a system must be a model of that system (1970)
- A New Approach to Linear Filtering and Prediction Problems (1960)
- Design for a brain (1960)