Reference. A “good regulator theorem” for embodied agents

In a classic paper, Conant and Ashby claimed that “every good regulator of a system must be a model of that system.” Artificial Life has produced many examples of systems that perform tasks with apparently no model in sight; these suggest Conant and Ashby’s theorem doesn’t easily generalise beyond its restricted setup. Nevertheless, here we show that a similar intuition can be fleshed out in a different way: whenever an agent is able to perform a regulation task, it is possible for an observer to interpret it as having “beliefs” about its environment, which it “updates” in response to sensory input. This notion of belief updating provides a notion of model that is more sophisticated than Conant and Ashby’s, as well as a theorem that is more broadly applicable. However, it necessitates a change in perspective, in that the observer plays an essential role in the theory: models are not a mere property of the system but are imposed on it from outside. Our theorem holds regardless of whether the system is regulating its environment in a classic control theory setup, or whether it’s regulating its own internal state; the model is of its environment either way. The model might be trivial, however, and this is how the apparent counterexamples are resolved.

Cite

Cite as @virgo-2025-a (helia, typst) · \cite{virgo-2025-a} (LaTeX)
BibTeX
bibtex · 10 lines
@misc{virgo-2025-a,
  doi = {10.48550/ARXIV.2508.06326},
  url = {https://arxiv.org/abs/2508.06326},
  author = {Virgo, Nathaniel and Biehl, Martin and Baltieri, Manuel and Capucci, Matteo},
  keywords = {Artificial Intelligence (cs.AI), Systems and Control (eess.SY), FOS: Computer and information sciences, FOS: Computer and information sciences, FOS: Electrical engineering, electronic engineering, information engineering, FOS: Electrical engineering, electronic engineering, information engineering},
  title = {A "good regulator theorem" for embodied agents},
  publisher = {arXiv},
  year = {2025},
  copyright = {Creative Commons Attribution 4.0 International}
}
hayagriva YAML (typst)
yaml · 13 lines
virgo-2025-a:
  type: misc
  title: A "good regulator theorem" for embodied agents
  author:
  - Virgo, Nathaniel
  - Biehl, Martin
  - Baltieri, Manuel
  - Capucci, Matteo
  date: 2025
  publisher: arXiv
  url: https://arxiv.org/abs/2508.06326
  serial-number:
    doi: 10.48550/ARXIV.2508.06326
Cites 44 works (1 here)
With notes (1)

A Bayesian Interpretation of the Internal Model Principle baltieri-2025-a

The internal model principle, originally proposed in the theory of control of linear systems, nowadays represents a more general class of results in control theory and cybernetics. The central claim of these results is that, under suitable assumptions, if a system (a controller) can regulate against a class of external inputs (from the environment), it is because the system contains a model of the system causing these inputs, which can be used to generate signals counteracting them. Similar claims on the role of internal models appear also in cognitive science, especially in modern Bayesian treatments of cognitive agents, often suggesting that a system (a human subject, or some other agent) models its environment to adapt against disturbances and perform goal-directed behaviour. It is however unclear whether the Bayesian internal models discussed in cognitive science bear any formal relation to the internal models invoked in standard treatments of control theory. Here, we first review the internal model principle and present a precise formulation of it using concepts inspired by categorical systems theory. This leads to a formal definition of “model” generalising its use in the internal model principle. Although this notion of model is not a priori related to the notion of Bayesian reasoning, we show that it can be seen as a special case of possibilistic Bayesian filtering. This result is based on a recent line of work formalising, using Markov categories, a notion of “interpretation”, describing when a system can be interpreted as performing Bayesian filtering on an outside world in a consistent way.
DOI · arXiv
External (43)
virgo-2025-a reference entries/refs/virgo-2025-a/virgo-2025-a.hel