How to discount Information: Information flow in sensing-acting systems and the emergence of heirarchies

We argue that consistent formulation of optimal sensing and control must include information terms, yielding an extension of the standard POMDP setting. To make the standard reward/costs terms consist