Information theory may be useful for understanding active inference. As a minimum it offers some alternative perspectives on the quantities used in the active inference theory such as surprise, KL divergence, and entropy. This post provides a very short introduction to information theory.