Also, see Michael Levin’s work on “multiscale competency architectures”. Fields, Levin, et al. apply this framework to ANNs in “The free energy principle induces neuromorphic development” (2022), see sections 2 and 4 in particular. This paper also addresses the question “How do modules/boundaries interact with thermodynamics—e.g. can we quantify the negentropy/bits-of-optimization requirements to create new boundaries/modules, or maintain old ones?”
See section 3. “Optimization and Scale Separation in Evolving Systems” in “Toward a theory of evolution as multilevel learning” (Vanchurin et al., 2022).
Also, see Michael Levin’s work on “multiscale competency architectures”. Fields, Levin, et al. apply this framework to ANNs in “The free energy principle induces neuromorphic development” (2022), see sections 2 and 4 in particular. This paper also addresses the question “How do modules/boundaries interact with thermodynamics—e.g. can we quantify the negentropy/bits-of-optimization requirements to create new boundaries/modules, or maintain old ones?”