Getting massively out of my depth here, but is that an easy thing to do given the later stages will have to share weights with early stages?
I’m not sure, but I could imagine an activation representing a counter of “how many steps have I been thinking for” is a useful feature encoded in many such networks.
Getting massively out of my depth here, but is that an easy thing to do given the later stages will have to share weights with early stages?
I’m not sure, but I could imagine an activation representing a counter of “how many steps have I been thinking for” is a useful feature encoded in many such networks.