A fun thing about example 1. is that we can totally imagine an AF System that could drag a goat off a cliff and eat it (put it in a bioreactor which it uses to charge its battery), it’s just that no one would make that, because it wouldn’t make sense. Artificial systems use ‘cheats’ like solar power or hydrocarbons because the cheats are better. There may never be an era or a use case where it makes sense to ‘stop cheating’.
A weird but important example is that you might not ever see certain (sub-pivotal) demonstrations of strength from most AGI researcher institutions, not because they couldn’t make those things, but because doing so would cause them to be nationalized as a defense project.
A fun thing about example 1. is that we can totally imagine an AF System that could drag a goat off a cliff and eat it (put it in a bioreactor which it uses to charge its battery), it’s just that no one would make that, because it wouldn’t make sense. Artificial systems use ‘cheats’ like solar power or hydrocarbons because the cheats are better. There may never be an era or a use case where it makes sense to ‘stop cheating’.
A weird but important example is that you might not ever see certain (sub-pivotal) demonstrations of strength from most AGI researcher institutions, not because they couldn’t make those things, but because doing so would cause them to be nationalized as a defense project.