All non-omniscient agents make decisions with incomplete information. I don’t think this will change at any level of takeoff.
Sure, but my point here is that AGI will be only weakly superhuman during the critical risk period, so it will be highly uncertain, and probably human judgment is likely to continue to play a large role. Quite possibly to our detriment.
All non-omniscient agents make decisions with incomplete information. I don’t think this will change at any level of takeoff.
Sure, but my point here is that AGI will be only weakly superhuman during the critical risk period, so it will be highly uncertain, and probably human judgment is likely to continue to play a large role. Quite possibly to our detriment.