Pretty much. Though I’d call it a “fast takeoff” instead of “sharp left turn” because I think “sharp left turn” is supposed to have connotations beyond “fast takeoff”, e.g., “capabilities end up generalizing further than alignment”.
Right, you are saying evolution doesn’t provide evidence for AI capabilities generalizing further than alignment, but then only consider the fast takeoff part of the SLT to be the concern. I know you have stated reasons why alignment would generalize further than capabilities, but do you not think an SLT-like scenario could occur in the two capability jump scenarios you listed?
Pretty much. Though I’d call it a “fast takeoff” instead of “sharp left turn” because I think “sharp left turn” is supposed to have connotations beyond “fast takeoff”, e.g., “capabilities end up generalizing further than alignment”.
Right, you are saying evolution doesn’t provide evidence for AI capabilities generalizing further than alignment, but then only consider the fast takeoff part of the SLT to be the concern. I know you have stated reasons why alignment would generalize further than capabilities, but do you not think an SLT-like scenario could occur in the two capability jump scenarios you listed?