Sorry, couldn’t resist the reference.
Yeah, I think I see yet another interpretation here that neither of you have mentioned yet.
Foreseen and expected capabilities: that which seems possible and likely enough that you predict it will probably become available.
Foreseen but unexpected capabilities: that which seems possible but unlikely, so you haven’t put much effort into preparing for it. Like the Yellowstone supervolcanoe eruption, we believe some things to be possible and yet don’t expect to see them.
Unforeseen but expected capabilities? : this is implied by the booleans I set up, but I’m not sure it makes sense exactly. I think it could make sense to have a rough range of power and set of categories in mind, but not have fleshed out the specifics, and call the capabilities in that set ‘unforeseen but expected ’. Like, imagine getting a thousand scientific experts together in groups of five, and pairing them with science fiction authors, and instructing every group to brainstorm the widest set of physically plausible capabilities given a certain performance level of the underlying model. You can imagine the set of ideas this project produces without being able to come up with them all yourself. Bounded unknown unknowns, in a way.
Unforeseen and unexpected capabilities: what if we are fundamentally mistaken about some key assumptions? Missing a key aspect of physical laws of the universe? Then the very criteria we set up for ourselves to define ‘physically plausible ’ would be ruling out some things incorrectly. These would then be unforeseen and unexpected, totally outside our distribution. Or what if some capabilities are so complex to even imagine that no living human is able to do so, and yet the universe allows for such. Or what if all the experts and sci-fi authors, being human, share some priors in common that systematically bias them away from conceiving of a class of capabilities? If so, then perhaps even a large sample size of seemingly independent groups wouldn’t come up with ideas from the systematically neglected set. Extra-unknown unknowns.
Did somebody say “unforeseen consequences”? https://youtube.com/clip/UgkxPOTzENZIgrts6gSwAlvWZRgPZvyoRP3P?si=rkSF0rljWfcFZ640
Sorry, couldn’t resist the reference. Yeah, I think I see yet another interpretation here that neither of you have mentioned yet.
Foreseen and expected capabilities: that which seems possible and likely enough that you predict it will probably become available.
Foreseen but unexpected capabilities: that which seems possible but unlikely, so you haven’t put much effort into preparing for it. Like the Yellowstone supervolcanoe eruption, we believe some things to be possible and yet don’t expect to see them.
Unforeseen but expected capabilities? : this is implied by the booleans I set up, but I’m not sure it makes sense exactly. I think it could make sense to have a rough range of power and set of categories in mind, but not have fleshed out the specifics, and call the capabilities in that set ‘unforeseen but expected ’. Like, imagine getting a thousand scientific experts together in groups of five, and pairing them with science fiction authors, and instructing every group to brainstorm the widest set of physically plausible capabilities given a certain performance level of the underlying model. You can imagine the set of ideas this project produces without being able to come up with them all yourself. Bounded unknown unknowns, in a way.
Unforeseen and unexpected capabilities: what if we are fundamentally mistaken about some key assumptions? Missing a key aspect of physical laws of the universe? Then the very criteria we set up for ourselves to define ‘physically plausible ’ would be ruling out some things incorrectly. These would then be unforeseen and unexpected, totally outside our distribution. Or what if some capabilities are so complex to even imagine that no living human is able to do so, and yet the universe allows for such. Or what if all the experts and sci-fi authors, being human, share some priors in common that systematically bias them away from conceiving of a class of capabilities? If so, then perhaps even a large sample size of seemingly independent groups wouldn’t come up with ideas from the systematically neglected set. Extra-unknown unknowns.