The obvious and almost certainly correct answer to the meta-question is that there is no question that can be asked that won’t cause the AI to devote as many possible resources to answering forever, given that activating it doesn’t cause it to ask itself the simplest possible question and then spend eternity answering it over and over without ever interacting non-harmfully with humans.
The obvious and almost certainly correct answer to the meta-question is that there is no question that can be asked that won’t cause the AI to devote as many possible resources to answering forever, given that activating it doesn’t cause it to ask itself the simplest possible question and then spend eternity answering it over and over without ever interacting non-harmfully with humans.