Solving these tasks might require resources e.g. a bunch of money.
If humans were solving them, then they would not be gathering those resources themselves, but instead allocated a budget they can use, and they could not really be expected to perform additional independent work to expand that budget.
When you imagine the powerful AI system solving the tasks, do you also imagine it having these limitations, like working under a bounded budget without earning more money for the project?
For the examples I gave I’d imagine they would work under a bounded budget.
But I’m also happy to imagine an AI system that is running a fusion company, which delegates the “design a more efficient fusion reactor” to a different AI system. In that story the first AI system is in charge of budgeting and allocating resources, including getting more resources.
Solving these tasks might require resources e.g. a bunch of money.
If humans were solving them, then they would not be gathering those resources themselves, but instead allocated a budget they can use, and they could not really be expected to perform additional independent work to expand that budget.
When you imagine the powerful AI system solving the tasks, do you also imagine it having these limitations, like working under a bounded budget without earning more money for the project?
For the examples I gave I’d imagine they would work under a bounded budget.
But I’m also happy to imagine an AI system that is running a fusion company, which delegates the “design a more efficient fusion reactor” to a different AI system. In that story the first AI system is in charge of budgeting and allocating resources, including getting more resources.