This will depend on how many other funders are “swayed” towards the area by this funding and the research that starts coming out of it. This is a great bit of progress, but alone is nowhere near the amount needed to make optimal progress on AI. It’s important people don’t get the impression that this funding has “solved” the AI problem (I know you’re not saying this yourself).
Consider that Xrisk research in e.g. biology draws usefully on technical and domain-specific work in biosafety and biosecurity being done more widely. Until now AI safety research hasn’t had that body to draw on in the same way, and has instead focused on fundamental issues on the development of general AI, as well as outlining the challenges that will be faced. Given that much of this funding will go towards technical work by AI researchers, this will hopefully get this side of things going in a big way, and help build a body of support and involvement from the non-risk AI/CS community, which is essential at this moment in time.
But there’s a tremendous amount of work that will need to be done—and funded—in both the technical, fundamental, and broader (policy, etc) areas. Even if FHI/CSER are successful in applying, the funds that are likely to be allocated to the work we’re doing from this pot is not going to be near what we would need for our respective AI research programmes (I can’t speak for MIRI, but I presume this to be the case also). But it will certainly help!
This will depend on how many other funders are “swayed” towards the area by this funding and the research that starts coming out of it. This is a great bit of progress, but alone is nowhere near the amount needed to make optimal progress on AI. It’s important people don’t get the impression that this funding has “solved” the AI problem (I know you’re not saying this yourself).
Consider that Xrisk research in e.g. biology draws usefully on technical and domain-specific work in biosafety and biosecurity being done more widely. Until now AI safety research hasn’t had that body to draw on in the same way, and has instead focused on fundamental issues on the development of general AI, as well as outlining the challenges that will be faced. Given that much of this funding will go towards technical work by AI researchers, this will hopefully get this side of things going in a big way, and help build a body of support and involvement from the non-risk AI/CS community, which is essential at this moment in time.
But there’s a tremendous amount of work that will need to be done—and funded—in both the technical, fundamental, and broader (policy, etc) areas. Even if FHI/CSER are successful in applying, the funds that are likely to be allocated to the work we’re doing from this pot is not going to be near what we would need for our respective AI research programmes (I can’t speak for MIRI, but I presume this to be the case also). But it will certainly help!