Problem is that this formalisation is probably bullshit. It looks a bit like a video game where you generate “research points” for AGI and/or FAI. Research IRL does not work like that. You need certain key insights for AGI and a different set for FAI if some insights are shared among both sets (they probably are) the above model does not work any longer.
Further problem: How do you quantify G and F? A mathematical modell with variables you can’t quantify is of um very limited use (or should I say ornamentation?).
It sounds like we’re just rehashing the old arguments over the Drake equation.
You need certain key insights for AGI and a different set for FAI if some insights are shared among both sets (they probably are) the above model does not work any longer.
The model doesn’t assume that the sets of research are disjoint. See this thread where jessicat assumed the model wouldn’t work for her conception of FAI research in which the FAI problem is entirely reduced to AGI research. Fremaining and Gremaining can both include units of FAI or AGI research. First paragraph of the section on model 1.
How do you quantify G and F? A mathematical modell with variables you can’t quantify is of um very limited use (or should I say ornamentation?).
The point is that this is not a question that you even would have asked before. It’s just like the criticism about the last four factors in the Drake equation, but how many people were thinking about the questions raised by those factors before they were invented? I think this is more useful to have than not, and it can be built upon, which the authors apparently intend to do. Instead of just getting a good one in on me, actually ask “How do you quantify G and F?” We can ask subquestions that probably have a bearing on that question. What AGI research could be dependent upon FAI research, and vice versa? Are there examples of past technologies in which safety and functionality were at odds, and how analogous are these past examples with FAI/AGI research? How did, say, the Manhattan Project, especially in its early days, quantify and estimate its progress against other national nuclear weapon projects? What literature already exists on the topic of estimating research progress? Etc.
And then there are questions about how to improve the model, some of which they pose in the post itself. Although I haven’t found that any of your criticisms hold, I would still ask, how would you model this problem?
Problem is that this formalisation is probably bullshit. It looks a bit like a video game where you generate “research points” for AGI and/or FAI. Research IRL does not work like that. You need certain key insights for AGI and a different set for FAI if some insights are shared among both sets (they probably are) the above model does not work any longer. Further problem: How do you quantify G and F? A mathematical modell with variables you can’t quantify is of um very limited use (or should I say ornamentation?).
It sounds like we’re just rehashing the old arguments over the Drake equation.
The model doesn’t assume that the sets of research are disjoint. See this thread where jessicat assumed the model wouldn’t work for her conception of FAI research in which the FAI problem is entirely reduced to AGI research. Fremaining and Gremaining can both include units of FAI or AGI research. First paragraph of the section on model 1.
The point is that this is not a question that you even would have asked before. It’s just like the criticism about the last four factors in the Drake equation, but how many people were thinking about the questions raised by those factors before they were invented? I think this is more useful to have than not, and it can be built upon, which the authors apparently intend to do. Instead of just getting a good one in on me, actually ask “How do you quantify G and F?” We can ask subquestions that probably have a bearing on that question. What AGI research could be dependent upon FAI research, and vice versa? Are there examples of past technologies in which safety and functionality were at odds, and how analogous are these past examples with FAI/AGI research? How did, say, the Manhattan Project, especially in its early days, quantify and estimate its progress against other national nuclear weapon projects? What literature already exists on the topic of estimating research progress? Etc.
And then there are questions about how to improve the model, some of which they pose in the post itself. Although I haven’t found that any of your criticisms hold, I would still ask, how would you model this problem?