Oh, I actually think that giving the 100th best person a bunch of power is probably better.than the status quo, assuming there are ~100 people who pass the bar (I also feel pessimistic about the status quo). The only reason why I think the status quo might be better is that more metaphilosophy would develop, and then whoever gets amplified would have more metaphilosophical competence to begin with, which seems safer.
I think the world will end up in a catastrophic epistemic pit. For example, if any religious leader got massively amplified, I think it’s pretty likely (>50%) the whole world will just stay religious forever.
Us making progress on metaphilosophy isn’t an improvement over the empowered person making progress on metaphilosophy, conditioning on the empowered person making enough progress on metaphilosophy. But in general I wouldn’t trust someone to make enough progress on metaphilosophy unless they had a strong enough metaphilosophical base to begin with.
(I assume you mean that the 1000th person is much worse than the status quo, because they will end up in a catastrophic epistemic pit. Let me know if that’s a misunderstanding.)
Is your view:
People can’t make metaphilosophical progress, but they can recognize and adopt it. The status quo is OK because there is a large diversity of people generating ideas (the best of which will be adopted).
People can’t recognize metaphilosphical progress when they see it, but better views will systematically win in memetic competition (or in biological/economic competition because their carriers are more competent).
“Metaphilosophy advances one funeral at a time,” the way that we get out of epistemic traps is by creating new humans who start out with less baggage.
Something completely different?
I still don’t understand how any of those views could imply that it is so hard for individuals to make progress if amplified. For each of those three views about why the status quo is good, I think that more than 10% of people would endorse that view and use their amplified power in a way consistent with it (e.g. by creating lots of people who can generate lots of ideas; by allowing competition amongst people who disagree, and accepting the winners’ views; by creating a supportive and safe environment for the next generation and then passing off power to that generation...) If you amplify people radically, I would strongly expect them to end up with better versions of these ideas, more often, than humanity at large.
My normal concern would be that people would drift too far too fast, so we’d end up with e.g. whatever beliefs were most memetically fit regardless of their accuracy. But again, I think that amplifying someone leaves us in a way better situation with respect to memetic competition unless they make an unforced error.
Even more directly: I think more than 1% of people would, if amplified, have the world continue on the same deliberative trajectory it’s on today. So it seems like the fraction of people you can safely amplify must be more than 1%. (And in general those people will leave us much better off than we are today, since lots of them will take safe, easy wins like “Avoid literally killing ourselves in nuclear war.”)
I can totally understand why you’d say “lots of people would mess up if amplified due to being hasty and uncareful.” But I still don’t see what could possibly make you think “99.99999% of people would mess up most of the time.” I’m pretty sure that I’m either misunderstanding your view, or it isn’t coherent.
It seems to me the difficulty is likely to be in assessing whether someone would have a good enough start, and being able to do this probably requires enough ability to assess metaphilosophical competence now such that we could pick such a person to make progress later.
(I’m not zhukeepa; i’m just bringing up my own thoughts.)
This isn’t quite the same as a improvement, but one thing that is more appealing about normal-world metaphilosophical progress than empowered-person metaphilosophical progress is that the former has a track record of working*, while the latter is untried and might not work.
Oh, I actually think that giving the 100th best person a bunch of power is probably better.than the status quo, assuming there are ~100 people who pass the bar (I also feel pessimistic about the status quo). The only reason why I think the status quo might be better is that more metaphilosophy would develop, and then whoever gets amplified would have more metaphilosophical competence to begin with, which seems safer.
What about the 1000th person?
(Why is us making progress on metaphilosphy an improvement over the empowered person making progress on metaphilosphy?)
I think the world will end up in a catastrophic epistemic pit. For example, if any religious leader got massively amplified, I think it’s pretty likely (>50%) the whole world will just stay religious forever.
Us making progress on metaphilosophy isn’t an improvement over the empowered person making progress on metaphilosophy, conditioning on the empowered person making enough progress on metaphilosophy. But in general I wouldn’t trust someone to make enough progress on metaphilosophy unless they had a strong enough metaphilosophical base to begin with.
(I assume you mean that the 1000th person is much worse than the status quo, because they will end up in a catastrophic epistemic pit. Let me know if that’s a misunderstanding.)
Is your view:
People can’t make metaphilosophical progress, but they can recognize and adopt it. The status quo is OK because there is a large diversity of people generating ideas (the best of which will be adopted).
People can’t recognize metaphilosphical progress when they see it, but better views will systematically win in memetic competition (or in biological/economic competition because their carriers are more competent).
“Metaphilosophy advances one funeral at a time,” the way that we get out of epistemic traps is by creating new humans who start out with less baggage.
Something completely different?
I still don’t understand how any of those views could imply that it is so hard for individuals to make progress if amplified. For each of those three views about why the status quo is good, I think that more than 10% of people would endorse that view and use their amplified power in a way consistent with it (e.g. by creating lots of people who can generate lots of ideas; by allowing competition amongst people who disagree, and accepting the winners’ views; by creating a supportive and safe environment for the next generation and then passing off power to that generation...) If you amplify people radically, I would strongly expect them to end up with better versions of these ideas, more often, than humanity at large.
My normal concern would be that people would drift too far too fast, so we’d end up with e.g. whatever beliefs were most memetically fit regardless of their accuracy. But again, I think that amplifying someone leaves us in a way better situation with respect to memetic competition unless they make an unforced error.
Even more directly: I think more than 1% of people would, if amplified, have the world continue on the same deliberative trajectory it’s on today. So it seems like the fraction of people you can safely amplify must be more than 1%. (And in general those people will leave us much better off than we are today, since lots of them will take safe, easy wins like “Avoid literally killing ourselves in nuclear war.”)
I can totally understand why you’d say “lots of people would mess up if amplified due to being hasty and uncareful.” But I still don’t see what could possibly make you think “99.99999% of people would mess up most of the time.” I’m pretty sure that I’m either misunderstanding your view, or it isn’t coherent.
It seems to me the difficulty is likely to be in assessing whether someone would have a good enough start, and being able to do this probably requires enough ability to assess metaphilosophical competence now such that we could pick such a person to make progress later.
(I’m not zhukeepa; i’m just bringing up my own thoughts.)
This isn’t quite the same as a improvement, but one thing that is more appealing about normal-world metaphilosophical progress than empowered-person metaphilosophical progress is that the former has a track record of working*, while the latter is untried and might not work.
*Slowly and not without reversals.