I endorse most of this comment; this “core thing” idea is exactly what I tried to understand when writing my recent post on deep knowledge according to Yudkowsky.
This post, and this whole series of posts, feels like its primary function is training data to use to produce an Inner Eliezer that has access to the core thing, or even better to know the core thing in a fully integrated way. And maybe a lot of Eliezer’s other communications is kind of also trying to be similar training data, no matter the superficial domain it is in or how deliberate that is.
Yeah, that sounds right. I feel like Yudkowsky always write mostly training data, and feels like explaining as precisely as he can the thing he’s talking about never works. I agree with him that it can’t work without the reader doing a bunch of work (what he calls homework), but I expect (from my personal experience) that doing the work while you have an outline of the thing is significantly easier. It’s easier to trust that there’s something valuable at the end of the tunnel when you have a half-decent description.
The condescension is important information to help a reader figure out what is producing the outputs, and hiding it would make the task of ‘extract the key insights’ harder.
Here though I feel like you’re overinterpreting. In older writing, Yudkowsky is actually quite careful to not directly insult people and be condescending. I’m not saying he never does it, but he tones it down a lot compared to what’s happening in this recent dialogue. I think that a better explanation is simply that he’s desperate, and has very little hope of being able to convey what he means because he’s being doing that for 13 years and no one catched on.
Maybe point 8 is also part of the explanation: doing this non-condescendingly sounds like far more work for him, and yet he does’t expect it to work, so he doesn’t take that extra charge for little expected reward.
My Inner Eliezer says that writing this post without the condescension, or making it shorter, would be much much more effort for Eliezer to write. To the extent such a thing can be written, someone else has to write that version. Also, it’s kind of text in several places.
I endorse most of this comment; this “core thing” idea is exactly what I tried to understand when writing my recent post on deep knowledge according to Yudkowsky.
Yeah, that sounds right. I feel like Yudkowsky always write mostly training data, and feels like explaining as precisely as he can the thing he’s talking about never works. I agree with him that it can’t work without the reader doing a bunch of work (what he calls homework), but I expect (from my personal experience) that doing the work while you have an outline of the thing is significantly easier. It’s easier to trust that there’s something valuable at the end of the tunnel when you have a half-decent description.
Here though I feel like you’re overinterpreting. In older writing, Yudkowsky is actually quite careful to not directly insult people and be condescending. I’m not saying he never does it, but he tones it down a lot compared to what’s happening in this recent dialogue. I think that a better explanation is simply that he’s desperate, and has very little hope of being able to convey what he means because he’s being doing that for 13 years and no one catched on.
Maybe point 8 is also part of the explanation: doing this non-condescendingly sounds like far more work for him, and yet he does’t expect it to work, so he doesn’t take that extra charge for little expected reward.