Some paragraph breaks would go a long ways towards the kingdom of playful rants from the desolate lands of manic ravings.
cwillu
Any chance you have the generated svg’s still, not just the resulting bitmap render?
That’s actually a rather good depiction of a dog’s head, in my opinion.
OK. But can you prove that “outcome with infinite utility” is nonsense? If not—probability is greater than 0 and less than 1.
That’s not how any of this works, and I’ve spent all the time responding that I’m willing to waste today.
You’re literally making handwaving arguments, and replying to criticisms that the arguments don’t support the conclusions by saying “But maybe an argument could be made! You haven’t proven me wrong!” I’m not trying to prove you wrong, I’m saying there’s nothing here that can be proven wrong.
I’m not interested in wrestling with someone who will, when pinned to the mat, argue that because their pinky can still move, I haven’t really pinned them.
You’re playing very fast and loose with infinities, and making arguments that have the appearance of being mathematically formal.
You can’t just say “outcome with infinite utility” and then do math on it. P(‹undefined term›) is undefined, and that “undefined” does not inherit the definition of probability that says “greater than 0 and less than 1”. It may be false, it may be true, it may be unknowable, but it may also simply be nonsense!
And even if it wasn’t, that does not remotely imply than an agent must-by-logical-necessity take any action or be unable to be acted upon. Those are entirely different types.
And alignment doesn’t necessarily mean “controllable”. Indeed, the very premise of super-intelligence vs alignment is that we need to be sure about alignment because it won’t be controllable. Yes, an argument could be made, but that argument needs to actually be made.
And the simple implication of pascal’s mugging is not uncontroversial, to put it mildly.
And Gödel’s incompleteness theorem is not accurately summarized as saying “There might be truths that are unknowable”, unless you’re very clear to indicate that “truth” and “unknowable” have technical meanings that don’t correspond very well to either the plain english meanings nor the typical philosophical definitions of those terms.
None of which means you’re actually wrong that alignment is impossible. A bad argument that the sun will rise tomorrow doesn’t mean the sun won’t rise tomorrow.
“I—” said Hermione. “I don’t agree with one single thing you just said, anywhere.”
“However, through our current post-training process, the calibration is reduced.” jumped out at me too.
Please don’t break title norms to optimize for attention.
Retracted given that it turns out this wasn’t a deliberate migration.
Retracted given that it turns out this wasn’t a deliberate migration.
If it ends up being useful, the chapter switcher php can be replaced with a slightly hacky javascript page that performs the same function, as such the entire site can easily be completely static.
First line was “HPMOR.com is an authorized, ad-free mirror of Eliezer Yudkowsky‘s epic Harry Potter fanfic, Harry Potter and the Methods of Rationality (originally under the pen name Less Wrong).”, and in the footer: “This mirror is a project of Communications from Elsewhere.” The “Privacy and Terms” page made extensive reference to MIRI though: “Machine Intelligence Research Institute, Inc. (“MIRI”) has adopted this Privacy Policy (“Privacy Policy”) to provide you, the user of hpmor.com (the “Website”)”
Disagree with the “extremely emphatically” emphasis. Yes, it’s not as good, but it more satisfyingly scratched the “what happened in the end” itch, much more than the half-dozen other continuations I’ve read.
I’ve pulled down a static mirror from archive.org and modified a couple pieces which depended on server-side implementation to use a javascript version, most notably the chapter dropdown. In the unlikely case it’s useful, ping me.
Which is another gripe: hpmor.com prominently linked the epub/moby/pdf versions, while the trashed version makes no reference to their existence anymore.
Ugh. Why does everyone need to replace nice static web pages with junk that wants to perform a couple http requests every time the window changes:
Are you arguing that you couldn’t implement appropriate feedback mechanisms via the stimulation of truncated nerve endings in an amputated limb?
Actually, no, not “sorta”, it very much reminds me of gruntle.
What writing on the internet could have been.
Sorta reminds me of the old jwz gruntle (predating modern blogging).
I’d link directly, but he does things with referers sometimes, and don’t want to risk it.
Meta, possibly a site bug:
The footnote links don’t seem to be working for me, in either direction: footnote 1 links to #footnote-1, but there’s no element with that id; likewise the backlink on the footnote links to #footnote-anchor-1, which also lacks a block with a matching id.