FAWS

Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 15, chap­ter 84

• FAWSApr 9, 2012, 5:11 PM

  5 points

  in reply to: MixedNuts’s comment on: Ra­tion­al­ity Quotes April 2012

  Are you saying that the demographic you are talking about is special in using prejudice as the marker of evilness (as opposed to religious affiliation or whatever), or in taking that sort of attitude at all?

• FAWSApr 6, 2012, 11:41 AM

  0 points

  in reply to: Dmytry’s comment on: SMBC comic: poorly pro­grammed av­er­age-util­ity-max­i­miz­ing AI

  the thing that is identical is that you are trading utilities across people,

  This is either wrong (the utility functions of the people involved aren’t queried in the dust speck problem) or so generic as to be encompassed in the concept of “utility calculation”.

  Aggregating utility functions across different people is an unsolved problem, but not necessarily an unsolvable one. One way of avoiding utility monsters would be to normalize utility functions. The obvious way to do that leads to problems such as arachnophobes getting less cake even if they like cake equally much, but IMO that’s better than utility monsters.

• FAWSApr 6, 2012, 11:01 AM

  7 points

  in reply to: Dmytry’s comment on: SMBC comic: poorly pro­grammed av­er­age-util­ity-max­i­miz­ing AI

  (examples chosen for being at different points in the spectrum between the two options, not for being likely)

  Moral Universalism could be true in some sense, but not automatically compelling, and the AI would need to be programmed to find and/​or follow it.

  There could be a uniquely specified human morality that fulfills much of the same purpose Moral Universalism does for humans.

  It might be possible to specify what we want in a more dynamic way than freezing in current customs.

• FAWSApr 6, 2012, 10:37 AM

  18 points

  in reply to: Thomas’s comment on: SMBC comic: poorly pro­grammed av­er­age-util­ity-max­i­miz­ing AI

  The only similarity between those cases is that they involve utility calculations you disagree with. Otherwise every single detail is completely different. (e. g. the sort of utility considered, two negative utilities being traded against each other vs. trading utility elsewhere (positive and negative) for positive utility, which side of the trade the single person with the large individual utility difference is on, the presence of perverse incentives, etc, etc).

  If anything it would be more logical to equate Felix with the tortured person and treat this as a reductio ad absurdum of your position on the dust speck problem. (But that would be wrong too, since the numbers aren’t actually the problem with Felix, the fact that there’s an incentive to manipulate your own utility function that way is (among other things).)

• FAWSApr 4, 2012, 8:33 PM

  0 points

  in reply to: ArisKatsaris’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 14, chap­ter 82

  Yes, and the FFN update alert already went out. My guess is that Eliezer posted the chapter and deleted it immediately afterwards, perhaps due to some formatting problem.

• FAWSApr 4, 2012, 2:19 PM

  13 points

  in reply to: linkhyrule5’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 14, chap­ter 82

  If he apologizes he’ll probably either do it in person or in a similar way to last time, when he apologized for being unfair after Fawkes started shouting via Flitwick.

  One major problem with such a list is that he currently doesn’t know how difficult it would be to earn more money.

• FAWSApr 4, 2012, 12:23 PM

  6 points

  in reply to: Alejandro1’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 14, chap­ter 82

  And there is no problem with that if it’s restricted to non-blackmail interactions (except perhaps to the degree it’s mistaken by others to also apply to blackmail). Not responding to blackmail as a principled position and not valuing the life of the hostage highly enough for the amount asked for are completely different things.

  Otherwise it would have made sense for Voldemort (who wouldn’t care about Death Eater families) to keep taking family members hostage and ask for lower and lower amounts until hitting the sum they are valued at. Either that sum would have been low enough to devastate the morale of the Order members (e. g, 100 galleons and Voldemort asks for 101 the next time) or it would be high enough to drain their funds.

  A refusal to respond to blackmail needs to be unconditional.

• FAWSApr 4, 2012, 3:20 AM

  10 points

  on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 14, chap­ter 82

  Dumbledore seems a bit off in equating the two situations. Lucius isn’t threatening to send Hermione to Azkaban in the hope of getting something from Harry/​Dumbledore; in fact he made clear that he would rather send her to Azkaban than receive the money. Therefore paying of the blood debt does not equal giving in to blackmail and Harry can save her while still maintaining a consistent position of not giving in to blackmail. Engineering similar situations without making apparent that they are engineered (and therefore blackmail) is probably too impractical to be worth the effort.

Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 14, chap­ter 82

• FAWSApr 2, 2012, 10:07 AM

  −2 points

  in reply to: TheOtherDave’s comment on: What is life?

  Hence the word “largely”.

• FAWSApr 1, 2012, 11:46 PM

  0 points

  in reply to: Raemon’s comment on: What is life?

  Saying that moral weight is based on sentience is IMO largely a tautology. Sentience is mostly the word we use for “whatever poorly defined features of a mind give it moral weight”.

• FAWSApr 1, 2012, 1:00 AM

  1 point

  in reply to: Eponymuse’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  Harry could still get a false negative. Remember, Harry will feel the impulse to offer a drink to Alice if and only if if Alice is about to be surprised.

  Again, we don’t know that. The soda working in two steps as you seem to suggest (detecting future surprise, then determining whether that surprise is sufficient to cause soda spitting when drunk at the right time) is consistent with what we know about the soda. But that’s not the only possibility consistent with what we know. The soda could also work in a single step and detect whether soda drunk at various points would be spit, without directly detecting surprise at all.

• FAWSMar 31, 2012, 11:30 PM

  8 points

  in reply to: [deleted]’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  And more significantly:

  “Severus,” Albus Dumbledore said, and his voice almost cracked, “do you realize what you are saying? If Harry Potter and Voldemort fight their war with Muggle weapons there will be nothing left of the world but fire!”

  “What?” said Minerva. She had heard of guns, of course, but they weren’t that dangerous to an experienced witch -

  Severus spoke as though she weren’t in the room. “Then perhaps, Headmaster, he is sending a deliberate warning to Harry Potter of exactly that; saying that any attack with Muggle weapons will be met with retaliation in kind. Command Mr. Potter to cease his use of Muggle technology in his battles; that will show him the message is received… and not give him any more ideas.” Severus frowned. “Though, come to think of it, Mr. Malfoy—and of course Miss Granger—well, on second thought a blanket prohibition on technology seems wiser—”

  The old wizard pressed both his hands to his forehead, and from his lips came an unsteady voice, “I begin to hope that it is Harry behind this escape… oh, Merlin defend us all, what have I done, what have I done, what will become of the world?”

  There aren’t really any other good candidates for what he might have done to cause this particular problem (even if he felt responsibility on account of e g. not having been able to beat Voldemort permanently himself it seems unlikely to phrase it like that).

• FAWSMar 31, 2012, 11:14 PM

  0 points

  in reply to: Eponymuse’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  We don’t know that, committing to saying Vldemort is alive conditional on actually giving them a can might suffice.

• FAWSMar 30, 2012, 9:10 PM

  16 points

  in reply to: aladner’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  Unlike most of the room she knows Harry well enough that even him scaring a Dementor, no matter how surprising, wouldn’t make her personally afraid of Harry; she might be worried about what trouble he could cause but she knows perfectly well that he wouldn’t do anything to her. Besides it was less of a surprise for her since Dumbledore already told her Harry had developed a new charm.

• FAWSMar 29, 2012, 9:45 PM

  12 points

  in reply to: jimrandomh’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  The Interdict of Merlin blocking transmission of non-magical knowledge between living minds?

• FAWSMar 29, 2012, 12:18 PM

  4 points

  in reply to: thelittledoctor’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  Could you summarize to spare us from gazing into that abyss?

• FAWSMar 29, 2012, 11:15 AM

  14 points

  in reply to: ygert’s comment on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  We know this not to be true since Quirrel changed back into his normal appearance when the polyjuice wore off in Azkaban while he was unconscious.

• FAWSMar 28, 2012, 1:12 PM

  21 points

  on: Harry Pot­ter and the Meth­ods of Ra­tion­al­ity dis­cus­sion thread, part 13, chap­ter 81

  Why does Dumbledore not give a quick Summary of the worst consequences of being in debt to Lucius Malfoy? It’s hard to see how that could necessitate telling secrets that cannot be revealed in public, the laws involved should already be known. Naming a few of the “certain rights” Lucius would have shouldn’t take more time than Dumbledore actually spends trying to convince Harry.