Kenny

• KennyMar 28, 2023, 1:46 AM

  1 point

  0

  in reply to: jbash’s comment on: More in­for­ma­tion about the dan­ger­ous ca­pa­bil­ity eval­u­a­tions we did with GPT-4 and Claude.

  You seem to be describing something that’s so implausible it might as well be impossible.

  Given the existing constraints, I think ARC made the right choice.

• KennyMar 27, 2023, 7:15 PM

  1 point

  0

  in reply to: jbash’s comment on: More in­for­ma­tion about the dan­ger­ous ca­pa­bil­ity eval­u­a­tions we did with GPT-4 and Claude.

  Do you think ARC should have traded publicizing the lab’s demands for non-disclosure instead of performing the exercise they did?

  I think that would have been a bad trade.

  I also don’t think there’s much value to them whistleblowing about any kind of non-disclosure that the lab’s might have demanded. I don’t get the sense there’s any additional bad (or awful) behavior – beyond what’s (implicitly) apparent from the detailed info ARC has already publicly released.

  I think it’s very useful to maintain sufficient incentives for the lab’s to want to allow things like what ARC did.

  … it wouldn’t necessarily be unreasonable to shut the “labs” down or expropriate them at right about this point in the story.

  Sure, tho I’d be much more terrified were they expropriated!

• KennyMar 24, 2023, 6:05 PM

  1 point

  0

  in reply to: jbash’s comment on: More in­for­ma­tion about the dan­ger­ous ca­pa­bil­ity eval­u­a­tions we did with GPT-4 and Claude.

  Wouldn’t it be better to accept contractual bindings and then at least have the opportunity to whistleblow (even if that means accepting the legal consequences)?

  Or do you think that they have some kind of leverage by which the labs would agree to NOT contractually bind them? I’d expect the labs to just not allow them to evaluate the model at all were ARC to insist on or demand this.

• KennyFeb 21, 2023, 9:38 PM

  1 point

  1

  in reply to: marcusarvan’s comment on: Bing Chat is blatantly, ag­gres­sively misaligned

  I’m definitely not against reading your (and anyone else’s) blog posts, but it would be friendlier to at least outline or excerpt some of the post here too.

• KennyFeb 21, 2023, 9:35 PM

  1 point

  0

  in reply to: Jacob Pfau’s comment on: Bing Chat is blatantly, ag­gres­sively misaligned

  It looks like you didn’t (and maybe can’t) enter the ASCII art in the form Bing needs to “decode” it? For one, I’d expect line breaks, both after and before the code block tags and also between each ‘line’ of the art.

  If you can, try entering new lines with <kbd>Shift</​kbd>+<kbd>Enter</​kbd>. That should allow new lines without being interpreted as ‘send message’.

• KennyFeb 21, 2023, 6:31 PM

  2 points

  0

  on: [linkpost] Bet­ter Without AI

  I really like David’s writing generally but this ‘book’ is particularly strong (and pertinent to us here on this site).

  The second section, What is the Scary kind of AI?, is a very interesting and (I think) useful alternative perspective on the risks that ‘AI safety’ do and (arguably) should focus on, e.g. “diverse forms of agency”.

  The first chapter of the third (‘scenarios’) section, At war with the machines, provides a (more) compelling version of a somewhat common argument, i.e. ‘AI is (already) out to get us’.

  The second detailed scenario, in the third chapter, triggered my ‘absurdity heuristic’ hard. The following chapter points out that absurdity was deliberate – bravo David!

  The rest of the book is a surprisingly comprehensive synthesis of a lot of insights from LW, the greater ‘Modern Rationalist’ sphere, and David’s own works (much of which is very much related to and pertinent to the other two sets of insights). I am not ‘fully sold’ on ‘Mooglebook AI doom’, but I have definitely updated fairly strongly towards it.

• KennyFeb 8, 2023, 10:44 PM

  1 point

  0

  in reply to: michael_dello’s comment on: Movie Re­view: Megan

  This seems like the right trope:

  • Cartoonland Time—TV Tropes [WARNING: browsing TV Tropes can be a massive time sink]

• KennyFeb 8, 2023, 8:32 PM

  5 points

  3

  in reply to: Slimepriestess’s comment on: Quan­tum Suicide, De­ci­sion The­ory, and The Multiverse

  That’s why I used a fatal scenario, because it very obviously cuts all future utility to zero

  I don’t understand why you think a decision resulting in some person’s or agent’s death “cuts all future utility to zero”. Why do you think choosing one’s death is always a mistake?

• KennyFeb 7, 2023, 6:56 PM

  1 point

  0

  in reply to: Gordon Seidoh Worley’s comment on: Ama­zon clos­ing Ama­zonSmile to fo­cus its philan­thropic giv­ing to pro­grams with greater impact

  I think I’d opt to quote the original title in a post here to indicate that it’s not a ‘claim’ being made (by me).

• KennyJan 28, 2023, 6:23 PM

  2 points

  0

  in reply to: mad’s comment on: Iron defi­cien­cies are very bad and you should treat them

  IIRC, RDIs (and I would guess EARs) vary quite significantly among the various organizations that calculate/​estimate/​publish them. That might be related to the point ChristianKI seemed to be trying to make. (Tho I don’t know whether ‘iron’ is one of the nutrients for which this is, or was, the case.)

• KennyDec 5, 2022, 2:08 AM

  1 point

  0

  on: ChatGPT: First Impressions

  I can’t tell what’s the output of ChatGPT or your prompts or commentary.

• KennyNov 14, 2022, 12:08 AM

  1 point

  0

  in reply to: philh’s comment on: [Link] “Im­proper Nouns” by siderea

  I don’t think ‘chronic fatigue syndrome’ is a great example of what the post discusses because ‘syndrome’ is a clear technical (e.g. medical) word already. Similarly, ‘myalgic encephalitis’ is (for most listeners or readers) not a phrase made up of common English words. Both examples seem much more clearly medical or technical terms. ‘chronic fatigue’ would be a better example (if it was widely used) as it would conflate the unexplained medical condition with anything else that might have the same effects (like ‘chronic overexertion’).

• KennyNov 12, 2022, 7:57 PM

  1 point

  0

  on: You are bet­ter at math (and al­ign­ment) than you think

  The only benefit of public schools anymore, from what I can tell, is that very wise and patient parents can use it to support their children in mastering Defense Against the Dark Arts.

  Well, that and getting to play with other kids. Which is still pretty cool.

  This may be, perhaps, an under-appreciated function of (public) school schooling!

• KennyNov 10, 2022, 9:04 PM

  22 points

  17

  in reply to: Ronny Fernandez’s comment on: What it’s like to dis­sect a cadaver

  I would think the title is itself a content warning.

  I guess someone might think this post is or could be far more abstract and less detailed about the visceral realities than it is (or maybe even just using the topic as a metaphor at most).

  What kind of specific content warning do you think would be appropriate? Maybe “Describes the dissection of human bodies in vivid concrete terms.”?

• KennyOct 2, 2022, 2:54 PM

  2 points

  0

  in reply to: Aorou’s comment on: Dath Ilan’s Views on Stop­gap Corrigibility

  I was going to share it with you if you didn’t have it, but thanks!

• KennyOct 1, 2022, 4:09 AM

  1 point

  0

  in reply to: Aorou’s comment on: Dath Ilan’s Views on Stop­gap Corrigibility

  Has anyone shared the link with you yet?

[Link] “Im­proper Nouns” by siderea

• KennySep 24, 2022, 6:17 PM

  4 points

  1

  on: Pro­jec­tLawful.com gives you policy experience

  After a long day of work, you can kick back with projectlawful for a few hours, and then go to sleep. You can read projectlawful on the weekend. You can read projectlawful on vacation. It’s rest and rejuvenation and recharging …

  I did NOT find this to be the case – I found it way TOO engaging and that it therefore, e.g. actively disrupted my ability to go to sleep. I also found the story to be extremely upsetting, i.e. NOT restful or rejuvenating. As-of now, it’s extremely bleak.

  I very much DO like it and I am perfectly happy that it’s a glowfic. (There are some mildly confusing parts, probably because of it being a glowifc, but nothing too bad.)

  This is also the first story for which I viscerally felt the utility of providing a ‘trigger warning’.

  I don’t know what in particular makes you think the story is useful as “policy experience”. I’m skeptical that much ‘real world’ policy in any way resembles the story.

• KennySep 13, 2022, 12:51 PM

  1 point

  2

  in reply to: CFAR!Duncan’s comment on: Ap­pendix: Jar­gon Dictionary

  I thought it might be a reference to this:

  • In the Cells of the Eggplant | Meta-rationality

• KennySep 1, 2022, 9:37 PM

  3 points

  0

  in reply to: Valentine’s comment on: Againstness

  I think ‘againstness’ is nearly perfect :)

  I didn’t think anything was confusing!

  ‘Againstness’ felt like a nearly self-defining word to me.

  Your course had a rough/​sketched/​outlined model based on other models at various levels and there’s a few example techniques based on it (in the course).

  “againstness control” is totally sensible – just like, e.g. ‘againstness management’ and ‘againstness practice’, are too.

  I think there’s an implied (and intriguing) element of using SNS arousal/​dominance for, e.g. motivation. I think there are some times or circumstances in which ‘SNS flow’ is effective, e.g. competitive sports.

  I don’t think your example techniques need a special term. I understood this post as ‘gesturing’ at something more than presenting anything comprehensive.