skulk-and-quarrel

Karma: −2

skulk-and-quarrel 14 Apr 2023 3:49 UTC
−12 points
−10
in reply to: Ericf’s comment on: On AutoGPT
I think we ban research on embodied AI and let GPT takeover Metaverse. Win win

Edit: and also nuke underground robot research facilities? Doesn’t seem like a great idea in hindsight

[Question] Is there a manifold plot of all people who had a say in AI alignment?

skulk-and-quarrel31 Mar 2023 21:50 UTC

8 points

0 comments1 min readLW link

skulk-and-quarrel 28 Mar 2023 22:52 UTC
4 points
0
on: A rough and incomplete review of some of John Wentworth’s research
Disclaimer: I have not read the Wentworth’s post or the linked one but I know (little) about finite-sample and asymptotic bounds.
(He had another few versions, allegedly with fuller proofs, though I was not able to understand them and focused on this one.)
I think the key point of the statement is “any finite-entropy function $f (X)$ ”. This makes sure that the “infinity” in the sampling goes away. That being said, it should be possible to extend the proof to non-independent samples, Cosma Shalizi has done a ton of work on this.

skulk-and-quarrel 20 Mar 2023 22:48 UTC
0 points
0
in reply to: gwern’s comment on: RLHF does not appear to differentially cause mode-collapse
The impact in ChatGPT could be potentially due to longer prompts or the “system prompt”. It would be great to test that in a similar analysis

skulk-and-quarrel 17 Mar 2023 18:48 UTC
1 point
0
in reply to: Maxwell Peterson’s comment on: Super-Luigi = Luigi + (Luigi—Waluigi)
What about the luigis and waluigis in different languages, cultures, religions? Ones that can be described via code? It feels like you can always invent new waluigis unless the RLHF killed all of the waluigis from your pre-training data (whatever that means)

The token limit (let’s call that $n$ ) is your limit here, you just need to create a waluigi in $t$ steps, so that you can utilize him for the last $n - t$ steps. I think this eventually breaks down to something about computational bounds, like can you create a waluigi in this much time

skulk-and-quarrel 17 Mar 2023 18:31 UTC
2 points
0
on: Super-Luigi = Luigi + (Luigi—Waluigi)
Second insight:
If you can find Luigi and Waluigi in the behavior vector space, then you have a helpful direction to nudge the AI towards. You nudge it in the direction of Luigi - Waluigi.
You need to do this for all (x,y) pairs of Luigis and Waluigis. How do you enumerate all the good things in the world with their evil twins, and then somehow compare the internal embedding shift against all of these directions? Is that even feasible? You probably would just get stuck.