As for the idea of competing AIs, if they can modify each other’s code, what’s to keep one from just deleting the other?
Or, for that matter, from modifying the other AI to change its values and goals in how the other AI modifies itself? Indirect self-modification?
This problem seems rather harder than directly implementing a FAI.
Current theme: default
Less Wrong (text)
Less Wrong (link)
Arrow keys: Next/previous image
Escape or click: Hide zoomed image
Space bar: Reset image size & position
Scroll to zoom in/out
(When zoomed in, drag to pan; double-click to close)
Keys shown in yellow (e.g., ]) are accesskeys, and require a browser-specific modifier key (or keys).
]
Keys shown in grey (e.g., ?) do not require any modifier keys.
?
Esc
h
f
a
m
v
c
r
q
t
u
o
,
.
/
s
n
e
;
Enter
[
\
k
i
l
=
-
0
′
1
2
3
4
5
6
7
8
9
→
↓
←
↑
Space
x
z
`
g
Or, for that matter, from modifying the other AI to change its values and goals in how the other AI modifies itself? Indirect self-modification?
This problem seems rather harder than directly implementing a FAI.