People have made tons of slightly-different things all tackling this sort of goal (for example: https://stampy.ai/ ), they just didn’t happen to fill this exact niche.
I do think maybe it’d actually just be good for @Scott Alexander to write an up-to-date one.
A lot of why I like this one is Scott’s prose, which I feel awkward completely copying and making changes to, and writing a new thing from scratch is a pretty high skill operation.
Stampy seems pretty shallow, even more so than this FAQ. Is that what you meant by it not filling “this exact niche”?
By the way, I come from AGI safety from first principles, where I found your comment linking to this. Notably, that sequence says “My underlying argument is that agency is not just an emergent property of highly intelligent systems, but rather a set of capabilities which need to be developed during training, and which won’t arise without selection for it.” which is reasonable and seems an order of magnitude more conservative than this FAQ, which doesn’t really touch the question of agency at all.
People have made tons of slightly-different things all tackling this sort of goal (for example: https://stampy.ai/ ), they just didn’t happen to fill this exact niche.
I do think maybe it’d actually just be good for @Scott Alexander to write an up-to-date one.
A lot of why I like this one is Scott’s prose, which I feel awkward completely copying and making changes to, and writing a new thing from scratch is a pretty high skill operation.
Stampy seems pretty shallow, even more so than this FAQ. Is that what you meant by it not filling “this exact niche”?
By the way, I come from AGI safety from first principles, where I found your comment linking to this. Notably, that sequence says “My underlying argument is that agency is not just an emergent property of highly intelligent systems, but rather a set of capabilities which need to be developed during training, and which won’t arise without selection for it.” which is reasonable and seems an order of magnitude more conservative than this FAQ, which doesn’t really touch the question of agency at all.