That’s the umbrella topic, but I do not think that topic is in any way meant to exclude science. I mean… it’s science. How many thousands of words has Eliezer written on quantum physics?
Surely there are worse things that could happen to a community of rationalists than links to scientific discoveries of strong mutual interest. It’s not even a slippery slope towards bad off-topic stuff.
Edit: And I’m going to continue mostly contextless link sharing in the Open Thread until a link sharing subreddit is enabled.
It’s not even a slippery slope towards bad off-topic stuff.
I rather disagree. There are plenty of places online to find links to interesting scientific discoveries. And the sense in which Eliezer wrote about quantum physics is entirely different from the sense in which these links were “about science”.
That said, I didn’t mean to suggest in my question that the comment was off-topic, but rather wanted to know what folks thought about it.
Maybe I should just have said AI, or AGI. I suspect we will need further advances in computing power to achieve greater than human intelligence, friendly or otherwise.
I suspect the advances we need will decentralize the cpu.
We may end up instead building Aggregates of ALU,s scaled to more closely emulate complex neuronal flow.
Different sentient tasks may need different clock speeds.
I would not be surprised if the initial seed of an FAI could be implemented on current technology available to consumers. The missing part is understanding, not computing power.
On the other hand, increased available computing power makes it easier for someone without real understanding to stumble on unfriendly AGI through brute force searches of design space.
To the extent that FAI will depend on the continued exponential growth of computing capacity, I’d say yes.
I’ve always thought FAI was only tangentially on-topic here (more of a mutual interest than anything). This community is explicitly about rationality.
That’s the umbrella topic, but I do not think that topic is in any way meant to exclude science. I mean… it’s science. How many thousands of words has Eliezer written on quantum physics?
Surely there are worse things that could happen to a community of rationalists than links to scientific discoveries of strong mutual interest. It’s not even a slippery slope towards bad off-topic stuff.
Edit: And I’m going to continue mostly contextless link sharing in the Open Thread until a link sharing subreddit is enabled.
I rather disagree. There are plenty of places online to find links to interesting scientific discoveries. And the sense in which Eliezer wrote about quantum physics is entirely different from the sense in which these links were “about science”.
That said, I didn’t mean to suggest in my question that the comment was off-topic, but rather wanted to know what folks thought about it.
Are you sure you don’t mean uFAI? Friendliness isn’t a hardware problem.
Maybe I should just have said AI, or AGI. I suspect we will need further advances in computing power to achieve greater than human intelligence, friendly or otherwise.
I suspect the advances we need will decentralize the cpu. We may end up instead building Aggregates of ALU,s scaled to more closely emulate complex neuronal flow. Different sentient tasks may need different clock speeds.
I would not be surprised if the initial seed of an FAI could be implemented on current technology available to consumers. The missing part is understanding, not computing power.
On the other hand, increased available computing power makes it easier for someone without real understanding to stumble on unfriendly AGI through brute force searches of design space.