wedrifid comments on Stupid Questions Open Thread

wedrifid 31 Dec 2011 8:42 UTC
12 points

I think it would be significantly easier to make FAI than LukeFreindly AI

Massively backwards! Creating an FAI (presumably ‘friendly to humanity’) requires an AI that can somehow harvest and aggregate preferences over humans in general but an FAI just needs to scan one brain.
- Larks 31 Dec 2011 21:16 UTC
  0 points
  Parent
  Scanning is unlikely to be the bottleneck for a GAI, and it seems most of the difficulty with CEV is from the Extrapolation part, not the Coherence.
  - wedrifid 31 Dec 2011 21:54 UTC
    6 points
    Parent
    
    Scanning is unlikely to be the bottleneck for a GAI, and it seems most of the difficulty with CEV is from the Extrapolation part, not the Coherence.
    
    It doesn’t matter how easy the parts may be, scanning, extrapolating and cohering all of humanity is harder than scanning and extrapolating Luke.
    - torekp 2 Jan 2012 18:48 UTC
      5 points
      Parent
      Not if Luke’s values contain pointers to all those other humans.