Intrinsically valuable to a human run society. The laws of physics value an entity able to replicate itself across all accessible areas of reality—presumably at a minimum this galaxy and nearby ones- as efficiently as possible has the most value. Such optimized machinery is what Zvi calls “destroying all value in the universe” because presumably the optimal solution puts all it’s energy into replication and has the least amount of intelligence or inner thoughts or art or culture required.
The wake of such an event leaves the universe tiled with repeating subunits that do nothing but stockpile resources for no purpose than to exist as long as possible after the heat death of the universe.
Intrinsically valuable to a human run society. The laws of physics value an entity able to replicate itself across all accessible areas of reality—presumably at a minimum this galaxy and nearby ones- as efficiently as possible has the most value. Such optimized machinery is what Zvi calls “destroying all value in the universe” because presumably the optimal solution puts all it’s energy into replication and has the least amount of intelligence or inner thoughts or art or culture required.
The wake of such an event leaves the universe tiled with repeating subunits that do nothing but stockpile resources for no purpose than to exist as long as possible after the heat death of the universe.
No.
Things humans value will continue to be valuable because we are going to solve the alignment problem
Even if AI gained all of the power it would still find us interesting for the same reason we find dinosaurs interesting
Even if you are right and the max-entropy state of the universe is a literal paper clipper it would be way more interesting than you are describing
I hope you are correct but timelines exist where you are not
same as (1)
I also hope you are correct but optimality is whatever is optimal