The number in the conclusion just changed by a factor of 40. I double-checked the math in the last section, and found it was overly complex and completely wrong. I also forgot to remove the number of predicates p from the dictionary-based estimate for s.
BTW, note that even if you can prove that an AI isn’t conscious, that doesn’t prove that it isn’t dangerous.
The number in the conclusion just changed by a factor of 40. I double-checked the math in the last section, and found it was overly complex and completely wrong. I also forgot to remove the number of predicates p from the dictionary-based estimate for s.
BTW, note that even if you can prove that an AI isn’t conscious, that doesn’t prove that it isn’t dangerous.
Oops. Original math was correct.