Thinking about other domains, a proof is a summary of (an aspect of) a formal system. It provides a different level of information than is contained in the base axioms. Can we model “summary” of the suffering level/ratio/hellishness of a world in the same terms. It’s not about trusting the agent, it’s about the agent finding the subset of information about the world that shows us that the result is true.
Thinking about other domains, a proof is a summary of (an aspect of) a formal system. It provides a different level of information than is contained in the base axioms. Can we model “summary” of the suffering level/ratio/hellishness of a world in the same terms. It’s not about trusting the agent, it’s about the agent finding the subset of information about the world that shows us that the result is true.