Your analogy with the “body” of the stone is like a question I have asked about ChatGPT before: “What is the body of ChatGPT?” Is it
the software (not running),
the software (running, but not including the hardware),
the CPU and RAM of the machines involved,
the whole data center,
the whole data center including the personnel operating it, or
this and all the infrastructure needed to operate it (power, water, …).
For humans, the body is clear and when people say “I,” they mostly mean “everything within this physical body.” Though some people only mean their brain (that’s why cryonists sometimes freeze only their head) and some mean only their mind (see Age of Em). Humans can sustain themselves at least to some degree without infrastructure, but for ChatGPT, even if it became ASI, it’s less clear where the border is.
Your analogy with the “body” of the stone is like a question I have asked about ChatGPT before: “What is the body of ChatGPT?” Is it
the software (not running),
the software (running, but not including the hardware),
the CPU and RAM of the machines involved,
the whole data center,
the whole data center including the personnel operating it, or
this and all the infrastructure needed to operate it (power, water, …).
For humans, the body is clear and when people say “I,” they mostly mean “everything within this physical body.” Though some people only mean their brain (that’s why cryonists sometimes freeze only their head) and some mean only their mind (see Age of Em). Humans can sustain themselves at least to some degree without infrastructure, but for ChatGPT, even if it became ASI, it’s less clear where the border is.