There’s an alignment-related problem, the problem of defining real objects. Relevant topics: environmental goals; task identification problem; “look where I’m pointing, not at my finger”; Eliciting Latent Knowledge.
Another highly relevant post: The Pointers Problem.
Another highly relevant post: The Pointers Problem.