Let us call this precise, instruction-following genie a Golem Genie. (A golem is a
creature from Jewish folklore that would in some stories do exactly as told [Idel 1990],
often with unintended consequences, for example polishing a dish until it is as thin as
paper [Pratchett 1996].)
(The “Idel” reference goes to Idel, Moshe. 1990. Golem: Jewish Magical and Mystical Traditions on the Artificial Anthropoid. SUNY Series
in Judaica. Albany: State University of New York Press.)
From the MIRI paper “Intelligence Explosion and Machine Ethics”:
(The “Idel” reference goes to Idel, Moshe. 1990. Golem: Jewish Magical and Mystical Traditions on the Artificial Anthropoid. SUNY Series in Judaica. Albany: State University of New York Press.)