Bogdan Ionut Cirstea comments on Testing which LLM architectures can do hidden serial reasoning

[Bogdan Ionut Cirstea]

The toy task reminded me of the ‘Hidden side objectives’ subsection in section ‘B.1.2 OBFUSCATED SCHEMING REASONING’ of Towards evaluations-based safety cases for AI scheming.