I agree strongly with your point about experts vs laypersons interacting with the AI, Donald. I personally am really excited for the potential of game / simulation-world interactions with varying numbers of AI agents and human experts. But I think this a high risk scenario if you are trying to evaluate a new cutting-edge model to test how dangerous it is. I think this project as stated by Encultured AI has value iff it carefully uses only well-vetted models under careful surveillance, and is made available for evaluating new models only in special high-security settings.
I agree strongly with your point about experts vs laypersons interacting with the AI, Donald. I personally am really excited for the potential of game / simulation-world interactions with varying numbers of AI agents and human experts. But I think this a high risk scenario if you are trying to evaluate a new cutting-edge model to test how dangerous it is. I think this project as stated by Encultured AI has value iff it carefully uses only well-vetted models under careful surveillance, and is made available for evaluating new models only in special high-security settings.