I have a feeling the classic MIRI-style “either your system is too dumb to achieve the goal or your system is so smart that you can’t trust it anymore” argument is important here. The post essentially assumes that we have a powerful trusted model that can do impressive things like “accurately identify suspicious actions” but is trusted enough to be widely internally deployed. This seems fine for a brainstorming exercise (and I do think such brainstorming exercises should exist).
I think GPT-4 is already somewhat useful for identifying suspicious actions.
I think GPT-4 is already somewhat useful for identifying suspicious actions.