In online learning this is called the sleeping experts setting (we say an expert is “asleep” when it declines to make a prediction).
The algorithm in this post is the standard algorithm in the sleeping experts setting, though I don’t actually know a good reference. I think it is described in the notes for this course.
Edit: I think that course actually calls the sleeping experts “specialists,” if you are trying to ctrl+F for it.
In online learning this is called the sleeping experts setting (we say an expert is “asleep” when it declines to make a prediction).
The algorithm in this post is the standard algorithm in the sleeping experts setting, though I don’t actually know a good reference. I think it is described in the notes for this course.
Edit: I think that course actually calls the sleeping experts “specialists,” if you are trying to ctrl+F for it.