What I think I’m most interested in, is does training on one task improve or degrade it’s performance on other tasks?
It’s not very surprising if you take a model and throw a bunch of tasks at it and it eventually learns how to do all tasks. But if it can apply lessons from one task to general situations, that’s impressive!
Therefore, transfer from image captioning or visual grounded question answering tasks is possible.
We were not able to observe any benefit from pretraining on boxing.
What I think I’m most interested in, is does training on one task improve or degrade it’s performance on other tasks?
It’s not very surprising if you take a model and throw a bunch of tasks at it and it eventually learns how to do all tasks. But if it can apply lessons from one task to general situations, that’s impressive!
Some tasks improve others, some don’t:
Interesting. Research into this area might also give us some insight into which areas of human IQ are separate, and which parts are correlated.