In economics (and I’m sure in many other fields—I’m just writing about what I know here), something like this is supposedly done in the “robustness checks” section of a paper.
Machine learning sometimes has ablation studies, where you remove various components of your system and rerun everything. To figure out whether the fancy new layer you added actually contributes to the overall performance.
Machine learning sometimes has ablation studies, where you remove various components of your system and rerun everything. To figure out whether the fancy new layer you added actually contributes to the overall performance.