For the identity function, wouldn’t regularisation would push the non-zero weights towards unity?
Thanks for the comment! I didn’t get around to testing that, but that’s one of the exact things I had in mind for my “Next Steps” #3 on training regimens that more reliably produce optimal, interpretable models.
For the identity function, wouldn’t regularisation would push the non-zero weights towards unity?
Thanks for the comment! I didn’t get around to testing that, but that’s one of the exact things I had in mind for my “Next Steps” #3 on training regimens that more reliably produce optimal, interpretable models.