The short answer is that most of the lessons come from my hobby of thinking about weird learning rules—alternatives to back-prop that make more sense under certain conditions/requirements.
(Can’t say I pass my own test from the “Are you solving the right problem?” section, but it’s just a hobby anyway.)
What problems did you solve, from which you are extracting these lessons?
The short answer is that most of the lessons come from my hobby of thinking about weird learning rules—alternatives to back-prop that make more sense under certain conditions/requirements.
(Can’t say I pass my own test from the “Are you solving the right problem?” section, but it’s just a hobby anyway.)