IMO, the power of differentiability is greatly underused. Everyone is locked into a ‘optimize parameters based on data & loss’ mindset, and few ever use the alternatives like ‘optimize data/trajectory based on parameters & loss’ or ’optimize loss based on data/parameters.
Strongly agree. It’s obnoxiously difficult to get people to understand that this was what I did (kind of) in this paper.
Strongly agree. It’s obnoxiously difficult to get people to understand that this was what I did (kind of) in this paper.