Huge thanks for writing this! Particularly liked the SVD intuition and how it can be used to understand properties of . One small correction I think. You wrote:
is simply the projection along the vector
I think is projection along the vector , so is projection on hyperplane perpendicular to
Totally agree! This is my big weakness right now—hopefully as I read more papers I’ll start developing a taste and ability to critique.