Cool post, and I am excited about (what I’ve heard of) SLT for this reason—but it seems that that post doesn’t directly address the volume question for deep learning in particular? (And perhaps you didn’t mean to imply that the post would address that question.)
Right. SLT tells us how to operationalize and measure (via the LLC) basin volume in general for DL. It tells us about the relation between the LLC and meaningful inductive biases in the particular setting described in this post. I expect future SLT to give us meaningful predictions about inductive biases in DL in particular.
The post is live here.
Cool post, and I am excited about (what I’ve heard of) SLT for this reason—but it seems that that post doesn’t directly address the volume question for deep learning in particular? (And perhaps you didn’t mean to imply that the post would address that question.)
Right. SLT tells us how to operationalize and measure (via the LLC) basin volume in general for DL. It tells us about the relation between the LLC and meaningful inductive biases in the particular setting described in this post. I expect future SLT to give us meaningful predictions about inductive biases in DL in particular.