When you start to include broad basins (where a small perturbation changes your loss but only slightly), and other results like Mingard et al.‘s and Valle Pérez et al.’s, I’m inclined to think this picture is more representative. But even in this picture, we can probably end up making statements about singularities in the blobby regions having disproportionate effect over all points within those regions.
When you start to include broad basins (where a small perturbation changes your loss but only slightly), and other results like Mingard et al.‘s and Valle Pérez et al.’s, I’m inclined to think this picture is more representative. But even in this picture, we can probably end up making statements about singularities in the blobby regions having disproportionate effect over all points within those regions.