I agree that the phrasing could be better; any suggestions?
I actually think you could just drop that intro altogether, or move it later into the post. We do have pretty good evidence of modularity in the brain (as well as other biological systems) and in trained neural nets; it seems to be a pretty common property of large systems “evolved” by local optimization. And the rest of the post (as well as some of the other comments) does a good job of talking about some of that evidence. It’s a good post, and I think the arguments later in the post are stronger than that opening.
(On the other hand, if you’re opening with it because that was your own main prior, then that makes sense. In that case, maybe note that it was a prior for you, but that the evidence from other directions is strong enough that we don’t need to rely much on that prior?)
Thanks, that’s helpful. I do think there’s a weak version of this which is an important background assumption for the post (e.g. without that assumption I’d need to explain the specific ways in which ANNs and BNNs are similar), so I’ve now edited the opening lines to convey that weak version instead. (I still believe the original version but agree that it’s not worth defending here.)
I actually think you could just drop that intro altogether, or move it later into the post. We do have pretty good evidence of modularity in the brain (as well as other biological systems) and in trained neural nets; it seems to be a pretty common property of large systems “evolved” by local optimization. And the rest of the post (as well as some of the other comments) does a good job of talking about some of that evidence. It’s a good post, and I think the arguments later in the post are stronger than that opening.
(On the other hand, if you’re opening with it because that was your own main prior, then that makes sense. In that case, maybe note that it was a prior for you, but that the evidence from other directions is strong enough that we don’t need to rely much on that prior?)
Thanks, that’s helpful. I do think there’s a weak version of this which is an important background assumption for the post (e.g. without that assumption I’d need to explain the specific ways in which ANNs and BNNs are similar), so I’ve now edited the opening lines to convey that weak version instead. (I still believe the original version but agree that it’s not worth defending here.)