Of course ReLU is great!! I was trying to say that if I were a 2009 ANN researcher (unaware of prior ReLU uses like most people probably were at the time) and someone (who had not otherwise demonstrated expertise) came in and asked why we use this particular woosh instead of a bent line or something, then I would’ve thoroughly explained the thought out of them. It’s possible that I would’ve realized how it works but very unlikely IMO. But a dumbworker more likely to say “Go do it. Now. Go. Do it now. Leave. Do it.” as I see it.
Of course ReLU is great!! I was trying to say that if I were a 2009 ANN researcher (unaware of prior ReLU uses like most people probably were at the time) and someone (who had not otherwise demonstrated expertise) came in and asked why we use this particular woosh instead of a bent line or something, then I would’ve thoroughly explained the thought out of them. It’s possible that I would’ve realized how it works but very unlikely IMO. But a dumbworker more likely to say “Go do it. Now. Go. Do it now. Leave. Do it.” as I see it.