Jsevillamol comments on What’s the backward-forward FLOP ratio for Neural Networks?

[Jsevillamol]

That should be 2:1, not 3:1 (2 FLOPs per connection for the backward pass to 1 FLOP per connection for the forward pass).

And that is basically right, except for the caveats we point out in the post.