Can we actually speed up the “thinking” of fully trained ML models by K times during inference if we run it on processors that are K times faster?
Yes, definitely.
a. Yes b. Yes
This is all with the caveat that doing things faster doesn’t mean that it can solve bigger, more difficult problems or that it’s solutions will be of a higher quality.
Can we actually speed up the “thinking” of fully trained ML models by K times during inference if we run it on processors that are K times faster?
Yes, definitely.
a. Yes b. Yes
This is all with the caveat that doing things faster doesn’t mean that it can solve bigger, more difficult problems or that it’s solutions will be of a higher quality.