Latency only matters to the degree that something is waiting on it. If your car won’t respond to an event until a round trip across a wireless connection, and oops dropped packet, you’re not going to have a good time.
In a datacenter, not only are latencies going to be much lower, you can often set things up that you can afford to wait for whatever latency remains. This is indeed still a concern- maintaining high utilization while training across massive numbers of systems does require hard work- but that’s a lot different than your car being embedded in a wall.
Latency only matters to the degree that something is waiting on it. If your car won’t respond to an event until a round trip across a wireless connection, and oops dropped packet, you’re not going to have a good time.
In a datacenter, not only are latencies going to be much lower, you can often set things up that you can afford to wait for whatever latency remains. This is indeed still a concern- maintaining high utilization while training across massive numbers of systems does require hard work- but that’s a lot different than your car being embedded in a wall.