Your AI is only as good as the network underneath it

When an AI workload is not performing as expected, the obvious place to look is the GPU. Do we have enough compute capacity? Would adding more GPUs solve the problem? Not necessarily. The GPUs may be perfectly capable of handling the workload, but if the network is not able to move data quickly and consistently, adding more compute could result in more expense without addressing the real bottleneck. This is something I think we risk losing sight of in the rush to invest in AI. GPUs cannot do their job alone. They rely on huge amounts of data moving quickly between compute, storage and applicat