Designing a data center for AI, by Nokia. Connecting GPUs: the pattern of traffic is different than ordinary traffic (more bursty, with long perios of network rest, when the GPU "think").
Despite "common knowledge", Ethernet works as well as InfiniBand here.