All Reduce Across the Atlantic: Bandwidth in Decentralized TrainingThe practical realities of devestatingly high communication cost in training.