DiLoCo: Data Parallelism for the Datacenter Poor

Distributed training sans datacenter.

October 3, 2025 · 25 min · 5278 words · Shane Caldwell