distributed-optimization

1 free lesson tagged distributed-optimization across AI. Each one is a short sequence of focused steps with narration and a five-question quiz at the end — take them in any order, no signup required.

advanced

Removing the Server: Gossip and Decentralized SGD

What happens when nobody coordinates: averaging by talking only to neighbours, why the graph's spectral gap sets the convergence rate, and how compressing messages by orders of magnitude still converges.

7 steps·~11 min

Removing the Server: Gossip and Decentralized SGD

Related topics