Communication-Efficient Language Model Training Scales Reliably and Robustly: Scaling Laws for DiLoCo
Paper
•
2503.09799
•
Published
•
14
Zachary Charles
zcharles8
·
AI & ML interests
federated learning, optimization, distributed learning
Recent Activity
authored
a paper
about 1 year ago
FAX: Scalable and Differentiable Federated Primitives in JAX
upvoted
a
paper
about 1 year ago
FAX: Scalable and Differentiable Federated Primitives in JAX
Organizations
