ORCIDGitHubLinkedIn
RSS Curriculum Vitae TR

Data Parallelism

Turkish equivalent: Veri paralelliğiDomain: Machine Learning Systems

A distributed-training strategy that replicates a model across workers and partitions input batches while synchronizing parameter gradients or updates.

  • Tensor Parallelism
  • Pipeline Parallelism
  • Distributed Training
  • Throughput

Updated:

Related concepts

Machine Learning Systems