Skip to content

Commit

Permalink
Add distributed collective op broadcast/allgather/reduce_scatter/barr…
Browse files Browse the repository at this point in the history 
…ier (#1202)

### Motivation:

implement collectives op `broadcast`, `allreduce_coalesced`,
`allgather`, `_allgather_base`, `allgather_coalesced`,
`allgather_into_tensor_coalesced`, `reduce_scatter`,
`_reduce_scatter_base`, `reduce_scatter_tensor_coalesced`, `barrier`.
  • Loading branch information
@Chao1Han
Chao1Han authored Jan 8, 2025
1 parent 28e7c8c commit af8622f
Show file tree
Hide file tree
Showing 2 changed files with 974 additions and 31 deletions.
Loading

0 comments on commit af8622f

Please sign in to comment.