Skip to content

Commit

Permalink
Adds more collectives to ProcessGroups (#108)
Browse files Browse the repository at this point in the history
* initial commit for reduce_scatter

* fixes reduce_scatter function signature, refactors test and adds reduce_scatter test

* fixes test

* adds explicit NotImplementedError to reduce_scatter in gloo, simplify the test suite

* fix tests after merge

* initial commit

* Added all collectives, starting tests now

* fixes allreduce test, add and debug allgather_into_tensor_coalesced

* added all tests, need to hammer out failures

* fixes the tests

* linter

* test simplification

* more cleanup

* refactor + update tests

* add reduce_scatter multi pg tests

* add the full test suite

* final cleanups

* add _assert_list and _maybe_share_tensors
  • Loading branch information
allenwang28 authored Feb 12, 2025
1 parent f44aaa5 commit ca8c540
Show file tree
Hide file tree
Showing 2 changed files with 381 additions and 106 deletions.
Loading

0 comments on commit ca8c540

Please sign in to comment.