[core][compiled graphs] Support NCCL operations in non-compiled graphs #48272
Labels
compiled-graphs
core
Issues that should be addressed in Ray Core
enhancement
Request for new feature and/or capability
good first issue
Great starter issue for someone just starting to contribute to Ray
P1
Issue that should be fixed within a few weeks
Comments
stephanie-wang
added
enhancement
|
Hello Stephanie Wang, this is my first time working on the Ray open source project, and I really wanted to make some contributions to Ray at that time. I have read your description and hope that non compiled graphics can also support NCCL operations. Since compiled graphics can support NCCL operations, should I follow the relevant NCCL process for compiled graphics to make non compiled graphics support NCCL? Can you describe in more detail how to do it? thank you. @stephanie-wang |
jcotant1
added
core
jjyao
added
P1
|
Hi @stephanie-wang , is there any progress on this feature? If no one else is following up, can you assign it to me? |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Description
Currently the
TorchTensorType(transport="nccl")hint only changes behavior for compiled graphs. Non-compiled graphs cannot execute p2p or allreduce NCCL operations. The performance would be much worse, but we support this feature for debugging purposes.Use case
No response
The text was updated successfully, but these errors were encountered: