This helps you to submit job with multinode & multgpu in Slurm in Torchrun
slurm
pytorch
ddp
slurm-cluster
multigpu
multinode
slurm-multi-node
slurm-multi-gpu
distributed-launch
distributed-data-pa
slurm-multi-job
multinode-cluster
-
Updated
Nov 18, 2023 - Shell