Skip to content

The model cannot be trained with multiple cards on a single machine #57

Open
@langge52

Description

Dear author, hello

Thank you very much for sharing these codes.

The problem I am currently facing is that I am unable to train with multiple cards on a single machine. Due to the abandonment of torch. distributed. launch, I have attempted CUDA_ VISIBLE_ DIVICES=0,1,2,3 Python - m torch. distributed. run -- nnodes 1-- nproc_ Per_ Node 4 train.py -- config configs/demo. yaml; Torchrun train.py -- config configs/demo.yaml and other training commands cannot be trained, and there is no relevant log information output. Therefore, I would like to ask you for advice on how to solve this problem. Thank you very much and look forward to your reply. Thank you again.

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions