Skip to content

Commit

Permalink
modify README
Browse files Browse the repository at this point in the history
  • Loading branch information
fengwang committed Oct 22, 2021
1 parent 8c6880c commit c14cadc
Showing 1 changed file with 5 additions and 5 deletions.
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -184,7 +184,7 @@ TWIST is a novel self-supervised representation learning method by classifying l
## Single-node Training
ResNet-50 (requires 8 GPUs, Top-1 Linear 72.6%)
```
python3 -m torch.distributed.launch --nproc_per_node=8 train.py \
python3 -m torch.distributed.launch --nproc_per_node=8 --use_env train.py \
--data-path ${DATAPATH} \
--output_dir ${OUTPUT} \
--aug barlow \
Expand All @@ -196,7 +196,7 @@ python3 -m torch.distributed.launch --nproc_per_node=8 train.py \
## Multi-node Training
ResNet-50 (requires 16 GPUs spliting over 2 nodes for multi-crop training, Top-1 Linear 75.5%)
```
python3 -m torch.distributed.launch --nproc_per_node=8 \
python3 -m torch.distributed.launch --nproc_per_node=8 --use_env \
--nnodes=${WORKER_NUM} \
--node_rank=${MACHINE_ID} \
--master_addr=${HOST} \
Expand All @@ -207,7 +207,7 @@ python3 -m torch.distributed.launch --nproc_per_node=8 \

ResNet-50w2 (requires 32 GPUs spliting over 4 nodes for multi-crop training, Top-1 Linear 77.7%)
```
python3 -m torch.distributed.launch --nproc_per_node=8 \
python3 -m torch.distributed.launch --nproc_per_node=8 --use_env \
--nnodes=${WORKER_NUM} \
--node_rank=${MACHINE_ID} \
--master_addr=${HOST} \
Expand All @@ -223,7 +223,7 @@ python3 -m torch.distributed.launch --nproc_per_node=8 \

DeiT-S (requires 16 GPUs spliting over 2 nodes for multi-crop training, Top-1 Linear 75.6%)
```
python3 -m torch.distributed.launch --nproc_per_node=8 \
python3 -m torch.distributed.launch --nproc_per_node=8 --use_env \
--nnodes=${WORKER_NUM} \
--node_rank=${MACHINE_ID} \
--master_addr=${HOST} \
Expand All @@ -250,7 +250,7 @@ python3 -m torch.distributed.launch --nproc_per_node=8 \

ViT-B (requires 32 GPUs spliting over 4 nodes for multi-crop training, Top-1 Linear 77.3%)
```
python3 -m torch.distributed.launch --nproc_per_node=8 \
python3 -m torch.distributed.launch --nproc_per_node=8 --use_env \
--nnodes=${WORKER_NUM} \
--node_rank=${MACHINE_ID} \
--master_addr=${HOST} \
Expand Down

0 comments on commit c14cadc

Please sign in to comment.