Update README.md

sunnweiwei · Apr 20, 2023 · 5125c8e · 5125c8e
1 parent bf46bcd
commit 5125c8e
Showing 1 changed file with 13 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -145,6 +145,19 @@ python specialization.py \
 --do_eval true
 ```
 
+or run with multi-gpus, using [accelerate](https://github.com/huggingface/accelerate):
+
+```bash
+accelerate launch --num_processes 4 specialization.py \
+--model microsoft/deberta-v3-base \
+--loss rank_net \
+--data data/marco-train-10k.jsonl \
+--permutation marco-train-10k-gpt3.5.json \
+--save_path out/deberta-10k-rank_net \
+--do_train true \
+--do_eval true
+```
+
 ### Evalaute the trained specialized model
 
 ```bash