Update README.md

baueraj · Apr 15, 2024 · 7b412ae · 7b412ae
1 parent a1cf964
commit 7b412ae
Showing 1 changed file with 19 additions and 17 deletions.
diff --git a/demo/README.md b/demo/README.md
@@ -1,3 +1,22 @@
+
+## WizardLM Inference Demo
+
+We provide the inference demo script for **WizardLM-Family**.
+
+1. According to the instructions of [Llama-X](https://github.com/AetherCortex/Llama-X), install the environment.
+2. Install these packages:
+```bash
+pip install transformers
+pip install vllm
+```
+3. Enjoy your demo:
+```bash
+CUDA_VISIBLE_DEVICES=0 python wizardLM_demo.py \
+   --base_model "xxx/path/to/wizardLM_7b_model" \
+   --n_gpus 1
+```
+
+
 ## WizardCoder Inference Demo
 
 We provide the inference demo script for **WizardCoder-Family**.
@@ -34,20 +53,3 @@ CUDA_VISIBLE_DEVICES=0 python wizardmath_demo.py \
    --base_model "xxx/path/to/wizardmath_7b_model" \
    --n_gpus 1
 ```
-
-## WizardLM Inference Demo
-
-We provide the inference demo script for **WizardLM-Family**.
-
-1. According to the instructions of [Llama-X](https://github.com/AetherCortex/Llama-X), install the environment.
-2. Install these packages:
-```bash
-pip install transformers==4.31.0
-pip install vllm==0.1.4
-```
-3. Enjoy your demo:
-```bash
-CUDA_VISIBLE_DEVICES=0 python wizardLM_demo.py \
-   --base_model "xxx/path/to/wizardLM_7b_model" \
-   --n_gpus 1
-```