Update README.md

LeonVanHout · Sep 1, 2023 · f0ae44c · f0ae44c
1 parent 5648be6
commit f0ae44c
Showing 1 changed file with 17 additions and 0 deletions.
diff --git a/demo/README.md b/demo/README.md
@@ -34,3 +34,20 @@ CUDA_VISIBLE_DEVICES=0 python wizardmath_demo.py \
    --base_model "xxx/path/to/wizardmath_7b_model" \
    --n_gpus 1
 ```
+
+## WizardLM Inference Demo
+
+We provide the inference demo script for **WizardLM-Family**.
+
+1. According to the instructions of [Llama-X](https://github.com/AetherCortex/Llama-X), install the environment.
+2. Install these packages:
+```bash
+pip install transformers==4.31.0
+pip install vllm==0.1.4
+```
+3. Enjoy your demo:
+```bash
+CUDA_VISIBLE_DEVICES=0 python wizardLM_demo.py \
+   --base_model "xxx/path/to/wizardLM_7b_model" \
+   --n_gpus 1
+```