Update README.md

Signed-off-by: bojiang <5886138+bojiang@users.noreply.github.com>
bentoml · Oct 19, 2024 · 42e4c47 · 42e4c47
1 parent 74a1d12
commit 42e4c47
Showing 1 changed file with 7 additions and 1 deletion.
diff --git a/README.md b/README.md
@@ -49,7 +49,13 @@ For the full model list, see the [OpenLLM models repository](https://github.com/
 To start an LLM server locally, use the `openllm serve` command and specify the model version.
 
 > [!NOTE]
-> If you are deploying a gated models, make sure to set HF_TOKEN in enviroment variables
+> OpenLLM does not store model weights. A Hugging Face token (HF_TOKEN) is required for gated models.
+> 1. Create your Hugging Face token [here](https://huggingface.co/settings/tokens).
+> 2. Request access to the gated model, such as [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B).
+> 3. Set your token as an environment variable by running:  
+>    ```bash
+>    export HF_TOKEN=<your token>
+>    ```
 
 ```bash
 openllm serve llama3:8b