Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
Signed-off-by: bojiang <5886138+bojiang@users.noreply.github.com>
  • Loading branch information
bojiang authored Oct 19, 2024
1 parent fd5380b commit 74a1d12
Showing 1 changed file with 5 additions and 0 deletions.
5 changes: 5 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -19,6 +19,8 @@ pip install openllm # or pip3 install openllm
openllm hello
```



![hello](https://github.com/user-attachments/assets/5af19f23-1b34-4c45-b1e0-a6798b4586d1)

## Supported models
Expand Down Expand Up @@ -46,6 +48,9 @@ For the full model list, see the [OpenLLM models repository](https://github.com/

To start an LLM server locally, use the `openllm serve` command and specify the model version.

> [!NOTE]
> If you are deploying a gated models, make sure to set HF_TOKEN in enviroment variables
```bash
openllm serve llama3:8b
```
Expand Down

0 comments on commit 74a1d12

Please sign in to comment.