Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history 
Signed-off-by: bojiang <5886138+bojiang@users.noreply.github.com>
  • Loading branch information
@bojiang
bojiang authored Dec 10, 2024
1 parent 14660e4 commit 53b07d7
Showing 1 changed file with 0 additions and 3 deletions.
3 changes: 0 additions & 3 deletions README.md
View file
Original file line number Diff line number Diff line change
Expand Up @@ -29,9 +29,6 @@ OpenLLM supports a wide range of state-of-the-art open-source LLMs. You can also

| Model | Parameters | Quantization | Required GPU | Start a Server |
| ---------------- | ---------- | ------------ | ------------- | ----------------------------------- |
| Llama 3.1 | 8B | - | 24G | `openllm serve llama3.1:8b` |
| Llama 3.1 | 8B | AWQ 4bit | 12G | `openllm serve llama3.1:8b-4bit` |
| Llama 3.1 | 70B | AWQ 4bit | 80G | `openllm serve llama3.1:70b-4bit` |
| Llama 3.2 | 1B | - | 12G | `openllm serve llama3.2:1b` |
| Llama 3.2 | 3B | - | 12G | `openllm serve llama3.2:3b` |
| Llama 3.2 Vision | 11B | - | 80G | `openllm serve llama3.2:11b-vision` |
Expand Down

0 comments on commit 53b07d7

Please sign in to comment.