Search results

[Bug]: Llama-3.2-11B-Vision-Instruct: block table already exists

bugSomething isn't workingSomething isn't working

Status: Open.

#55 In tenstorrent/vllm;

· tstescoTT opened on Jan 23, 2025

[Bug]: max_seqs_in_batch=1 induces a FATAL

bugSomething isn't workingSomething isn't working

Status: Open.

#54 In tenstorrent/vllm;

· rpavlovicTT opened on Jan 18, 2025

[Bug]: Sending /v1/completions API request to TtMllamaForConditionalGeneration model crashes model backend

bugSomething isn't workingSomething isn't working

Status: Open.

#53 In tenstorrent/vllm;

· tstescoTT opened on Jan 17, 2025

[Feature]: handle request parameter best_of=1

enhancementNew feature or requestNew feature or request

Status: Open.

#44 In tenstorrent/vllm;

· tstescoTT opened on Dec 13, 2024

[Feature]: [TT devices] Support different top-pk parameters in the same batch

P1

enhancementNew feature or requestNew feature or request

Status: Open.

#42 In tenstorrent/vllm;

· skhorasganiTT opened on Dec 10, 2024

[Feature]: Support for logprobs sampling parameter in TT backend

enhancementNew feature or requestNew feature or request

good first issueGood for newcomersGood for newcomers

Status: Open.

#37 In tenstorrent/vllm;

· milank94 opened on Nov 23, 2024