Skip to content
Assign

FEAT: Xavier: Share KV cache between VLLM replicas #3810

Sign in to view logs

FEAT: Xavier: Share KV cache between VLLM replicas

FEAT: Xavier: Share KV cache between VLLM replicas #3810

Triggered via issue January 10, 2025 09:21
@codingl2k1codingl2k1
commented on #2732 d347956
Status Success
Total duration 11s
Artifacts –

assign.yaml

on: issue_comment
issue_assign
0s
issue_assign
Fit to window
Zoom out
Zoom in