Search results

ROCm support missing from Dockerfile

module: rocm

Status: Open.

#3380 In pytorch/serve;

· jakki-amd opened on Jan 7, 2025

Clarify interactions between TorchServe and KServe

Status: Open.

#3378 In pytorch/serve;

· kimminw00 opened on Dec 26, 2024

Torchserve-kfs docker images for other python version (3.10+)

Status: Open.

#3374 In pytorch/serve;

· cjidboon94 opened on Dec 12, 2024

vLLM ZeroDivisionError

Status: Open.

#3373 In pytorch/serve;

· mfahadyousaf opened on Dec 10, 2024

Quickstart vLLM examples do not work as expected

Status: Open.

#3365 In pytorch/serve;

· prashant-warrier-echelonvi opened on Nov 18, 2024

Unable to build frontend after following the documentation

Status: Open.

#3364 In pytorch/serve;

· mihaidusmanu opened on Nov 11, 2024

Trying to find a doc explaining how the scaling works (min_worker to max_worker)

Status: Open.

#3362 In pytorch/serve;

· lschaupp opened on Nov 9, 2024

Issue when sending parallel requests

Status: Open.

#3361 In pytorch/serve;

· lschaupp opened on Nov 8, 2024

weights_only default flip for torch.load

Status: Open.

#3360 In pytorch/serve;

· mikaylagawarecki opened on Nov 7, 2024

Low Throughput and High Latency with TorchServe Deployment on AWS

Status: Open.

#3359 In pytorch/serve;

· dummyuser-123 opened on Nov 6, 2024

Model & Instance scaling

Status: Open.

#3358 In pytorch/serve;

· markcNewell opened on Nov 5, 2024

413 Request Entity Too Large

Status: Open.

#3357 In pytorch/serve;

· pengxin233 opened on Nov 5, 2024