Search results

Segmentation Fault error when crafting pb_utils.Tensor object Triton BLS model

Status: Open.

#7953 In triton-inference-server/server;

· carldomond7 opened on Jan 18, 2025

Failed to launch triton-server：”error: creating server: Internal - failed to load all models“

module: backendsIssues related to the backendsIssues related to the backends

Status: Open.

#7950 In triton-inference-server/server;

· pzydzh opened on Jan 17, 2025

build.py broken in r24.11

Status: Open.

#7939 In triton-inference-server/server;

· prm-james-hill opened on Jan 15, 2025

Triton crashes with SIGSEGV

crashRelated to server crashes, segfaults, etc.Related to server crashes, segfaults, etc.

Status: Open.

#7938 In triton-inference-server/server;

· ctxqlxs opened on Jan 15, 2025

[Question] Are the libnvinfer_builder_resources necessary in the triton image ?

Status: Open.

#7932 In triton-inference-server/server;

· MatthieuToulemont opened on Jan 14, 2025

Server build with python BE failing due to missing Boost lib

Status: Open.

#7925 In triton-inference-server/server;

· buddhapuneeth opened on Jan 9, 2025

How to get access to the vllm backend model

Status: Open.

#7916 In triton-inference-server/server;

· lianyiyi opened on Jan 3, 2025

running triton as a inference service on host

Status: Open.

#7915 In triton-inference-server/server;

· sriram-dsl opened on Jan 3, 2025

OpenAI-Compatible Frontend should support world_size larger than 1

enhancementNew feature or requestNew feature or request

Status: Open.

#7914 In triton-inference-server/server;

· cocodee opened on Jan 3, 2025

vllm_backend: What is the right way to use downloaded model + model.json together?

Status: Open.

#7912 In triton-inference-server/server;

· kyoungrok0517 opened on Jan 2, 2025

Detected NVIDIA NVIDIA GeForce RTX 4090 D GPU, which is not yet supported in this version of the container

Status: Open.

#7911 In triton-inference-server/server;

· mailliw2010 opened on Jan 2, 2025

Python backend with multiple instances cause unexpected and non-deterministic results

Status: Open.

#7907 In triton-inference-server/server;

· NadavShmayo opened on Dec 25, 2024