Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Remove tail latency in MonoVertex when transformation is involved #2247

Open
yhl25 opened this issue Dec 2, 2024 · 0 comments
Open

Remove tail latency in MonoVertex when transformation is involved #2247

yhl25 opened this issue Dec 2, 2024 · 0 comments
Assignees
@yhl25
Labels
area/mono-vertex Mono Vertex enhancement New feature or request rust Rust
Milestone
1.5

Comments

@yhl25
Copy link
Contributor

yhl25 commented Dec 2, 2024 •
edited
Loading

Currently, we do transformation in batches which introduces tail latency problem when some of the requests in the batch takes longer time than the others.
@yhl25 yhl25 added enhancement New feature or request rust Rust area/mono-vertex Mono Vertex labels Dec 2, 2024
@yhl25 yhl25 added this to the 1.5 milestone Dec 2, 2024
@yhl25 yhl25 self-assigned this Dec 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@yhl25 yhl25

Labels
area/mono-vertex Mono Vertex enhancement New feature or request rust Rust
Projects
None yet
Milestone
1.5
Development

No branches or pull requests
1 participant
@yhl25