Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Multiple qps timeouts/failures #9499

Closed
muxi opened this issue Jan 30, 2017 · 7 comments
Closed

Multiple qps timeouts/failures #9499

muxi opened this issue Jan 30, 2017 · 7 comments
Assignees
@vjpai @jtattermusch @ctiller
Labels
disposition/BUILDNURSE For all buildnurse related build/test failures and flakes priority/P0

Comments

@muxi
Copy link
Member

muxi commented Jan 30, 2017

In https://grpc-testing.appspot.com/job/gRPC_performance_pull_requests/8839/consoleFull

Failed tests include:
ruby_protobuf_sync_streaming_qps_unconstrained
ruby_protobuf_sync_unary_qps_unconstrained
ruby_protobuf_unary_ping_pong
node_protobuf_async_unary_qps_unconstrained
node_protobuf_unary_ping_pong
csharp_generic_async_streaming_ping_pong
csharp_protobuf_async_streaming_ping_pong
csharp_protobuf_async_unary_ping_pong
csharp_protobuf_sync_to_async_unary_ping_pong
csharp_protobuf_async_unary_qps_unconstrained
csharp_to_cpp_protobuf_sync_unary_ping_pong
csharp_to_cpp_protobuf_async_streaming_ping_pong
@muxi muxi added the disposition/BUILDNURSE For all buildnurse related build/test failures and flakes label Jan 30, 2017
@muxi muxi mentioned this issue Jan 30, 2017
Merged
@dgquintas
Copy link
Contributor

Seen again #9508

@dgquintas dgquintas mentioned this issue Jan 30, 2017
Merged
@y-zeng y-zeng mentioned this issue Jan 31, 2017
Merged
@jtattermusch jtattermusch mentioned this issue Jan 31, 2017
Merged
@rjshade rjshade mentioned this issue Jan 31, 2017
Merged
@yang-g yang-g mentioned this issue Jan 31, 2017
Merged
@muxi muxi mentioned this issue Feb 1, 2017
Merged
@y-zeng y-zeng mentioned this issue Feb 1, 2017
Merged
This was referenced Feb 2, 2017
Merged
Merged
Merged
Merged
Merged
@muxi muxi mentioned this issue Feb 6, 2017
Merged
@sreecha sreecha mentioned this issue Feb 6, 2017
Merged
This was referenced Feb 7, 2017
Merged
Merged
@dgquintas
Copy link
Contributor

dgquintas commented Feb 7, 2017 •
edited
Loading

This is happening repeatedly in the performance tests.

Test instances that fail usually have:

Connect failed: 
{"created":"@1486406714.156364046",
"description":"Failed to connect to remote host: OS Error",
"errno":111,
"file":"src/core/lib/iomgr/tcp_client_posix.c",
"file_line":236,
"os_error":"Connection refused",
"syscall":"connect",
"target_address":"ipv4:127.0.0.1:10100"}

(see https://grpc-testing.appspot.com/job/gRPC_performance_pull_requests/9062/consoleFull)

@muxi muxi mentioned this issue Feb 7, 2017
Merged
@markdroth markdroth mentioned this issue Feb 7, 2017
Merged
This was referenced Feb 7, 2017
Merged
Merged
@ctiller ctiller mentioned this issue Feb 7, 2017
Merged
@jtattermusch jtattermusch mentioned this issue Feb 7, 2017
Merged
@dgquintas dgquintas mentioned this issue Feb 8, 2017
Merged
@ctiller ctiller mentioned this issue Feb 8, 2017
Merged
@ncteisen ncteisen mentioned this issue Feb 8, 2017
Merged
@yang-g yang-g mentioned this issue Feb 8, 2017
Merged
This was referenced Feb 8, 2017
Merged
Closed
@muxi muxi mentioned this issue Feb 8, 2017
Merged
@apolcyn
Copy link
Contributor

apolcyn commented Feb 9, 2017

failure for node_protobuf_async_unary_qps_unconstrained seen in
https://grpc-testing.appspot.com/job/gRPC_performance_pull_requests/9137/testReport/

pr #9612 against master

@markdroth markdroth mentioned this issue Feb 9, 2017
Merged
@dgquintas dgquintas mentioned this issue Feb 9, 2017
Merged
This was referenced Feb 9, 2017
Merged
Merged
@markdroth markdroth mentioned this issue Feb 10, 2017
Merged
@adelez
Copy link
Contributor

adelez commented Feb 11, 2017

Timeout happened with
benchmarks.qps_json_driver.quit and
benchmarks.qps_json_driver.cpp_protobuf_sync_streaming_qps_unconstrained_secure_500kib_resource_quota
https://grpc-testing.appspot.com/job/gRPC_performance_pull_requests/9206/#showFailuresLink

This was referenced Feb 11, 2017
Merged
Closed
@dgquintas
Copy link
Contributor

@apolcyn is the related fix we discussed recently in?

@apolcyn
Copy link
Contributor

apolcyn commented Feb 11, 2017

yeah the failures in the original post at top should be fixed now

@dgquintas
Copy link
Contributor

Duplicate of #9399 and #9668

@lock lock bot locked as resolved and limited conversation to collaborators Oct 2, 2018
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Assignees

@vjpai vjpai

@jtattermusch jtattermusch

@ctiller ctiller

Labels
disposition/BUILDNURSE For all buildnurse related build/test failures and flakes priority/P0
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
7 participants
@dgquintas @muxi @vjpai @apolcyn @jtattermusch @ctiller @adelez