Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

enhance: Use stats Handler to record request/response size metrics #36107

Merged

Conversation

congqixia
Copy link
Contributor

@congqixia congqixia commented Sep 9, 2024

Related to #36102

This PR use newly added grpcSizeStatsHandler to reduce calling proto.Size since the request & response size info is recorded by grpc framework.

Related to milvus-io#36102

This PR use newly added `grpcSizeStatsHandler` to
reduce calling `proto.Size` since the request &
response size info is recorded by grpc framework.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
@sre-ci-robot sre-ci-robot added the size/L Denotes a PR that changes 100-499 lines. label Sep 9, 2024
@sre-ci-robot
Copy link
Contributor

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: congqixia

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@mergify mergify bot added dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement ci-passed labels Sep 9, 2024
Copy link

codecov bot commented Sep 9, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 72.63%. Comparing base (9981795) to head (39cefd4).
Report is 3 commits behind head on master.

Additional details and impacted files

Impacted file tree graph

@@            Coverage Diff             @@
##           master   #36107      +/-   ##
==========================================
- Coverage   81.62%   72.63%   -8.99%     
==========================================
  Files        1267     1268       +1     
  Lines      150911   151034     +123     
==========================================
- Hits       123182   109706   -13476     
- Misses      22846    36434   +13588     
- Partials     4883     4894      +11     
Files with missing lines Coverage Δ
internal/distributed/proxy/service.go 85.37% <100.00%> (+0.18%) ⬆️
internal/proxy/impl.go 85.87% <100.00%> (-0.03%) ⬇️
pkg/metrics/grpc_stats_handler.go 100.00% <100.00%> (ø)

... and 245 files with indirect coverage changes

@weiliu1031
Copy link
Contributor

/lgtm

@sre-ci-robot sre-ci-robot merged commit 51870ae into milvus-io:master Sep 9, 2024
15 of 16 checks passed
congqixia added a commit to congqixia/milvus that referenced this pull request Sep 9, 2024
…ilvus-io#36107)

Related to milvus-io#36102

This PR use newly added `grpcSizeStatsHandler` to reduce calling
`proto.Size` since the request & response size info is recorded by grpc
framework.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Sep 10, 2024
…ics (#36107) (#36118)

Cherry-pick from master
pr: #36107 
Related to #36102

This PR use newly added `grpcSizeStatsHandler` to reduce calling
`proto.Size` since the request & response size info is recorded by grpc
framework.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
@congqixia congqixia deleted the enhance/use_stats_record_grpc_size branch September 11, 2024 02:04
chyezh pushed a commit to chyezh/milvus that referenced this pull request Sep 11, 2024
…ilvus-io#36107)

Related to milvus-io#36102

This PR use newly added `grpcSizeStatsHandler` to reduce calling
`proto.Size` since the request & response size info is recorded by grpc
framework.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
congqixia added a commit to congqixia/milvus that referenced this pull request Sep 30, 2024
Previous label case broken by milvus-io#36107, this PR make all inbound label
using label constants from metrics package.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Sep 30, 2024
Previous label case broken by #36107, this PR make all inbound label
using label constants from metrics package.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
congqixia added a commit to congqixia/milvus that referenced this pull request Sep 30, 2024
Previous label case broken by milvus-io#36107, this PR make all inbound label
using label constants from metrics package.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Sep 30, 2024
…36616)

Cherry pick from master
pr: #36613 
Previous label case broken by #36107, this PR make all inbound label
using label constants from metrics package.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
congqixia added a commit to congqixia/milvus that referenced this pull request Oct 28, 2024
Related to milvus-io#36102

Previous PR milvus-io#36107 add grpc inteceptor to observe rpc
stats. Using same strategy, this pr add gin middleware
to observer restful v2 rpc stats.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
congqixia added a commit to congqixia/milvus that referenced this pull request Oct 28, 2024
Related to milvus-io#36102

Previous PR milvus-io#36107 add grpc inteceptor to observe rpc
stats. Using same strategy, this pr add gin middleware
to observer restful v2 rpc stats.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Oct 29, 2024
…37224)

Cherry pick from master
pr: #37223
Related to #36102

Previous PR #36107 add grpc inteceptor to observe rpc stats. Using same
strategy, this pr add gin middleware to observer restful v2 rpc stats.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Oct 29, 2024
Related to #36102

Previous PR #36107 add grpc inteceptor to observe rpc stats. Using same
strategy, this pr add gin middleware to observer restful v2 rpc stats.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
congqixia added a commit to congqixia/milvus that referenced this pull request Oct 29, 2024
…s-io#37223)

Related to milvus-io#36102

Previous PR milvus-io#36107 add grpc inteceptor to observe rpc stats. Using same
strategy, this pr add gin middleware to observer restful v2 rpc stats.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
sre-ci-robot pushed a commit that referenced this pull request Oct 29, 2024
…37223) (#37240)

Cherry pick from master
pr: #37223
Related to #36102

Previous PR #36107 add grpc inteceptor to observe rpc stats. Using same
strategy, this pr add gin middleware to observer restful v2 rpc stats.

Signed-off-by: Congqi Xia <congqi.xia@zilliz.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
approved ci-passed dco-passed DCO check passed. kind/enhancement Issues or changes related to enhancement lgtm size/L Denotes a PR that changes 100-499 lines.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants