Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add task type annotation for pods when EnableGangScheduling is true. #1268

Merged
merged 1 commit into from
Apr 2, 2021

Conversation

jiangkaihua
Copy link
Contributor

Signed-off-by: jiangkaihua jiangkaihua1@huawei.com

Signed-off-by: jiangkaihua <jiangkaihua1@huawei.com>
@aws-kf-ci-bot
Copy link
Contributor

Hi @jiangkaihua. Thanks for your PR.

I'm waiting for a kubeflow member to verify that this patch is reasonable to test. If it is, they should reply with /ok-to-test on its own line. Until that is done, I will not automatically test new commits in this PR, but the usual testing commands by org members will still work. Regular contributors should join the org to skip this step.

Once the patch is verified, the new status will be reflected by the ok-to-test label.

I understand the commands that are listed here.

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@coveralls
Copy link

Coverage Status

Coverage decreased (-0.05%) to 71.429% when pulling d3967a6 on jiangkaihua:master into 8d179f7 on kubeflow:master.

@gaocegege
Copy link
Member

/assign @shinytang6

@google-oss-robot
Copy link

@gaocegege: GitHub didn't allow me to assign the following users: shinytang6.

Note that only kubeflow members, repo collaborators and people who have commented on this issue/PR can be assigned. Additionally, issues/PRs can only have 10 assignees at the same time.
For more information please see the contributor guide

In response to this:

/assign @shinytang6

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Copy link

@william-wang william-wang left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@google-oss-robot
Copy link

@william-wang: changing LGTM is restricted to collaborators

In response to this:

/lgtm

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Copy link
Member

@shinytang6 shinytang6 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

/lgtm

@google-oss-robot
Copy link

@shinytang6: changing LGTM is restricted to collaborators

In response to this:

/lgtm

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

@gaocegege
Copy link
Member

/lgtm

/approve

Thanks for your contribution! 🎉 👍

@google-oss-robot
Copy link

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: gaocegege, jiangkaihua, shinytang6, william-wang

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@gaocegege
Copy link
Member

/ok-to-test

@google-oss-robot google-oss-robot merged commit 3d9e7c8 into kubeflow:master Apr 2, 2021
@@ -55,6 +55,8 @@ const (
labelGroupName = "group-name"
// Deprecated label for backwards compatibility. Has to be removed
labelTFJobName = "tf-job-name"
// volcanoTaskSpecKey task spec key used in pod annotation when EnableGangScheduling is true
volcanoTaskSpecKey = "volcano.sh/task-spec"
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@jiangkaihua I suggest this is better to add the annotation like scheduling.k8s.io/task-spec=ps to announce task type.
This will be consistent with scheduling.k8s.io/group-name. This will make the naming more general and convenient for users. task-spec:ps/trainer is the proper name of distributed training. A general name is more reasonable other than volcano task spec.
/cc @gaocegege

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Should we discuss it with volcano members?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, l think it makes sense, but it needs some modification to volcano.
/cc @jiangkaihua

Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is there any other project may use this annotation?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, Our project will also need to know the task-spec of the pod. More important is that task-spec is the proper name of distributed training. A general name is more reasonable.

@google-oss-robot
Copy link

@shinytang6: GitHub didn't allow me to request PR reviews from the following users: jiangkaihua.

Note that only kubeflow members and repo collaborators can review this PR, and authors cannot review their own PRs.

In response to this:

Yes, l think it makes sense, but it needs some modification to volcano.
/cc @jiangkaihua

Instructions for interacting with me using PR comments are available here. If you have questions or suggestions related to my behavior, please file an issue against the kubernetes/test-infra repository.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

9 participants