-
Notifications
You must be signed in to change notification settings - Fork 3.4k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ref: adding compute environments (1/n) #3837
Conversation
Hello @williamFalcon! Thanks for updating this PR. There are currently no PEP 8 issues detected in this Pull Request. Cheers! 🍻 Comment last updated at 2020-10-04 04:38:16 UTC |
Codecov Report
@@ Coverage Diff @@
## master #3837 +/- ##
======================================
- Coverage 88% 88% -0%
======================================
Files 111 115 +4
Lines 8812 8882 +70
======================================
+ Hits 7769 7795 +26
- Misses 1043 1087 +44 |
def __init__(self, world_size): | ||
super().__init__(world_size) | ||
|
||
def master_address(self): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
shall it be rather a property?
port = os.environ.get('MASTER_PORT') | ||
return port | ||
|
||
def world_size(self): |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
this probably also does not change during training, so a property?
@@ -0,0 +1,13 @@ | |||
class ClusterEnvironment: |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
to the file general - missing Licence
@@ -0,0 +1,3 @@ | |||
from pytorch_lightning.cluster_environments.cluster_environment import ClusterEnvironment |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
can we rename this package just to environments
as TE is not a true cluster and there may be another non cluster evns
ref: adding compute environments (1/n)