Updating the getting started and docs to be more verbose #167
Conversation
facebook-github-bot
added
the
CLA Signed
There was a problem hiding this comment.
@prigoyal has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
|
@prigoyal has updated the pull request. You must reimport the pull request before landing. |
|
@prigoyal has updated the pull request. You must reimport the pull request before landing. |
There was a problem hiding this comment.
@prigoyal has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
|
@prigoyal has updated the pull request. You must reimport the pull request before landing. |
|
@prigoyal has updated the pull request. You must reimport the pull request before landing. |
There was a problem hiding this comment.
@prigoyal has imported this pull request. If you are a Facebook employee, you can view this diff on Phabricator.
Summary:
## Label smoothing made easier in VISSL
Before this PR, the only way to make it work would be to modify the `labels.py` files or to use the `cutmixup` collator. In some instances, this is rather impractical.
This PR allows to have the label smoothing done by just setting a flag in the loss like this:
```
LOSS:
name: cross_entropy_multiple_output_single_target
cross_entropy_multiple_output_single_target:
ignore_index: -1
label_smoothing: 0.1
```
I also refactored the code a bit:
- added unit tests on the surrounding code
- extracted the criterion from the configuration (allowing to have non framework dependent components)
Pull Request resolved: fairinternal/ssl_scaling#167
Reviewed By: prigoyal
Differential Revision: D29639909
Pulled By: QuentinDuval
fbshipit-source-id: f8348cc801ee7f726b07424342fc8aed74a361c9
No description provided.