Skip to content

Commit

Permalink
Add Masked language modeling with Bert example (#244)
Browse files Browse the repository at this point in the history
* Masked language modeling example

* format code

* train_step workflow and utility func implemented

* mlm and fine tune with bert from scratch

I have implemented Mask Language Model and Fine-tune model with bert from scratch using tf-nightly

* updated according to review feedback

* file formatted

* text paragraph added and refactored

* Copyediting, fix fine-tuning logic

* refactored and formatted

* refactored accordingly

* Copyediting, refactor loss_fn

* generated files added

* formating

Co-authored-by: François Chollet <francois.chollet@gmail.com>
  • Loading branch information
Ankur3107 and fchollet authored Sep 23, 2020
1 parent 7b9aa18 commit f553517
Show file tree
Hide file tree
Showing 3 changed files with 1,881 additions and 0 deletions.
Loading

0 comments on commit f553517

Please sign in to comment.