Hi @vblagoje , thanks for adding this 👍

GermEval dataset is currently not available - it seems that they've relaunched the shared task website. This dataset removal will also affect libraries such as Flair or nlp so I will try to find another mirror, thanks for reporting it!

For PoS tagging it would be awesome if you could also report/output accuracy after training - just import accuracy_score from the seqeval package :)

Thanks for the review @stefan-it Let me know if there are any additional suggestions. Perhaps we can add appropriate URLs for the GermEval dataset and remove the chunking example if needed.

This looks great, thanks! Note that there is a big rework of the examples to use the nlp library and Trainer in the pipeline. We're polishing the APIs before we start converting every script. I'll tag you when we get to this one to make sure we don't break anything.

In the meantime, could you take care of the styling issue so we can merge?

Ok @sgugger please do ping me and I'll make sure that all token classification examples work as expected, perhpas I can help with the transition. I am not sure why CI fails for styling, more specifically isort ERROR: examples/token-classification/tasks.py Imports are incorrectly sorted. It passes both on my working laptop and training machine. Could you please tell me how imports are incorrectly sorted in tasks.py ?

It may be because of the dep you're adding to examples. It should probably be added in the known_third_party list here.

Ok @sgugger check_code_quality passes now, but there are other new failures. On a first look, they seem transient/unrelated to this PR?

Looks flaky, re-triggered the CI