oroszgy / spaCy-tokenizer-benchmark Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

Quick and dirty scripts to measure the performance of spaCy

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
README.md		README.md
benchmark_spacy.py		benchmark_spacy.py
download_corpus.sh		download_corpus.sh
transform_corpus.py		transform_corpus.py

Repository files navigation

SpaCy tokenizer benchmark

Introduction

Quick and dirty scripts to measure the performance of spaCy

Prepare the data

$ download_corpus.sh
$ python3 transform_corpus.py

Run the benchmark

$ python3 benchmark_spacy.py

About

Quick and dirty scripts to measure the performance of spaCy

python nlp benchmark natural-language-processing tokenizer spacy

Report repository

Releases

No releases published

Packages

No packages published

Languages