MNBVC(Massive Never-ending BT Vast Chinese corpus)超大规模中文语料集。对标chatGPT训练的40T数据。MNBVC数据集不但包括主流文化，也包括各个小众文化甚至火星文的数据。MNBVC数据集包括新闻、作文、小说、书籍、杂志、论文、台词、帖子、wiki、古诗、歌词、商品介绍、笑话、糗事、聊天记录等一切形式的纯文本中文数据。
-
Updated
Nov 2, 2024
#
corpus-data
Here are 163 public repositories matching this topic...
ChatGPT 中文语料库 对话语料 小说语料 客服语料 用于训练大模型
-
Updated
May 15, 2024
地球上最全的华语现代诗歌语料库，3k+诗人，80K+诗歌，15M+字
-
Updated
Aug 1, 2023 - Python
A curated list of Open Information Extraction (OIE) resources: papers, code, data, etc.
nlp
data-science
natural-language-processing
big-data
ai
nlu
extract-information
information-extraction
datascience
dataset
papers
corpus-data
nlp-apis
nlp-resources
openie
relation-extraction
natural-language-understanding
open-information-extraction
literature-review
oie-systems
-
Updated
Oct 25, 2022
chinese NLP corpus of chinese science fiction,chinese science fiction corpus : About 4675 Chinese science fiction novels 大约有4675本科幻小说，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
nlp
corpus
science-fiction
scifi
chinese-nlp
corpus-data
datasets
nlp-resources
nlp-machine-learning
nlp-datasets
-
Updated
Oct 22, 2022
UA-GEC: Grammatical Error Correction and Fluency Corpus for the Ukrainian Language
natural-language-processing
corpus
dataset
corpus-data
corpus-tools
gec
nlp-datasets
grammatical-error-correction
ukrainian-language
-
Updated
Feb 11, 2024 - Macaulay2
chinese NLP corpus of chinese science fiction, chinese science fiction corpus: Archive of the Ark Plan of Ula Science Fiction Website 乌拉科幻小说网方舟计划存档，中文科幻小说自然语言处理语料库，中文科幻小说文本语料库，中文科幻小说文本数据库，科幻小说语料
nlp
corpus
science-fiction
scifi
chinese-nlp
corpus-data
datasets
nlp-resources
nlp-machine-learning
nlp-datasets
-
Updated
Oct 22, 2022
Utilities for Processing the Switchboard Dialogue Act Corpus
dialogue
corpus
corpus-data
corpus-tools
switchboard
dialogues
corpus-processing
dialogue-data
switchboard-corpus
dialogue-act
-
Updated
Jan 24, 2021 - Python
文本去重
-
Updated
May 23, 2024 - Python
DANeS is an open-source E-newspaper dataset by collaboration between DATASET JSC (dataset.vn) and AIV Group (aivgroup.vn)
open-source
machine-learning
natural-language-processing
corpus
artificial-intelligence
dataset
newspaper
corpus-data
text-sentiment
danes
datasetvn
aivgroup
-
Updated
May 11, 2022 - Python
Biomedical NLP Corpus or Datasets.
nlp
natural-language-processing
text-mining
bioinformatics
dataset
named-entity-recognition
corpus-data
medical-informatics
-
Updated
Apr 26, 2022
A parser for annotated MuseScore 3 files.
tsv
parser
corpus
xml-parsing
xml-parser
corpus-data
music-score
sheet-music
musescore
music-scores
corpus-generator
corpus-tools
xml-parser-library
corpus-processing
tsv-format
musescore2
tsv-files
musescore3
sheet-music-parser
musescore4
-
Updated
Sep 26, 2024 - Python
Reading the data from OPIEC - an Open Information Extraction corpus
nlp
natural-language-processing
wiki
wikipedia
corpus
information-extraction
dataset
corpora
corpus-data
nlp-resources
wikipedia-dump
corpus-tools
natural-language-understanding
open-information-extraction
dataset-interface
wikipedia-corpus
corpus-processing
nlp-datasets
-
Updated
Jun 12, 2019 - Java
粵文語料篩選器 Cantonese text filter
-
Updated
Sep 5, 2024 - Python
CCNC: A Comprehensive Chinese Name Corpus (3.65M name samples). 大型中文姓名语料库 (内含365万姓名语例)。
-
Updated
Jun 28, 2021 - Jupyter Notebook
Improve this page
Add a description, image, and links to the corpus-data topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the corpus-data topic, visit your repo's landing page and select "manage topics."