Skip to content
View adbar's full-sized avatar
415 followers · 270 following

Achievements

Achievement: Galaxy BrainAchievement: Pair ExtraordinaireAchievement: Pull Sharkx3Achievement: QuickdrawAchievement: Starstruckx3Achievement: Arctic Code Vault Contributor

Achievements

Achievement: Galaxy BrainAchievement: Pair ExtraordinaireAchievement: Pull Sharkx3Achievement: QuickdrawAchievement: Starstruckx3Achievement: Arctic Code Vault Contributor

Organizations

@deutschestextarchiv

Block or report adbar

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Please don't include any personal information such as legal names or email addresses. Maximum 100 characters, markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
adbar/README.md

Hi there! 👋

Github stars Youtube channel views

⚡  Web  ✍  Blog  ☕  Coffee

I'm a data engineer and scientist specializing in natural language processing. On Github I'm the author and maintainer of projects like Trafilatura, a popular open-source package to gather and extract text data used by researchers and the AI industry.

Most Popular Blog Posts

Open-Source Tech Stack

Skills Programming languages
Open source skills Most used languages

Pinned Loading

  1. trafilatura trafilatura Public

    Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML

    Python 3.8k 269

  2. htmldate htmldate Public

    Fast and robust date extraction from web pages, with Python or on the command-line

    Python 121 26

  3. simplemma simplemma Public

    Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

    Python 149 12

  4. py3langid py3langid Public

    Forked from saffsd/langid.py

    Faster, modernized fork of the language identification tool langid.py

    Python 50 9

  5. courlan courlan Public

    Clean, filter and sample URLs to optimize data collection – Python & command-line – Deduplication, spam, content and language filters

    Python 129 9

  6. German-NLP German-NLP Public

    Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

    455 67