Search results

Urls that redirect gets ignored by htmlLinkParser

Status: Open.

#48 In brendonboshell/supercrawler;

· tkjaergaard opened on Apr 8, 2020

Crawling last x URL's

Status: Open.

#47 In brendonboshell/supercrawler;

· cigolpl opened on Mar 6, 2020

Adding typescript definitions

Status: Open.

#31 In brendonboshell/supercrawler;

· MrRefactoring opened on May 9, 2019

Crawling binary files

Status: Open.

#21 In brendonboshell/supercrawler;

· joshuambg opened on Dec 4, 2018

Ensure Crawler#start can be safely called after Crawler#stop

Status: Open.

#17 In brendonboshell/supercrawler;

· brendonboshell opened on Jul 24, 2018

Expose response object

Status: Open.

#15 In brendonboshell/supercrawler;

· HaNdTriX opened on Apr 18, 2018

Script doesn't exit when using RedisUrlList

Status: Open.

#7 In brendonboshell/supercrawler;

· simoncpu opened on Oct 9, 2017