Curate proxies from various sources in terms of latency. Supported on python 2.7.* and >3.4.
>> from letmecrawl import letmecrawl
>> for proxy in letmecrawl():
>> print(proxy)
88.99.11.10:6666pip install letmecrawlUse docker image as a http service:
docker pull montenegrodr/letmecrawl:latestRunning:
docker run -p 8000:8000 montenegrodr/letmecrawl:latestRequest proxy from top of the queue:
$ curl localhost:8000
{"proxy":"138.68.178.106:80"}
$ curl localhost:8000
{"proxy":"184.59.102.95:80"}