Hi, this is Anshuman. I love scraping, crawling and getting data from various dom structures. I have 6 yrs of experience in scraping, crawling, processing and mining data.
My previous projects include-
1. Automated Crawling of Google for SEO Keywords
2. E-Commerce Crawling. Crawling websites like Amazon, Ebay,Alibaba etc.
3. E-mail list scraping and phone number scraping for targeted users
4. Scraping Data from within Android Apps
5. Dynamic Data crawling through JS Manipulation
6. Automated Form Filling and Scraping
7. Proxy Emulation and Authentication in order to prevent server blocking
8. Mobile Site emulation and crawling mobile site specifically
9. Scraping data from Desktop Apps, PDFs etc.
10. Artificial Intelligence to emulate human behaviour while crawling and scraping sites
Programming Languages I can use - Python, PHP, NodeJS, Jquery and Rails.
Frameworks I have been using - Python Scrapy, Apache Nutch, Selenium, DOM Manipulation using Chrome Extensions, URLLib2, Python Requests, PHP Syphony etc.
Data Can be exported to- Excel Files, MySQL, MongoDB, CouchDB, Cassendra, Redis, Docx. File, Amazon s3, HDFS, Oracle, MSSQL etc.
I have read your project description and I think I would be the right person to do your project. I will ensure great communication throughout the project with timely updates about the progress of the project. I would like to have a chat with you about the project and discuss more about how I will be approaching this task. Ping me and lets get started.
Thanks :)