Scrape Data & Email fom Website Directory - Good $$$ - TBB

$99-4001 USD

Completed

Posted

about 9 years ago

$99-4001 USD

Paid on delivery

I need someone who can scrape data from a website for me. The website blocks IP's after a specific number of page request so you must have the experience to know how to get past this using proxies. Not for first-timers. Website: TheBlue [login to view URL] (remove space before book) Example Pages (remove spaces): [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] [login to view URL] HINT: The email address does not show. It is stored in their SQL database but not on the website. If you have an idea on how to get the email, I will pay much more for this data. PM me after you bid so that we can discuss. Scraping the website will not provide the email address unless you have a trick to get it. If you scrape the data and then scrape the email address from the company’s website, the email address will not match the contacts name so do not do that. If you are unable to get access to the emails, I’ll pay a lower fee for the data scrapped from the website. These are the fields I need: Company Name --- (located on the About Us tab) Year Established --- (located on the About Us tab) Annual Volume --- (located on the About Us tab) LEED Experience --- (located on the About Us tab) BIM Experience --- (located on the About Us tab) Number of Employees --- (located on the About Us tab) About Us - Text/Description --- (located on the About Us tab) Main Contact First --- (located on the Locations/Contact Us tab) Main Contact Last --- (located on the Locations/Contact Us tab) Main Contact Title - Under Name when Available --- (located on the Locations/Contact Us tab) Main Contact Phone --- (located on the Locations/Contact Us tab) Main Contact Fax --- (located on the Locations/Contact Us tab) Street --- (located on the Locations/Contact Us tab) City --- (located on the Locations/Contact Us tab) State --- (located on the Locations/Contact Us tab) Zip --- (located on the Locations/Contact Us tab) Phone --- (located on the Locations/Contact Us tab) Fax --- (located on the Locations/Contact Us tab) Website --- (located on the Locations/Contact Us tab) Key Contacts Tab > Contact First Name --- (located on the Key Contacts tab) Key Contacts Tab > Contact Last Name --- (located on the Key Contacts tab) Key Contacts Tab > Title --- (located on the Key Contacts tab) Key Contacts Tab > Phone --- (located on the Key Contacts tab) (Would be nice to have the first few contacts but at least one is needed) Email --- (will pay extra if you find a way to get this as it is stored in SQL only) Blue Book Classifications --- (all, separated by pipe |) (located on the Blue Book Classifications tab) Facebook URL Twitter URL Profile URL --- (the URL to the page where the information is hosted) Do not bid on this project if you have not done similar work using proxies. I need to know you read the full project. To be considered, in your bid, include "I READ THE DETAILS". I anticipate there to be around 1-1.5 million listings. The URL increase in increments of 1 (see sample at top). That method can be used to generate the profile URL's. NOTE: Although my maximum budget is set at $3987, that is only if you are able to get the email addresses. Bids for web data only (no email) should be much lower for consideration. If you have a question that is not covered here, let me know. Thanks

Project ID: 8770655

About the project

13 proposals

Remote project

Active 9 yrs ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

Awarded to:

@mmbertasi

Hi there! I am an expert programmer/webscraper with experience developing custom applications to collect data from well over 100 websites for clients here on Freelancer. I've looked over this project and could deliver the completed data in slightly over a week. I understand your need for the e-mail; however, rest assured their is no way to get it from the bluebook website. That being said I can get you all of the other data using proxy rotation as you mentioned (I rent private proxies to use in my scraping projects) and in addition to providing you with the data, I would provide you with the windows based application I build to get the data as well (which you can use to get an updated version of the data anytime you like). If you decided you wanted to try to get the e-mail from the actual company websites I could incorporate that as well (however I see that is not something you wish to do). I hope to speak with you further about the project. I can be reached on Freelancer anytime; however, I cannot speak with you until you contact me first! Thanks! Mike

$1,000 USD in 10 days

5.0

(102 reviews)

7.2

13 freelancers are bidding on average $1,602 USD for this job

@mantislin

Hi sir, I am scraping expert, I have did too many similar projects, please check my feedback then you will know. Can you tell me more details? then I will provide demo data for you. Thanks, Kimi

$250 USD in 5 days

5.0

(377 reviews)

7.6

@seaanddream

I READ THE DETAILS... Hi, my name is Sevinc. I read your project descriptions carefully before bidding. Thank you for detailed information. I checked the urls as well...I got what you need and ready to go ahead as soon as we can clarify further project details. As you prefer, my bid does not include sraping emails.... I am 5-star web scraping expert here at freelancer.com. Pls check my profile and feedbacks first to have some idea about the quality of my previous business. I had many similar web scraping and dataabse building tasks, including extraction of large contact databases from various online directories, all achieved with 5/5 rating. Kindly get back to me if you wish to proceed with a top-rated and reliable partner here...pls note that I only deliver best quality at a reasonable price, and I am open for longterm partnerships, if you wish too... I am ready to prepare a sample task for you to check, once you five me a reply...regards.

$1,000 USD in 7 days

4.9

(250 reviews)

7.7

@rexzetsolutions

yeah i know how to deals with such cases where u need to scrape the data and after few times your ip getting blocked, i see the website nd i can scrape this, see my reviews i am expert in web scraping

$800 USD in 10 days

4.9

(263 reviews)

7.0

@fhasanbd

Hi, I am a professional web data scraper specialized using Python program, PHP script, .Net program, Crawler and Bot. My tool can search data and get information from Aa to Zz with an existing lists of english words. Below is the link for your reference as a sample related to my tool being developed. This demo will capture doctor's name, address, zip, phone, ratings and reviews in 4 different sites. The final output will be save in *.XLSX format or as your quirement.I can start as early possible depending on your approval and acceptance. In relation to this application, I can rest assured I will impart a high quality and reliable, efficient and accurate with the output. Give me a try and I will try to get the best results and finish the project far before the deadline. Thanks,Ferdous

$2,277 USD in 15 days

4.8

(162 reviews)

7.0

@mirniyazuddin92

Dear Sir/Ma'am, Price and duration will vary depending on actual project. I am a Web research and Data Entry expert. I checked and understood your requirements. I can handle this job very well to your appreciation. I can find and extract the information from different websites into an Excel sheet. I am ready to hear the details of the project more in detail now. I have always created a long-term collaboration with my clients through hard work and quality output for a reasonable price. If you have questions or doubts about anything, please feel free to ask me. Sincerely, Mir

$1,000 USD in 3 days

4.9

(150 reviews)

7.1

@flashsaiful

Hi, I can do this for you. Please send a massage in the PMB for details.......Best Regards flashsaiful

$1,100 USD in 20 days

4.8

(129 reviews)

6.6

@DanielVizcaya91

I READ THE DETAILS - Hello there, I will love to help you out with this project. I don't think it is possible to extract the email address, however I can extract all the other information you need. I have made this before and I know how to handle proxies in order to avoid being banned by the site. My work is characterized to be of really high quality so I know you will be satisfy with the final results. Hope to hear back from you soon. Thanks

$699 USD in 3 days

4.7

(94 reviews)

6.9

@Hurnara362

Sir, I have changed my bid price.thanks...............................................................................................................................

$1,200 USD in 30 days

5.0

(26 reviews)

5.2

@pranotosh

I'm a Web Developer having a lot of experience in Web Searching, Web Scraping, Data Entry, Excel etc. I can assure you 100% accuracy. Please consider my bid. Thanks

$2,000 USD in 10 days

4.9

(25 reviews)

4.5

@rakaatwork

Hello There,, I am interested to work with you on your project, I have immense experience of 5+ years in developing similar projects.I will provide you my best services as needed for this job. I would appreciate if you could give me this opportunity to have further discussions and you would also get to know more about my skills well. I always works on my projects independently and never disappointed my clients. Quickly about me:- - Senior PHP Developer with 5+ years of experience. - Skills : Core PHP, My SQL, Meteor. Js, CakePHP, Angular.js, WordPress, Amazon Cloud Setup, Drupal, API Development, HTML 5, CSS3, JavaScript, j Query, Ajax, XML etc. - Available 40 hours per week. - Result and Product Oriented. I can assure you that I will be able to assist you in your task in time with quality work. I am always available on Email and Skype. Please have a voice or video chat if necessary. I am able to start your project as soon as possible according to you. Thank you for your consideration, I am waiting to be hired in this project to show my skills. Highly Professional, Rakesh Kumar (Senior Software Developer)

$3,333 USD in 30 days

5.0

(2 reviews)

3.6

@fayjur

Hello sir, I am ready to take the project. I went through your project description and got enough expertise to handle and finish your project within in budget and within deadline. Thanks & Regards, Fayjur Rahman

$2,277 USD in 3 days

5.0

(3 reviews)

1.5

@DanPope

I have tools (apps, scripts) that does this with precision and very fast. Should you accept my bid, you'll have results within weeks. I am VERY good in proxies - not sure how many accesses they accept on one IP. It might take a longer time until I change proxies to often. I will try to find a trick to obtain emails, no promise though. Till I succeed, what is your budget for NO email? 1 million page to scrape and format in excel will take more than 10 days (not as these pinheads bid), even with the most sophisticated software, which I have !! Only scraping (no email, no proxies) may take 35 days full 20h/day PC work, for 1 mil pages, ALL AUTOMATIC - not manual. Do the math, pinheads do not. This bid might change according to the information you add. Good Luck! I READ THE DETAILS

$3,888 USD in 30 days