Experienced Python Developer Needed for Advanced Web Scraping Script

€250-750 EUR

Closed

Posted

4 months ago

€250-750 EUR

Paid on delivery

Project Overview We are seeking an experienced Python developer to create a sophisticated web scraping script. The primary goal is to extract business information from various online sources, starting with Google Maps and expanding to other platforms. Note that we only need the scraping script itself, as we have team members handling the backend, frontend, and cloud infrastructure. Key Responsibilities 1. Develop a robust web scraping script using Python (and JavaScript if necessary) to extract business data from Google Maps. 2. Implement features to search for businesses within a specified radius of a given location. 3. Extend the scraper's capabilities to gather additional information from other online sources such as Facebook, Instagram, TikTok, and business directories. 4. Ensure the scraper can handle dynamic web content and pagination. 5. Implement data cleaning and structuring functions within the script. 6. Develop the script in a way that it can be easily integrated into our existing systems. 7. Implement error handling and logging within the script. 8. Optimize the scraper for performance and scalability. Required Skills and Experience - Proficient in Python programming - Experience with JavaScript (for handling dynamic content if necessary) - Extensive experience with web scraping libraries such as Selenium, BeautifulSoup, or Scrapy - Strong understanding of HTML, CSS, and JavaScript - Experience in handling dynamic web content and AJAX-based websites - Familiarity with anti-scraping techniques and how to overcome them - Knowledge of proxy rotation and request rate limiting - Experience with data cleaning and structuring - Strong problem-solving skills and attention to detail Preferred Qualifications - Experience scraping data from Google Maps and social media platforms - Knowledge of legal and ethical considerations in web scraping Project Deliverables 1. A fully functional web scraping script that can extract business information from Google Maps and other specified online sources. 2. Clean, well-documented, and maintainable code. 3. A detailed guide on how to use and maintain the script. 4. Documentation of any dependencies or setup required to run the script. Script Requirements - The script should be able to run independently of any specific backend or frontend. - It should output data in a standardized format (e.g., JSON) that can be easily consumed by various systems. - The script should be configurable via command-line arguments or a configuration file. Timeline The development of the script is expected to take 3-6 weeks. We may require ongoing collaboration for maintenance and feature additions based on performance. Please include in your proposal: 1. Your relevant experience and portfolio, specifically highlighting web scraping projects 2. Your approach to developing this scraping script 3. Estimated timeline and milestones 4. Your rate and availability We look forward to working with a skilled developer who can deliver a robust and efficient web scraping solution!

Project ID: 38574028

About the project

69 proposals

Remote project

Active 3 mos ago

Looking to make some money?

Email address

Benefits of bidding on Freelancer

Set your budget and timeframe

Get paid for your work

Outline your proposal

It's free to sign up and bid on jobs

69 freelancers are bidding on average €513 EUR for this job

@MashoodurRehman1

I am an experienced Python developer specializing in advanced web scraping. I have a strong portfolio of successful web scraping projects and extensive knowledge of Python, JavaScript, and web scraping libraries. My approach involves creating a robust scraping script with a focus on performance, scalability, and handling dynamic content. I estimate the development timeline to be 3-6 weeks and am available for ongoing collaboration. My rate is competitive and I am dedicated to delivering a top-notch solution.

€637 EUR in 5 days

5.0

(210 reviews)

8.1

@schoudhary1553

Top 1% in Freelancer.com Hi, Greetings! ✅checked your project details: ✅Completed Time: In project deadline We have worked on 900 + Projects. I have 6 + years of the experience in same kind of projects. If you are looking for a true Freelancer, I am the Right person for you. I am available almost 24-7 and am very responsive. I feel proud that I am a trusted Freelancer who pleases almost every single client. You can rest assure, your work will be delivered well in advance of others, with passion and accuracy. I guarantee you instant communication & responses when you need me. Why choose me? I think every client is the reason for my success. I only take projects which I am sure I can do quickly. My Portfolio Items: https://www.freelancer.com/u/schoudhary1553 I would really like to work with you on this project. If interested, Kindly contact me via chat for further details and discussion. Thank you Sandeep

€500 EUR in 7 days

4.9

(176 reviews)

7.6

@LiveExperts

Hi there , I have skimmed thorough the attachment on your project I'm bidding on your project "Experienced Python Developer Needed for Advanced Web Scraping Script". Let's dive in and have a meeting I am expert in this area. please leave a message on my chat so we can discuss the budget and deadline of the project. I have read your project description and i'm confident i can do this project for you perfectly. Regards, Usama ..

€750 EUR in 2 days

4.9

(34 reviews)

7.2

@ZohaibRoy

❇️ Advanced Web Scraping Script with Dynamic Content Handling ➡️ "Need a powerful web scraping solution to find and organize business info seamlessly? ⏺️ I can create a sophisticated Python script that will gather data from Google Maps and expand to platforms like Facebook, Instagram, and others. The script will manage dynamic content, clean and structure data, and handle pagination efficiently. With my skills in Python, web scraping libraries, and dealing with dynamic web content, you'll get a reliable tool for extracting business data accurately. Let's chat about how I can build this for you and streamline your data collection process!" ### Let's get started! ➡️ Here are some of my relevant Projects: ✅ Google Maps Business Scraper ✅ Facebook Data Extractor ✅ Instagram Business Info Scraper ✅ TikTok Business Profile Scraper ✅ Business Directories Crawler ✅ Selenium Dynamic Content Scraper ✅ Python Data Cleaner and Structurer ✅ AJAX-based Site Scraper ✅ Proxy Rotator for Scraping ✅ JSON Data Formatter --------------------------------- Waiting for your response in chat! Best Regards, Zohaib

€350 EUR in 2 days

4.9

(96 reviews)

7.2

@ahmadayaz

With over a decade of experience, I have a proven track record in Full Stack Development, WordPress, Mobile App Design, SAAS Development, and more. I am skilled in web scraping using Python, BeautifulSoup, and Scrapy, adept at handling dynamic content, and overcoming anti-scraping measures. I specialize in designing scalable solutions, ensuring clean, well-documented code for easy maintenance. I propose a 4-5 week timeline, with iterative milestones for steady progress. My rates are competitive, and I am available to start promptly. Let's collaborate on your web scraping project to extract data from Google Maps and other platforms effectively. Thank you for considering my proposal.

€675 EUR in 5 days

5.0

(20 reviews)

7.0

@dvcontact

Hello Sir, Have you ever wondered how much untapped business data lies hidden on platforms like Google Maps, waiting to be revealed? I am excited to propose my services for your advanced web scraping project. With my extensive experience in Python web scraping, I am equipped to unveil this data treasure trove, starting with Google Maps. My approach includes the following meticulous steps: Here are steps I will take to complete this project: - Develop a robust web scraping script with Python, utilizing Selenium or BeautifulSoup for data extraction. - Implement a search feature to locate businesses within a specified radius on Google Maps. - Extend scraping capabilities to additional platforms like Facebook and Instagram. - Ensure the scraper handles dynamic content, pagination, and implements data structuring functions. - Optimize the script for integration, performance, and scalability, with error handling. To demonstrate my capabilities, I would be delighted to offer a complimentary demonstration script designed to extract real-time data from Google Maps, even before the project is awarded. I am eager to discuss your specific needs and tailor a solution that exceeds your expectations. Let's connect soon to explore this opportunity further. Regards, Smith

€500 EUR in 6 days

4.9

(15 reviews)

5.9

@ashrafsbai6655

Hi there, I checked your requirements and guarantee you that i have relevant experience in Python,ml and data science it's gonna be done within the highest quality . Let's contact via chat so that I can start work immediately

€750 EUR in 1 day

4.9

(38 reviews)

5.6

@Sidrairfan078

Hey, How are you? I have 5+ years of working experience doing IT jobs. I am full stack developer have a strong working experience of every framework specially Selenium, Selenium Webdriver, Web Scraping, Python and JavaScript. Please start chat, So we have a detail discussion regarding to project. And I have read your project details as well. You can check my portfolio as well: https://www.freelancer.com/u/Sidrairfan078 Waiting for your Reply. Thanks! Sidra

€350 EUR in 7 days

5.0

(4 reviews)

5.2

@dataspro

Nice to talk you pascalgrc, After reading in detail the requirements of your project and concluding that they match my areas of knowledge and skills, I would like to introduce myself. My name is Anthony Muñoz and I am the lead engineer for DS Pro IT agency. I have worked for over 10 years in Backend and software development and have successfully done multiple jobs. It will be a pleasure to work together to make your project a reality. Please feel free to contact me. I´m looking forward to working with you. I really appreciate your time and remain attentive to any request or question. Greetings

€998 EUR in 7 days

4.7

(6 reviews)

5.8

@MesbahEma

I can create a robust Python web scraping script tailored to extract business data from Google Maps and other platforms. With experience in handling dynamic content, anti-scraping measures, and data structuring, I will ensure that the script performs efficiently, with features for error handling, proxy rotation, and scalability.

€500 EUR in 7 days

5.0

(8 reviews)

5.4

@aqibnasim

Hi pascalgrc, Your job post 'Experienced Python Developer Needed for Advanced Web Scraping Script' grabbed my attention instantly because it perfectly matches the skill set I work on. Having read the requirements carefully, I am sure I can complete your project very nicely. I have very good experience in your mentioned skills JavaScript, Python, Web Scraping, Selenium Webdriver, Selenium & it makes me 100% confident to deliver you perfect results. Please connect in inbox to discuss more about your interesting project. I'll be available according to Germany's timezone. Best regards Aqib Nasim

€750 EUR in 14 days

5.0

(4 reviews)

5.1

@Pyyetru

Hello, I went through your requirement, and it seems like I am a great fit for this job. I'm an expert who have many years of experience on Python webscraping development. I can finish your job in a month with high quality. Lets connect in chat so that we discuss further. Thank you

€500 EUR in 7 days

5.0

(7 reviews)

5.0

@UmairAnwar93

Hi , this is Umair. I have good experience with JavaScript, Web Scraping, Python, Selenium and Selenium Webdriver. I am a practicing Developer/Designer Since 2015. I can perfectly work on this project regarding Experienced Python Developer Needed for Advanced Web Scraping Script. I can say this with conviction as my all reviews are 5 stars , I can do this task for you and the quality of work would be up to the mark. However, further discussions are required for more clarity. I will wait for your text to discuss the project in further detail. Thanks & Regards Umair A.

€700 EUR in 20 days

5.0

(8 reviews)

5.1

@FaizalShaik80

Hello PascalGRC! Here is the best freelancer to create the scraping script to extract business information from various online sources, starting with Google Maps and expanding to other platforms. I will share my portfolio and experience in our chatting. Please contact me and lets discuss more detail about project. Best regards, Faizal

€500 EUR in 7 days

5.0

(9 reviews)

5.1

@ayesha0124

Hello there, I can help u with this job plz contact and initiate the chat so that we can discuss in detail. I have great experience with JavaScript, Selenium Webdriver, Web Scraping, Selenium and Python. Meanwhile here is my profile: https://www.freelancer.com/u/ayesha0124

€750 EUR in 8 days

5.0

(3 reviews)

4.9

@Mobilehead

I’m excited about the opportunity to develop your advanced web scraping script. I have extensive experience in Python, particularly with web scraping, and have successfully completed a similar project where I extracted business data from Google Maps and various social media platforms. In my previous project, I faced the challenge of navigating dynamic content and dealing with anti-scraping measures. I implemented a robust solution using Selenium and BeautifulSoup, ensuring the scraper could handle pagination and deliver clean, structured data in JSON format. This experience gives me a deep understanding of the complexities involved in scraping, particularly from Google Maps and social media sites. My approach for your project would involve creating a scalable, efficient script with built-in error handling and logging. I will ensure the code is well-documented and easily maintainable while optimizing for performance to handle large data sets. I can deliver the functional script within 4 weeks, with a focus on meeting the outlined requirements. My rate is competitive, and I'm available to start immediately. Looking forward to the possibility of collaborating on this project.

€500 EUR in 7 days

5.0

(4 reviews)

5.0

@Muhammadzeesha59

Hello Sir/MAM I am a skilled full stack developer. Having rich experience in Java , C++ , C , C# , Python , Eclipse , Sql , Mysql , .Net ,Oracle , Object Oriented Programming , Data Structure , Algorithms . I have a perfect grip on “Artificial Intelligence” “Automation” , and work in “Machine Learning” Deep Learning ”. My track record as demonstrated in my 100% job completion and 5-star review rating showcases My ability to deliver exceptional results on time and with utmost quality I believe that my skill set makes me the ideal candidate for this project Please come on chat we will discuss more about this I will be waiting for your reply . Thanks and Best Regards

€251 EUR in 4 days

4.8

(22 reviews)

5.3

@bindmission

Hello, I have 10 years of experience in Python development and web scraping. I am confident that I can develop a sophisticated web scraping script for your project needs. I will ensure the script extracts business information accurately from Google Maps and other platforms. Additionally, I will make sure the script handles dynamic content and pagination effectively. The script will be well-documented and maintainable, including detailed usage instructions and dependencies. I am experienced with libraries such as Selenium, BeautifulSoup, and Scrapy, and can handle anti-scraping techniques. I can meet your timeline of 3-6 weeks and am open to ongoing collaboration for maintenance and feature additions. Please find my portfolio and relevant experience highlighted in my attached proposal. Regards, VishnuLal NB

€750 EUR in 30 days

4.9

(45 reviews)

5.2

@djsmoothy

With a decade of experience as a full-stack developer, I can guarantee you an exceptional service. In my previous roles, I've delivered diverse web scraping projects such as yours. My expertise stretches from proficiently using Python and handling AJAX-based websites to providing top-notch data cleaning and structuring functions. Your project aligns perfectly with my skill set. I'm highly familiar with web scraping libraries like Selenium, BeautifulSoup, and Scrapy, which makes me adept at handling anti-scraping techniques and working around them efficiently. Additionally, my grasp of JavaScript ensures I can effectively manage the dynamic content that your project may require for expansion into platforms such as Facebook, Instagram, TikTok and others. To ensure your project's success, my approach will commence with a thorough needs analysis to determine the best possible strategy for delivering a robust and efficient web scraper script fitting your specific requirements. As for the timeline, I anticipate completing the script within 3-6 weeks in line with your project's needs. My rate is $60/hr and I am available 40 hours per week. Let's actualize your project together by proving why I should be your top candidate!

€750 EUR in 7 days

5.0

(4 reviews)

5.0

@PentabayC

With over 16 years of experience in HTML and CSS website design and development, I am excited to apply for the Experienced Python Developer Needed for Advanced Web Scraping Script. My career has been dedicated to crafting visually appealing and highly functional websites that effectively communicate a brand’s message and enhance user experience. I have a strong background in creating clean, modern designs that are both responsive and user-centric. My proficiency in HTML and CSS. My approach involves a keen eye for detail and a deep understanding of current design trends to create websites that are not only aesthetically pleasing but also highly functional. In addition to my design skills, I am well-versed in managing responsive layouts and optimizing websites for performance across various devices and browsers. My focus is always on delivering a seamless and enjoyable user experience, from initial design to final implementation.

€250 EUR in 5 days