Web scraping jobs

I need someone to extract all 887 names and addresses in and around (+25 km) Hannover (Germany) from a for market research purposes. Requirements: - Extracted data should be delivered in a CSV file. - Attention to detail is crucial for data accuracy. - Experience with data extraction or web scraping is highly preferred. Ideal Skills: - Proficient in data extraction and web scraping. - Able to deliver data in a specified format. - Detail-oriented.

I'm on the hunt for a skilled web scraping professional, preferably with Python expertise, to help me gather valuable leads. Key Responsibilities: I will provide the details information in Chat I need more then 2 Millions Leads from Provided list.

I have a Python web scraping code that needs fixing due to a recent update on the website. The code is currently failing at the data extraction phase, specifically with extracting tables and structured data. - Data Extraction: The code is unable to retrieve the necessary data from the website. - Data Type: The focus is primarily on extracting tables and structured data. - Data Usage: The extracted data will need to be saved as CSV and Excel.. Ideally, the freelancer for this project should have substantial experience with Python, web scraping and database management. Familiarity with the site would be a plus. Please provide examples of similar projects you have completed in your bid.

Budget $600.0 Time limit: 3 days per Milestone. You will collect several millions of record from thousands of websites and online resources this Main project but you must win the contest in the link below before you can apply for this main $600.00 Project. https://www.freelancer.com/contest/Data-Collection-Contest-2501765/details

... iv) Entrepreneurship v) Sciences 4. No duplicate contact is allowed. Submit your deliverable 100,000 rows populated according to these requirements on the Excel sheet I provided. 5. Finding the URL, writing script or using any other form of tools, platform, VPN, are your responsibilities. 6. It is not possible to do this job manually. You have to automate it by writing and running web scraping script or use 3rd party App or platform. 7. For the list of educational institutions, online resources and the Excel sheet see in the link below. Collect twice as many contacts from the 3 universities listed in green color. Main Project: The purpose of this contest is to filter out 90% of the incompetent

I need a freelancer to gather the contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the websi...

...tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Airtable. - Ability to deliver deeply differentiated and unique data sets. - Strong attention to detail and ability to follow specific data upload formats. Please include in your proposal examples of previous similar projects you have completed, or share two SaaS pricing models

I need a freelancer to gather the contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the websi...

Project Description: I am looking to hire a developer to create a bot that can monitor specific websites for changes or updates. The bot should continuously check the designated websites and immediate...when changes are detected. Use Python with Selenium or a similar technology for automation. Allow easy configuration of websites, conditions, and email settings. Deliverables: A fully functional bot script. Instructions for setting up and running the bot on my machine. Assistance with initial setup if required. Preferred Skills: Strong experience with Python and Selenium. Familiarity with web scraping and automation. Experience with email notifications (SMTP). If you're interested in this project, please provide examples of similar work you've done and your estimat...

We are seeking a talented Scraping API Developer with expertise in Beautiful Soup and other web scraping tools to join our team. The ideal candidate will be responsible for developing efficient and reliable scraping solutions to extract data from various websites and APIs. Key Responsibilities: Design, develop, and maintain web scraping scripts using Beautiful Soup, Selenium, and other tools Create and optimize scraping APIs to automate data extraction processes Ensure data integrity and accuracy in the extraction process Monitor and troubleshoot existing scraping scripts to ensure ongoing functionality Collaborate with team members to define scraping requirements and objectives Stay up-to-date with the latest trends and best...

I'm seeking a programmer to create a data extraction tool that search TripAdvisor reviews, Facebook and Google reviews. The program should specifically focus on gathering:l and sabing - Ratings and scores - User comments and feedback - Dates of reviews The extracted data should be formatted into an Excel file. Ideal candidates for this project should have experience with developing web scraping tools, data extraction software, and a solid understanding of how to navigate and extract information from TripAdvisor. Programming skills in Python, R or similar languages are highly desirable. Program should execute search on different keywords like: restaurant vegan, restaurant London, kids activity in Paris and so on, to extract contact data like: nane, website, phone, em...

I am looking for an experienced freelancer to scrape auto parts store data across 7,500 towns in the USA . The freelancer will be responsible for scraping the following information from Google search results: - Store name and address - Contact information - Website (if any) - Contact person's name (if available) The towns / cities names will be provided in an Excel sheet, and the freelancer will need to: Search for auto parts stores in each town via Google. Scrape the relevant data (store name, contact number, address, website). Compile and organize the scraped data into an Excel file. Requirements: Experience with web scraping and the use of tools like Selenium, BeautifulSoup, or Scrapy. Experience using Google Custom Search API or SerpApi to extract struct...

I'm in need of a web scraping expert who can extract specific data from online retailers of windscreen wiper blades. Data to be Scraped: - Make and model of the vehicle - Year of the vehicle - Size of the wiper blade - Whether it's for the rear wiper Ideally, you should have: - Proficiency in web scraping tools and programming languages such as Python - Experience with data analysis - Ability to present the data in a clear and organized manner Please get in touch if you have the required skills and experience. Thank you!

I'm in need of a professional data scraper to assist with uploading over 700 SKUs from a wholesale supplier site to my own wordpress platform. The task involves collecting various product details in...The task involves collecting various product details including names, information, SKUs, types, and photos from the source website. Key Responsibilities: - Scrape product data from a publicly accessible wholesale supplier site - Collect product names, SKUs, types, information and photos - Directly upload the gathered data onto my website Ideal Skills and Experience: - Proficient in data scraping and web crawling - Experience with eCommerce platforms and product data integration - Attention to detail to ensure all data is accurately copied and uploaded - Familiar with hand...

I need a professional designer to create cover images for my catalog/gig. The design should be classic and relevant to the services I offer, such as web scraping and data visualization. Key Requirements: - Each catalog/gig should have 2-3 images, with the first being the main image and the others serving as supporting screens. - The main cover image should highlight my service offerings. - A decent design is a must; I am open to suggestions but the final product should not look unprofessional. Ideal Skills: - Graphic design with experience in creating cover images. - Ability to understand and visually represent service offerings. - Good communication skills for understanding project requirements and providing suggestions.

I'm seeking a seasoned AI/ML developer to enhance our content ...increase the relevance and accuracy of the generated content. Moreover, you'll need to build mechanisms to verify and refine the generated content based on the source data. A key part of this project involves leveraging LLM queries for high-quality text generation. Ideal candidates should possess: - Proficiency in AI/ML, particularly in working with embeddings and LLMs. - Strong experience in data scraping and context-aware content processing. - Ability to ensure generated output closely aligns with the original source. We need someone who can start immediately and is open to potentially extended collaboration based on performance. If you're able to deliver robust, context-driven AI solutions, we wou...

Program that scrapes soccer pre-match betting odds from 3 South African bookmakers and identifies surebets, using Python (Playwright and Numpy) Ideal Skills: - Proficient in web scraping technologies - Proficient in programming languages suitable for this task (Python)

...avoid missunterstanding : job will assigned after you have provide test upload 50 products minimum ( you can let see us also in one of your stores ) Key Requirements: - Scraping of 1500 products from Shopify No FTP or similar tools available for this project - Comprehensive data collection including title, Images, Size, Color, Price, Description, Short description, and Tags (Price, Color, Size, Top type, Bottom type, Set type, Matter, Sleeve length, Cut, Patterns) of course also the categories have to match - Uploading the products to a Woocommerce store with provided logins Ideal Skills: - Proficient in web scraping - Experienced in product uploading to Woocommerce - Familiar with Shopify - Attention to detail in data collection Please note, only the mentioned...

I'm looking for an experienced data scraper who can collect car price details and specifications from a specific website on a daily basis. Requirements: - Scrape data daily on car prices and specifications - Potential for ongoing work based on quality and efficiency Ideal Skills: - Proficiency in web scraping tools and software - Experience with data collection from e-commerce or vehicle sale websites - Ability to deliver clean, usable data

I'm looking for an experienced data scraper who can collect car price details and specifications from a specific website on a daily basis. Requirements: - Scrape data daily on car prices and specifications - Potential for ongoing work based on quality and efficiency Ideal Skills: - Proficiency in web scraping tools and software - Experience with data collection from e-commerce or vehicle sale websites - Ability to deliver clean, usable data

...tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Airtable. - Ability to deliver deeply differentiated and unique data sets. - Strong attention to detail and ability to follow specific data upload formats. Please include in your proposal examples of previous similar projects you have completed, or share two SaaS pricing models

I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. - at an hourly interval. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites, Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.

I'm looking for a proficient web scraper to collect product details including images from 2000 websites. This project will involve extracting specific details such as product descriptions, specifications, and images. Ideal Skills and Experience: - Prior experience in web scraping - Proficiency in data extraction tools and programming languages (like Python, BeautifulSoup, Scrapy, etc.) - Ability to work with a large volume of websites - Attention to detail to ensure all relevant data is captured - Familiarity with ethical scraping practices and website terms of service. Please include examples of similar projects you've worked on in your proposal.

...tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Airtable. - Ability to deliver deeply differentiated and unique data sets. - Strong attention to detail and ability to follow specific data upload formats. Please include in your proposal examples of previous similar projects you have completed, or share two SaaS pricing models

I need a freelancer to gather the contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the websi...

Title: Research on Overseas Marketplaces & Tools (Contact Form Automations, Scraping, etc.) Project Overview: We operate a web advertising (ASP) business and need a detailed research report on tools or services (including potentially gray/black-hat marketplaces) that offer automated contact form solutions, scraping utilities, and related marketing technologies. We’d like to know where and how these tools are sold, pricing models (one-time vs. subscription), user reviews, and credibility. Tasks: Identify and list relevant sites or marketplaces (e.g., BlackHatWorld, SEOClerks, Shoppy, Sellix). Gather details on available tools: features, payment methods (crypto, PayPal, etc.), user feedback. Compare pros/cons, costs, and any known risks or issues. Deliver a ...

I am encountering an issue with my Puppeteer script which is preventing it from executing prope...executing properly on the local Windows machine using headless chrome. The error message reads: "Could not find Chrome (ver. 131.0.6778.204)." This bug needs to be fixed so that the script can perform web scraping as intended. Key Tasks: - Debug the Puppeteer script so that it can locate and interact with the appropriate version of Chrome. - Ensure the script can execute web scraping on any website. - Execute Docker in Cloud Run to facilitate this process. Ideal candidates for this project should be proficient in Node.js and Headless Puppeteer, with experience in debugging and web scraping. Familiarity with Docker and Cloud Run is also ess...

I'm in need of a skilled web scraper who can assist me in downloading product images from a number of different webpages. Key Requirements: - Experience with web scraping tools and techniques - Ability to handle multiple URLs and webpages - Ensuring images are downloaded in their original size and format The URLs will be provided as multiple webpages within a specified range. The ideal candidate for this project should be able to deliver quality work promptly. Please include examples of similar projects you've done in your proposal.

...Experience Level: Intermediate to Expert Project Description: Looking for an experienced Python developer to build an automated lead generation system for home services (roofing and cleaning) in the Miami-Dade/Broward area. The system will monitor online searches, capture prospect information, and handle automated follow-up via email and SMS. Required Skills: ✓ Python (3+ years experience) ✓ Web scraping (Selenium/BeautifulSoup) ✓ API integration (Twilio, or other Email services) ✓ Database management ✓ Cloud hosting experience ✓ Automation systems Deliverables: 1. Search monitoring system 2. Automated data collection 3. Email/SMS automation 4. Basic dashboard 5. Complete documentation Must Have: - GitHub profile with relevant projects - Experience with similar automa...

The work consists in scraping an event site (like tradefairdatesdotcom) and include the info in a wordpress event plugin. We will be scrapping events in 9 countries in Europe. The result of the scraping will be uploaded synchronized to the wp-events manager plugin (of our property). This will create a calendar of events that includes all the information of the scraping. Attached is a demo of the events plugin in which you can see the information required for each page (SINGLE EVENTS PAGE, EVENTS LOCATION, EVENTS LISTING, CATEGORIES). The information will be synchronized dynamically through a google sheets file to which you must assign the appropriate permissions (upload the json file, etc, you must have experience in this). - We have 40 landings on our website cor...

I'm seeking a freelancer to assist with data entry on my Wordpress website, specifically utili...primarily involves entering text content. Ideal Skills: - Proficiency in Wordpress and ACF - Strong attention to detail - Excellent English language skills Please note, the text content has yet to be sourced and will need to be gathered from existing documents. The ability to format text into HTML or Markdown may be required, although this will depend on the specific documents. Experience with web scraping could be advantageous for sourcing additional content, but this is not a primary requirement. The project requires a freelancer who is able to: - Understand and correctly populate ACF fields - Accurately input data from various sources - Maintain high quality standards t...

I need a Python-based web scraper that can collect product information from various manufacturer sites. The scraper should run on a daily basis. Ideal Skills and Experience: - Proficiency in Python, especially with web scraping libraries (like BeautifulSoup, Scrapy, Selenium) - Previous experience scraping e-commerce or manufacturer sites - Knowledge of data storage solutions for scraped content - Ability to set up a reliable, daily-scraping schedule - Attention to detail and data accuracy

I'm seeking a skilled web scraper for a data collection project from IMDb. I need all reviews and ratings from approximately 5000 movies. The task involves: - Collecting both user and critic reviews - Capturing the raw HTML code for each movie's review page - Formatting the data as separate CSV files for each movie - Storing the raw HTML files as separate files for each movie The CSV files should include reviewer names and review dates. Ideal Skills: - Proficiency in web scraping and data collection - Experience in creating CSV files - Attention to detail for accurate data capture - Proficiency in Python and BeautifulSoup - Skills in data cleaning for quality assurance The project should be completed within 2 weeks.

I'm looking f..."bought", excluding all sponsored items completely. - The output needs to provide the number of bought items, for example, if it says "50+ bought in the last month", as well as the price. Desired Output: - The final report should include: Brand, Product Name, Price, and Number of Bought Items. Ideal Skills and Experience: - Proficient in Python and familiar with PyCharm. - Prior experience with web scraping, particularly from Amazon, is a big plus. - Understanding of CSV file handling in Python. - Ability to deliver a clean, well-documented script. Issues i have faced while doing this in VBA: - amazon dont like more than 50 pings to their website - i made it stop once it get the error screen - sometimes no item identified , so i ju...

I need a freelancer to gather the contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the websi...

I'm looking for a skilled web scraper to collect product information from various websites. The primary source of data will be product-related sites. Experience in website scraping is crucial, and it would be beneficial if you have worked with product data before. Ideal Skills: - Proficiency in web scraping tools and software - Familiarity with product data collection - Attention to detail Experience: - Previous projects involving website scraping - Experience in data analysis and interpretation

...behavior data, or market research data. - The specifics of the data types will be discussed in detail during the selection process. - The ideal candidate should possess a deep understanding of various data collection techniques and tools. - Experience in data analysis will be an added advantage. The project will involve the use of different data collection methods, excluding online surveys, web scraping, and API integration. The ideal candidate should be flexible and able to adapt to different data collection methods as per project requirements. - Prior experience in alternative data collection methods will be beneficial. - The ability to think creatively and find unique data sources is a plus. Furthermore, the format of the data collection will be flexible, not limit...

...tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Airtable. - Ability to deliver deeply differentiated and unique data sets. - Strong attention to detail and ability to follow specific data upload formats. Please include in your proposal examples of previous similar projects you have completed, or share two SaaS pricing models

I'm in need of a Python guru with a strong background in data analysis, specifically with scientific data. Key Requirements: - Proficiency in Python programming - Extensive experience in data analysis - Familiarity with scientific data interpretation Please note that I also have some automation tasks that might need to be handled, primarily centered around data scraping and file management.

I'm in need of an experienced Python developer who can handle web scraping from 9wicket, focusing on sports data, match results, and betting odds. The primary goal is to scrape this data in real-time and insert it into a MySQL database. Key Responsibilities: - Scrape match results and betting odds from 9wicket - Insert the scraped data into a MySQL database - Ensure the data is being scraped in real-time Ideal Skills and Experience: - Proficiency in Python, with a strong focus on web scraping - Experience with MySQL databases - Knowledge of sports data and betting odds - Ability to set up and maintain real-time data scraping Please submit your proposal only if you have experience in similar projects.

I'm in urgent need of a data scraper. I need full contact details (name, phone number, email) from 24 specific pages of a website. The total records should be approximately 450-480. All the data needs to be put into a single Excel spreadsheet, with no additional data cleaning or formatting needed. Ideal freelancer for this project should have: - Proven experience in web scraping - Ability to deliver work under tight deadlines - Proficiency in Excel The data is to be organized in one sheet with all records. Please apply if you can start right away and deliver within a short time frame.

I'm in urgent need of a data scraper. I need full contact details (name, phone number, email) from 24 specific pages of a website. The total records should be approximately 450-480. All the data needs to be put into a single Excel spreadsheet, with no additional data cleaning or formatting needed. Ideal freelancer for this project should have: - Proven experience in web scraping - Ability to deliver work under tight deadlines - Proficiency in Excel The data is to be organized in one sheet with all records. Please apply if you can start right away and deliver within a short time frame.

Hello, I'm seeking a skilled developer with extensive experience in web scraping and data analysis. The task involves scraping car sales details from various car sales websites for my existing business. The ability to bypass security measures, including CAPTCHAs, is essential for this project. Key Requirements: - Proven experience in web scraping, particularly from car sales websites. - Strong problem-solving skills to navigate and bypass various security technologies. - Excellent data analysis abilities to interpret the scraped information. - Ability to deliver within a week. Please include your relevant experience in your application. I look forward to hearing from you.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm in need of a skilled developer who can scrape car sales details from various car sales websites. Key Requirements: - The ability to bypass various security technologies including captcha is essential. - Deep analytical skills to assess details and strong problem-solving capabilities. Data Needed: - Extracting car details and specifications - Collecting pricing information The scraped data will be used for personal use. Please let me know if you're interested.

I'm in need of a skilled developer who can scrape car listings and details from a car sales website. Key Requirements: - Bypass various security technologies, including captcha - Scrape data on car listings and details - Deliver data in Excel format - Focus on intermediate information (including mileage, year) Skills and Expe...who can scrape car listings and details from a car sales website. Key Requirements: - Bypass various security technologies, including captcha - Scrape data on car listings and details - Deliver data in Excel format - Focus on intermediate information (including mileage, year) Skills and Experience: - Deep analysis ability on details - Strong problem-solving skills - Prior experience with data scraping - Familiarity with handling captchas and other se...

I need a highly skilled developer to scrape over 250,000 data records from a car sales website. The project requires advanced expertise in web scraping, including the ability to bypass various security technologies such as CAPTCHAs and anti-bot systems. Data needs to be delivered in an Excel format. Ideal candidates would have: - Proven web scraping experience, particularly with car sales websites. - Ability to implement techniques to bypass security measures. - Excellent data organization skills for Excel.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.