Web Scraping Jobs

I'm seeking a proficient data scraper to gather unique and diversified SaaS product pricing models from various websites. The goal is to collect at least 30 distinct and deeply differentiated pricing models, not merely similar ones in terms of pricing, to stand out from the crowd. Key Responsibilities: - Scrape data from a variety of SaaS websites, focusing on pricing tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Ai...

I'm seeking a proficient data scraper to gather unique and diversified SaaS product pricing models from various websites. The goal is to collect at least 30 distinct and deeply differentiated pricing models, not merely similar ones in terms of pricing, to stand out from the crowd. Key Responsibilities: - Scrape data from a variety of SaaS websites, focusing on pricing tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Ai...

I need a freelancer to gather the contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the website for ...

First job is 450 entries You search with user name pick 3 dropdowns and pick profile after you cooy the profile like and past in sheet. Do this 450 times.

I'm seeking a data specialist to assist with my project of extracting in-play odds from Betfair. Key Responsibilities: - Extract data every minute from Betfair. - Focus on in-play market prices for cricket. Ideal Skills and Experience: - Proficient with data extraction tools and techniques. - Understanding of betting markets and odds. - Experience with Betfair is a plus. - Knowledge of cricket is an advantage. I am looking for someone reliable who can consistently deliver data at a minute's interval. This project is crucial for my analysis and your timely support will be greatly appreciated.

We are seeking a talented Scraping API Developer with expertise in Beautiful Soup and other web scraping tools to join our team. The ideal candidate will be responsible for developing efficient and reliable scraping solutions to extract data from various websites and APIs. Key Responsibilities: Design, develop, and maintain web scraping scripts using Beautiful Soup, Selenium, and other tools Create and optimize scraping APIs to automate data extraction processes Ensure data integrity and accuracy in the extraction process Monitor and troubleshoot existing scraping scripts to ensure ongoing functionality Collaborate with team members to define scraping requirements and objectives Stay up-to-date with the latest trends and best practices in web scraping and data extraction Requirements: P...

I am looking for an experienced freelancer to scrape auto parts store data across 7,500 towns in the USA . The freelancer will be responsible for scraping the following information from Google search results: - Store name and address - Contact information - Website (if any) - Contact person's name (if available) The towns / cities names will be provided in an Excel sheet, and the freelancer will need to: Search for auto parts stores in each town via Google. Scrape the relevant data (store name, contact number, address, website). Compile and organize the scraped data into an Excel file. Requirements: Experience with web scraping and the use of tools like Selenium, BeautifulSoup, or Scrapy. Experience using Google Custom Search API or SerpApi to extract structured results from Goo...

I'm in need of a web scraping expert who can extract specific data from online retailers of windscreen wiper blades. Data to be Scraped: - Make and model of the vehicle - Year of the vehicle - Size of the wiper blade - Whether it's for the rear wiper Ideally, you should have: - Proficiency in web scraping tools and programming languages such as Python - Experience with data analysis - Ability to present the data in a clear and organized manner Please get in touch if you have the required skills and experience. Thank you!

I'm looking for a skilled web developer who can create a script for me to automate tab navigation . - The script should operate through a website or an app. - The primary function of the script is to help me download multiple PDFs from the web without having to click each one individually. Example 1. 2. In the search box, you enter one Patent number. “US5551212” 3 then you would have to go to the download tab and click download and save I would like to be able to put a list of Patent numbers put a list of Pat numbers: US5512121 US5542135 US6712321 Etc Have it run through the script to download the pdf(s) to a folder desktop I’ve done this in the past, but it’s been years ago my coding mind is not up to it nowadays And easy to use cheap app maybe at or...

I'm in need of the volume data for Nifty 50 Futures on a 5 minute interval from 2015 to 2019. The data should be delivered in CSV format, as it will be used for a machine learning model. Ideal Skills: - Data extraction - Understanding of financial data - Proficiency in CSV formatting Experience: - Prior experience with stock market data - Machine learning model input preparation

I'm in need of a professional data scraper to assist with uploading over 700 SKUs from a wholesale supplier site to my own wordpress platform. The task involves collecting various product details including names, information, SKUs, types, and photos from the source website. Key Responsibilities: - Scrape product data from a publicly accessible wholesale supplier site - Collect product names, SKUs, types, information and photos - Directly upload the gathered data onto my website Ideal Skills and Experience: - Proficient in data scraping and web crawling - Experience with eCommerce platforms and product data integration - Attention to detail to ensure all data is accurately copied and uploaded - Familiar with handling large volume data

I'm seeking a seasoned AI/ML developer to enhance our content generation process. Your main tasks will include: - Creating custom embeddings from scraped text content using Google Vertex AI, with the primary aim of improving content relevance. - Incorporating metadata from the website to increase the relevance and accuracy of the generated content. Moreover, you'll need to build mechanisms to verify and refine the generated content based on the source data. A key part of this project involves leveraging LLM queries for high-quality text generation. Ideal candidates should possess: - Proficiency in AI/ML, particularly in working with embeddings and LLMs. - Strong experience in data scraping and context-aware content processing. - Ability to ensure generated output closely alig...

Program that scrapes soccer pre-match betting odds from 3 South African bookmakers and identifies surebets, using Python (Playwright and Numpy) Ideal Skills: - Proficient in web scraping technologies - Proficient in programming languages suitable for this task (Python)

I'm looking for an experienced freelancer to scrape 1500 products from Shopify and upload them to my Woocommerce store. to avoid missunterstanding : job will assigned after you have provide test upload 50 products minimum ( you can let see us also in one of your stores ) Key Requirements: - Scraping of 1500 products from Shopify No FTP or similar tools available for this project - Comprehensive data collection including title, Images, Size, Color, Price, Description, Short description, and Tags (Price, Color, Size, Top type, Bottom type, Set type, Matter, Sleeve length, Cut, Patterns) of course also the categories have to match - Uploading the products to a Woocommerce store with provided logins Ideal Skills: - Proficient in web scraping - Experienced in product uploading to Wooc...

I'm looking for an experienced data scraper who can collect car price details and specifications from a specific website on a daily basis. Requirements: - Scrape data daily on car prices and specifications - Potential for ongoing work based on quality and efficiency Ideal Skills: - Proficiency in web scraping tools and software - Experience with data collection from e-commerce or vehicle sale websites - Ability to deliver clean, usable data

I'm looking for an experienced data scraper who can collect car price details and specifications from a specific website on a daily basis. Requirements: - Scrape data daily on car prices and specifications - Potential for ongoing work based on quality and efficiency Ideal Skills: - Proficiency in web scraping tools and software - Experience with data collection from e-commerce or vehicle sale websites - Ability to deliver clean, usable data

I'm seeking a dedicated assistant to help with my TikTok business. The tasks will primarily involve finding relevant TikTok accounts, downloading their videos, transcribing video scripts, and utilizing ChatGPT to rewrite these scripts. Key Responsibilities: - Identify relevant TikTok accounts - Download associated short videos and upload them to my Notion page with complete video information - Transcribe video scripts and paste them into my Notion page - Use ChatGPT 4.0 to rewrite the scripts and paste them back into my Notion page - Classify videos by priority (A, B, C, D) Ideal Skills and Experience: - Familiarity with TikTok and its content - Proficiency in using Notion - Experience with ChatGPT or similar AI tools - Strong organisational skills - Ability to classify content bas...

I'm seeking a proficient data scraper to gather unique and diversified SaaS product pricing models from various websites. The goal is to collect at least 30 distinct and deeply differentiated pricing models, not merely similar ones in terms of pricing, to stand out from the crowd. Key Responsibilities: - Scrape data from a variety of SaaS websites, focusing on pricing tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Ai...

I need a freelancer to gather the contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the website for ...

I'm seeking a dedicated assistant to help with my TikTok business. The tasks will primarily involve finding relevant TikTok accounts, downloading their videos, transcribing video scripts, and utilizing ChatGPT to rewrite these scripts. Key Responsibilities: - Identify relevant TikTok accounts - Download associated short videos and upload them to my Notion page with complete video information - Transcribe video scripts and paste them into my Notion page - Use ChatGPT 4.0 to rewrite the scripts and paste them back into my Notion page - Classify videos by priority (A, B, C, D) for payment and all details, please please read the link: Ideal Skills and Experience: - Familiarity with TikTok and its content - Proficiency in using Notion - Experience with ChatGPT or similar AI tools - Str...

I am encountering an issue with my Puppeteer script which is preventing it from executing properly on the local Windows machine using headless chrome. The error message reads: "Could not find Chrome (ver. 131.0.6778.204)." This bug needs to be fixed so that the script can perform web scraping as intended. Key Tasks: - Debug the Puppeteer script so that it can locate and interact with the appropriate version of Chrome. - Ensure the script can execute web scraping on any website. - Execute Docker in Cloud Run to facilitate this process. Ideal candidates for this project should be proficient in Node.js and Headless Puppeteer, with experience in debugging and web scraping. Familiarity with Docker and Cloud Run is also essential. Please bid if you can help me solve this issue.

Title: Python Developer - Automated Lead Generation System for Home Services Budget: $2k Fixed Price Duration: 3-4 weeks Experience Level: Intermediate to Expert Project Description: Looking for an experienced Python developer to build an automated lead generation system for home services (roofing and cleaning) in the Miami-Dade/Broward area. The system will monitor online searches, capture prospect information, and handle automated follow-up via email and SMS. Required Skills: ✓ Python (3+ years experience) ✓ Web scraping (Selenium/BeautifulSoup) ✓ API integration (Twilio, or other Email services) ✓ Database management ✓ Cloud hosting experience ✓ Automation systems Deliverables: 1. Search monitoring system 2. Automated data collection 3. Email/SMS automation 4. Basic dashboard 5. C...

I need a Python-based web scraper that can collect product information from various manufacturer sites. The scraper should run on a daily basis. Ideal Skills and Experience: - Proficiency in Python, especially with web scraping libraries (like BeautifulSoup, Scrapy, Selenium) - Previous experience scraping e-commerce or manufacturer sites - Knowledge of data storage solutions for scraped content - Ability to set up a reliable, daily-scraping schedule - Attention to detail and data accuracy

I am looking for a freelancer who can integrate my Google Sheets with WhatsApp in order to send automated task reminders. The reminders should be triggered based on specific data updates in the sheet. Ideal Skills: - Proficiency in Google Sheets - Experience with WhatsApp integration - Knowledge of automation tools - Python/JavaScript skills (for scripting purposes) Please include examples of similar projects you've completed in your proposal. I look forward to hearing from you.

I'm seeking a skilled web scraper for a data collection project from IMDb. I need all reviews and ratings from approximately 5000 movies. The task involves: - Collecting both user and critic reviews - Capturing the raw HTML code for each movie's review page - Formatting the data as separate CSV files for each movie - Storing the raw HTML files as separate files for each movie The CSV files should include reviewer names and review dates. Ideal Skills: - Proficiency in web scraping and data collection - Experience in creating CSV files - Attention to detail for accurate data capture - Proficiency in Python and BeautifulSoup - Skills in data cleaning for quality assurance The project should be completed within 2 weeks.

I'm looking for a skilled Python developer to create a script in PyCharm for me. The script needs to load a CSV file with specific headings: Brand, Product Name, Price, EAN/UPC/ASIN. Key Requirements: - The script should go to Amazon and fetch the items that have been "bought", excluding all sponsored items completely. - The output needs to provide the number of bought items, for example, if it says "50+ bought in the last month", as well as the price. Desired Output: - The final report should include: Brand, Product Name, Price, and Number of Bought Items. Ideal Skills and Experience: - Proficient in Python and familiar with PyCharm. - Prior experience with web scraping, particularly from Amazon, is a big plus. - Understanding of CSV file handling in Python. -...

I'm looking for a skilled web scraper to collect product information from various websites. The primary source of data will be product-related sites. Experience in website scraping is crucial, and it would be beneficial if you have worked with product data before. Ideal Skills: - Proficiency in web scraping tools and software - Familiarity with product data collection - Attention to detail Experience: - Previous projects involving website scraping - Experience in data analysis and interpretation

We are hiring a dev to build us a simple web crawler. The desired tech stack we think is: Features we like are similar to the Spider project () which is free to download so perhaps we can start with this? - Features: Performs full text indexing. Can index both static and dynamic pages. Finds links in href, frame, area and meta tags, and can also follow links given in javascript as strings via and window.open. Respects protocol, and nofollow and noindex tags. Follows server side redirections. Allows spidering to be limited by depth (ie maximum number of clicks from the starting page), by (sub)domain or by directory. Allows spidering only the urls matching (or not matching) certain keywords or regular expressions. Supports indexing of pdf and doc files (using external binaries for fi...

I'm looking for a freelancer who can extract phone numbers from business directories on the web. The job will involve: - Data Entry: Accurate input of extracted phone numbers into a spreadsheet. Ideal skills for this job include: - Proficiency in web research - Data entry skills - Attention to detail - Familiarity with business directories. Please note that the specific format for the phone numbers has not yet been determined, so flexibility and adaptability will be key.

I'm seeking a proficient data scraper to gather unique and diversified SaaS product pricing models from various websites. The goal is to collect at least 30 distinct and deeply differentiated pricing models, not merely similar ones in terms of pricing, to stand out from the crowd. Key Responsibilities: - Scrape data from a variety of SaaS websites, focusing on pricing tiers and features of different SaaS products. - Upload the collected data to a no-code database, such as Notion or Airtable, following a specified format. Data Upload Example: Your uploads will resemble this format - [Notion Sample]() Ideal Skills and Experience: - Proven experience in web scraping, particularly in gathering pricing models from SaaS websites. - Proficiency in using no-code databases like Notion or Ai...

I need data to be collected on an ongoing basis for the NBA season for my bets. My budget is $50/ month or $6/spreadsheet until the month of June when the NBA season ends. This can be up for negotiation as time goes on. I need the freelancer to track the nba schedule - - and to update the data in the attached spreadsheet the night before or one day before the games are to be played. For example, in the spreadsheet I sent you, the games were played 11/29, you can retrieve the data on 11/28. Most of the data can and will be retrieved from the site, teamrankings.com. And some can be retrieved from chatgpt. You can find instructions in the Comments of Column B (Knicks vs Hornets). Just click on the purple tab on the top right corner We can also use Googlesheets if that works better. I wrot...

I'm in need of an experienced Python developer who can handle web scraping from 9wicket, focusing on sports data, match results, and betting odds. The primary goal is to scrape this data in real-time and insert it into a MySQL database. Key Responsibilities: - Scrape match results and betting odds from 9wicket - Insert the scraped data into a MySQL database - Ensure the data is being scraped in real-time Ideal Skills and Experience: - Proficiency in Python, with a strong focus on web scraping - Experience with MySQL databases - Knowledge of sports data and betting odds - Ability to set up and maintain real-time data scraping Please submit your proposal only if you have experience in similar projects.

I'm in urgent need of a data scraper. I need full contact details (name, phone number, email) from 24 specific pages of a website. The total records should be approximately 450-480. All the data needs to be put into a single Excel spreadsheet, with no additional data cleaning or formatting needed. Ideal freelancer for this project should have: - Proven experience in web scraping - Ability to deliver work under tight deadlines - Proficiency in Excel The data is to be organized in one sheet with all records. Please apply if you can start right away and deliver within a short time frame.

I'm in urgent need of a data scraper. I need full contact details (name, phone number, email) from 24 specific pages of a website. The total records should be approximately 450-480. All the data needs to be put into a single Excel spreadsheet, with no additional data cleaning or formatting needed. Ideal freelancer for this project should have: - Proven experience in web scraping - Ability to deliver work under tight deadlines - Proficiency in Excel The data is to be organized in one sheet with all records. Please apply if you can start right away and deliver within a short time frame.

Hello, I'm seeking a skilled developer with extensive experience in web scraping and data analysis. The task involves scraping car sales details from various car sales websites for my existing business. The ability to bypass security measures, including CAPTCHAs, is essential for this project. Key Requirements: - Proven experience in web scraping, particularly from car sales websites. - Strong problem-solving skills to navigate and bypass various security technologies. - Excellent data analysis abilities to interpret the scraped information. - Ability to deliver within a week. Please include your relevant experience in your application. I look forward to hearing from you.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm in need of a skilled developer who can scrape car sales details from various car sales websites. Key Requirements: - The ability to bypass various security technologies including captcha is essential. - Deep analytical skills to assess details and strong problem-solving capabilities. Data Needed: - Extracting car details and specifications - Collecting pricing information The scraped data will be used for personal use. Please let me know if you're interested.

I'm in need of a skilled developer who can scrape car listings and details from a car sales website. Key Requirements: - Bypass various security technologies, including captcha - Scrape data on car listings and details - Deliver data in Excel format - Focus on intermediate information (including mileage, year) Skills and Experience: - Deep analysis ability on details - Strong problem-solving skills - Prior experience with data scraping - Familiarity with handling captchas and other security measures

I need a highly skilled developer to scrape over 250,000 data records from a car sales website. The project requires advanced expertise in web scraping, including the ability to bypass various security technologies such as CAPTCHAs and anti-bot systems. Data needs to be delivered in an Excel format. Ideal candidates would have: - Proven web scraping experience, particularly with car sales websites. - Ability to implement techniques to bypass security measures. - Excellent data organization skills for Excel.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm looking for someone skilled in web scraping to gather email addresses from YouTube channels dedicated to educational content. Key Requirements: - Scraping email addresses of 2000 educational YouTube channels. - Experience with web scraping tools and techniques. - Knowledge of YouTube's platform and its educational channels. Please note: The goal is to find email addresses that are publicly available and not to engage in any illegal or unethical practices. A successful completion of this task could lead to more projects in the future.

I'm in need of a talented developer with proven experience in custom WordPress development and web scraping. The primary goal is to create a web scraping tool that can automatically search for general job opportunities on job boards. Key Responsibilities: - Develop a web scraping tool that targets general job boards without relying on APIs. - Create a custom WordPress plugin that integrates this tool into our existing WordPress platform, with a focus on automated notifications for new opportunities. - Ensure the plugin is user-friendly and intuitive to enhance the overall user experience. - Implement a system that notifies users when suitable opportunities are found. Ideal Skills: - Extensive experience in custom WordPress development, especially with plugin and theme creation. - S...

I'm looking for a professional with expertise in Power Automate preferably or another RPA software to help me extract data from an auction website. The final output should be an Excel spreadsheet. See attached example KEY TASK - Extract all columns in grey data from the Atlantic County auction website into an Excel spreadsheet. Also into a separate tab or separate spreadsheet do cape may county. See links below SPECIFIC REQUIREMENTS: - City, Status(Only take the most recent one), Judge Amount, Upset Amount and Priors(Just put the $ amount) will be seen after clicking the link for each property. - Columns with headings in purple I will manually fill in and columns with headings in green are automatically calculated. - When I rerun the program the grey columns will change, but I want...

Seeking experts for the creation and automation of customised CSV files with web data extraction Requirements: CSV files must include detailed product information: product codes, product names, categories, prices, images, brands, stock availability and other relevant attributes. Product data must be extracted directly from the manufacturer's website, as ready-made CSV files are not provided. The automation process must be smooth and efficient, ensuring that CSV files can be updated regularly with minimal manual effort. For direct import, CSV files must be compatible with our e-commerce platform. Ideal skills: Expertise in creating and automating custom CSV files. Experience in web scraping and data extraction using tools such as Python (BeautifulSoup, Selenium, Scrapy) or other rel...

Title: Web Scraper Needed to Extract Data from Nike UAE Website Description: I am looking for an experienced web scraper to build a script that can reliably scrape product data from the Nike UAE website. The end goal is to produce a CSV file containing all relevant product information as well as provide the code used for the scraping process. Project Requirements: Website: Nike UAE () Data Points Needed: Product name Product category Price Product description Product images (URLs) Any available product attributes (e.g., sizes, colors, stock status) Output Format: CSV file containing the extracted data. Each row should represent a single product, and columns should be clearly labeled. Deliverables: The CSV file with all requested product data. The code/script used to scrape the data. (Prefe...

I need a Python Selenium expert to create a working example for me. This example should be developed on Appwrite Cloud Functions and will perform tasks such as form filling, navigating pages, and data extraction. Key Requirements: - Experience with Python and Selenium - Prior experience with Appwrite Cloud Functions - Ability to create reliable and efficient bots

I have a Python script that automates checking usernames online to see if they're registered on a site. It uses AI for captcha solving, but currently, the username validation part is slow and needs optimization. Key Requirements: - Experience with Python and script optimization - Familiarity with web scraping techniques - Knowledge in AI and captcha solving mechanisms is a plus - Open to using any libraries/tools that can improve the speed The username validation is currently implemented via web scraping. The goal is to speed up this process significantly. Freelancer with expertise in enhancing Python scripts and web scraping is preferred. Please note, there are no restrictions on the libraries or tools that can be used.

I am looking for a sales person with basic knowledge in web automation, web scraping and anti bot bypassing solutions to sell anti bot related software for me. The job entails: Lead generation Finding customers Explaining the product The commission is 500€/sale with an additional negotiable bonus per 3 sales.