Web scraping project jobs

...Product Importing Two options for importing products into WooCommerce: 1. Automatic Import – Direct addition without manual approval. 2. Manual Review – Products are displayed for approval before being added. --- ? Key Technical Considerations ✅ Prevent duplicate products: If a product already exists, it will not be added again. ✅ Bypass stores that restrict data extraction: Use advanced scraping techniques. ✅ Accurate product classification: Products imported from Zara will be placed under the "Zara" category with relevant subcategories. Add category images if they are missing. ✅ Smart category distribution using AI. ✅ Create a special category for discounts and promotions. ✅ Develop a monitoring dashboard to track automation operations. ✅ Gener...

I'm looking for a skilled data scraper and processor. The project involves scraping image data from a website, opening attachments, extracting information from scanned image PDFs, consolidating and cleaning textual data, and then copying this data along with a prompt onto a second website. Lastly, you will need to capture the conclusion from this website and paste it onto Notepad. Ideal skills and experience for this job include: - Proficient in web data scraping - Experienced in data extraction from scanned image PDFs - Skilled in data cleaning and consolidation - Capable of accurately copying and pasting data - Familiar with Notepad for data entry Please apply if you are detail-oriented, efficient, and can handle large amounts of data.

I'm looking for a skilled web scraping expert with a focus on e-commerce. The project involves extracting specific product information from only one platform. Key Requirements: - Extracting price and availability from product pages - Experience with web scraping tools and techniques - Response in json format Please note that I will disclose the specific platform to scrape during the project. Maybe using Puppeteer? because website seems very protected. I have a shared server so this ideally would have to be done with php. For starting now please.

I'm looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to extract data from the w...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...

I'm in search of a proficient web scraper to assist me in collecting the websites and emails of numerous service providers. The main objective is to compile this information for email marketing initiatives. Key Requirements: - The scraper needs to navigate standard HTML websites and those requiring logins. - Prior experience in web scraping with an emphasis on collecting contact details is highly preferred. - The scraper should also provide the tools or script used for data collection. Please bid only if you possess the necessary skills and experience. Your bid will be considered only if you have a proven record in web scraping and can demonstrate your ability to gather contact information efficiently.

Project Overview: We are seeking experienced web scraping experts to develop robust and reliable scraping scripts for second-hand automotive marketplace: The goal is to build scripts that we can integrate into our existing systems to run daily, ensuring high-quality data extraction with minimal downtime. Key Requirements: 1. Script Development: * Create efficient web scraping scripts for various automotive marketplaces. * Ensure the code is clean, well-documented, and easy to maintain. * Deliver the source code, as we will be running and integrating the scripts within our existing infrastructure. * Structure the scraped data by car brand to improve tracking and control: ensure the output format groups listings under their respective br...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...

I need a Python expert to help me with two tasks. The first task is to scrape data from a specific website. The second task involves decoding a message using Python. Ideal Skills: - Extensive experience in Python - Expertise in web scraping - Proficiency in Python for message decoding Please be prepared to demonstrate your skills and experience in these areas.

Project Description: I am looking for a freelancer to develop an automated workflow using to scrape data from a WordPress-based website, store it in Airtable, and sync it with a Shopify store via its API. --- Main Tasks: 1. Scraping Product Data:   - Visit the target website and extract the list of available brands from the sidebar menu (approximately 20 brands).   - Retrieve the URLs of the product showcase pages for each brand.   - Extract the URLs of all products listed within each brand's catalog (currently 240 product URLs in total).   - Visit each product's page and extract the following details:    - Product Image    - Description    - Technical Specifications  &nbs...

I want to create an AI agent that automates my job application process. This personal project involves: - Job scraping from multiple platforms: LinkedIn, Indeed, Glassdoor, reed, and monster. - Resume matching: The AI should be able to match keywords in my resume with the skills required for the job. - Applying for jobs: The AI will send my cover letter and resume to HR. Additionally, the AI should create a list of jobs in Google Sheets. Ideal candidates for this project should have experience in AI development, specifically in creating job application bots. Familiarity with Google Sheets API is essential. Please include examples of similar projects you've completed in your proposal. The AI will use a single, static cover letter for all job applications. The ...

I'm looking for an experienced Python developer to revamp my web scraping automation code. The main task is to enhance the code for downloading PDFs specifically from corporate websites. Key Requirements: - Expertise in Python and web scraping libraries such as BeautifulSoup, Scrapy or Selenium. - Experience in automating tasks with Python. - Understanding of corporate websites structure and how to navigate them. - Ability to troubleshoot and optimize existing code. Your role will involve reviewing and improving the current codebase to ensure efficient and successful PDF downloads from target websites. Please provide examples of similar projects you've completed in your application.

I'm looking for an experienced web scraper to extract contact information from corporate websites. The required data includes emails, phone numbers, website addresses, country, and the physical address of the company. The final output should be delivered in an Excel format. Ideal skills for this job: - Proficiency in web scraping tools and techniques - Prior experience in data extraction from corporate sites - Strong attention to detail Please provide samples of previous similar work in your proposal.

I have an Excel spreadsheet containing 230 hospitals. I need assistance identifying the Facilities and Estates Managers for these hospitals, along with their phone numbers and email addresses for that person. Ideal Skills: - Proficient in data research and analysis - Excellent attention to detail - Experience with web scraping tools to gather data from various online sources. The project should be completed within 1 week. Please format and deliver the information in an Excel spreadsheet.

...extraction). Experience with network traffic analysis (e.g., Wireshark, TCP/IP packet sniffing). Knowledge of screen scraping, OCR (e.g., Tesseract, OpenCV), or API interception. Familiarity with automation frameworks (e.g., Selenium, AutoIt, PyAutoGUI). Experience integrating with AI models via APIs or sockets. Understanding of GIP2 Protocol (as described in the provided documentation). Strong problem-solving skills and ability to work independently. Nice to Have Experience with poker software and game mechanics. Familiarity with machine learning/AI models for game decision-making. Experience with cloud-based deployment (AWS, Google Cloud). Compensation Hourly rate or fixed project rate, negotiable based on experience....

I'm looking for an experienced Python developer to revamp my web scraping automation code. The main task is to enhance the code for downloading PDFs specifically from corporate websites. Key Requirements: - Expertise in Python and web scraping libraries such as BeautifulSoup, Scrapy or Selenium. - Experience in automating tasks with Python. - Understanding of corporate websites structure and how to navigate them. - Ability to troubleshoot and optimize existing code. Your role will involve reviewing and improving the current codebase to ensure efficient and successful PDF downloads from target websites. Please provide examples of similar projects you've completed in your application.

? Project Overview We are looking for a Python developer with experience in PDF text extraction, OCR, NLP, and web scraping to help automate the extraction and categorization of NCERT textbook questions into a structured format (CSV/JSON/Database). The extracted questions will be used in a quizzing platform that helps students prepare for exams. ? Responsibilities ✅ Extract text from NCERT PDFs (both searchable and scanned) using PyMuPDF, pdfplumber, and Tesseract OCR ✅ Identify and filter questions from extracted text using Regex and NLP ✅ Classify questions into Subject, Chapter, Type (MCQ, True/False, Fill in the Blanks), and Difficulty (Easy, Medium, Hard) ✅ Store extracted questions in a structured CSV/JSON format ✅ (Optional) Scrape past-year CBSE exam question...

I'm looking for a creative professional who can assist me with modern-style social media graphics, graphic design for a minimalist logo, and a web scraper to collect contact information. Ideal skills and experience include: - Proficiency in graphic design, particularly in creating social media graphics. - Experience in logo design, preferably in a minimalist style. - Ability to design in a modern aesthetic. - Proficient in web scraping, specifically in collecting contact information. - Experience in graphic design for creating .pdfs. - Proficient in typing and creating .pdfs.

I'm looking for a skilled web developer to create a dynamic website with live updates similar to Sky Exchange. The website should not include payment processing, but needs to feature live odds. Key Requirements: - Development of a Dynamic Website: The website should be dynamic, capable of updating in real-time to display live odds. - User Registration and Login: The site needs to have a user registration and login functionality. This will allow users to create accounts and log in to view custom content. - Admin Panel: An admin panel will be required for managing the odds. This will allow for easy updates and modifications to the odds displayed on the site. Ideal Skills: - Proficiency in web development with a focus on creating dynamic, real-time websites. - Experience ...

I need assistance in scraping details of 534 products from my client's eBay store into a CSV file. Please refer to the attached sample of a previously scraped product for reference. Requirements: - Extract comprehensive product details including Product Name and Price, Product Description and Images, SKU and Stock Levels, HTML description, category, eBay product URL, All Image URLs, and other specified details from the attached CSV. - eBay Store URL : Important Notes: - eBay has implemented restrictions to block scrapers using CAPTCHA. You may need to use a VPN or other methods to bypass these restrictions. - This is a small-budget project, so I appreciate your understanding and interest if you're able to work within this budget. Best Regards,

I'm looking for a web scraper that can collect product details from eCommerce websites. The data I need includes the title and description, price and availability, as well as images and specifications. Ideal Skills: - Proficiency in web scraping tools and techniques - Experience with eCommerce website scraping - Familiarity with data handling and processing Please feel free to reach out if you have any questions or if you need further information.

...consistently. yyyy-mm-dd Supplier(, Item)*(, 0 items) $#,##0.00(; #,##0.00)* e.g. 2025-02-03 Bunnings, Bolts+Nuts, 1 item $5.28 2025-02-01 Aldi, Bananas, 24 items $50.32; $200.00 which means 50.32 for groceries and 200.00 cash withdrawal. Only list the first item or the most expensive item on the invoice. Item count if possible. Please arrange the invoices by date. The program should support scraping tax invoices from Gmail and iMessages. Save to OneDrive. The program should be compatible with Windows. Provide a list in Excel with hyperlinks to the PDFs. Please include advanced filtering to categorize the invoices by supplier. The program should save the tax invoices only as PDF files. Include a feature to extract the amount. Single attachments per email or SMS are sufficient....

I need a skilled freelancer who can efficiently extract social media content from various sources including websites, social media profiles, and directories or databases. The extracted data should be delivered in Excel/CSV format. Ideal Skills and Experience: - Proficiency in data extraction and mining - Familiarity with social media platforms - Experience with web scraping - Ability to deliver data in specified formats

I need a freelancer who can perform a data scrape to collect details of local businesses for marketing purposes. Key Requirements: - Collecting contact information (Email addresses, Phone numbers, Physical addresses) of local businesses Ideal Skills: - Proficient in data scraping - Experience in collecting commercial data - Good understanding of data privacy regulations Please ensure that the data is accurate and up-to-date. Do not contact me unless you have read this brief- use reference - Blue Sky!

...create a web scraping application that will extract data from the National Park Service and Reserve CA websites. Data Requirements: - The application should pull in data about wilderness permits and campsites, specifically their availability and booking details. - Include information on various types of wilderness permits available. - Capture detailed location information for each campsite and permit. - Scrape data on the limits or quotas for each permit type and campsite. - Extract data on the booking windows and timelines for each permit and campsite. - Extract detailed fee information for each permit and campsite. - Capture data on seasonal availability for permits and campsites. Frequency: - I need this data to be scraped daily. Ideal Skills & Experience: - Pro...

I need a skilled data extraction professional to pull real-time stock prices from a specific website into my Excel. Key Responsibilities: - Gather real-time stock prices from the designated website. - Update this data into Excel on an hourly basis. Ideal Skills and Experience: - Proficient i...need a skilled data extraction professional to pull real-time stock prices from a specific website into my Excel. Key Responsibilities: - Gather real-time stock prices from the designated website. - Update this data into Excel on an hourly basis. Ideal Skills and Experience: - Proficient in data extraction and web scraping. - Experience with Excel and data management. - Knowledge of stock market data is a plus. Attached is the error I am getting when trying to go to Data--From ...

...no duplicates 3. Process Improvement & Reporting: - Collaborate with the agency team to refine lead qualification criteria and suggest improvements to the research process - Provide regular status updates on lead generation progress via weekly reports - Flag potential high-value leads for follow up by the agency's outreach team 4. Tool utilization - Use available research tools (eg. Instagram scraping tools, keyword searches) efficiently while adhering to Instagram's guidelines and ethical practices - Be open to learning new tools or methiodides as recommended by the agency Requirements & Qualifications: Experience: - Prior experience as Virtual Assistant or in lead generation/research is preferred - Familiarity with social media platforms, particularly In...

I'm seeking a skilled Python and Selenium developer to create a user-initiated web scraper for Chrome. The script will gather contact data, basic information, email addresses, and social media profiles (specifically YouTube, Vimeo, and ), triggered by the Ctrl + M keyboard shortcut. Key Requirements: - Python and Selenium expertise - Web scraping proficiency, particularly from social media platforms - Ability to save scraped data to a .CSV file The desired basic information includes the contact's name, email, social media profiles, and profile image URLs. The scraper should be able to initiate data collection for each contact upon pressing Ctrl + M. Ideal Skills: - Python - Selenium - Web Scraping - CSV file handling Please bid if you have ...

I need a quality freelancer to help gather data for our new online radio stations website, starting with Serbia. The task involves collecting data per station in each country, and formatting it into a JSON file as per a specific template. Ideal Skills & Experience: - Data collection and web scraping - JSON formatting - Image processing skills - Experience with online radio stations is a plus Data & Image Requirements: - The data format must match the specifications outlined in the provided Google document (). - Images for each station should be 470px width / 300px height, in a webp format of less than 100KB per image. Bonus: Supplying the JSON is latin Serbian (Croatian).

I'm looking for a data scraping expert to collect text and image content from various websites. Key Responsibilities: - Scrape text data from one base url with 3 levels of pagination - For example .. a website with list of multiple companies (this list is split into multiple pages) One company page on the base url website then has multiple products therefore each product has its own page as well. - Gather relevant text and image data. Put all content in one pdf or maximum 4. Ideal Skills: - Proficiency in web scraping tools and techniques - Experience in data analysis - Attention to detail This project requires someone who can efficiently and accurately collect large volumes of data. Prior experience with data scraping from websites is a plu...

I'm in need of an expert who can help automate a site scraping which has cloudflare protection.

I'm looking for a skilled web scraper to extract product details from a specific website's database. The information that I need includes product descriptions and specifications. The final output should be an Excel file with the data organized in separate columns for each detail. Ideal Skills and Experience: - Proficient in web scraping - Experience with Excel - Attention to detail - Ability to deliver data in specified format

My Rails 8 application scrapes specific Real Estate listings using Selenium. Since migrating from Heroku to Digital Ocean, the scraper is now getting blocked by Cloudfl...getting blocked by Cloudflare and other anti-bot protections. Your tasks include: - Modifying the existing scraper code (which I can provide) to make it undetectable and robust. - Ensuring the scraper works consistently, not just occasionally. - Implementing stealth techniques to bypass bot detection. - Testing the solution in the Rails console. Skills Required: - Ruby on Rails 8 - Selenium & Web Scraping - Cloudflare Bypass Techniques - Experience with Proxies & Browser Fingerprinting Avoidance Budget: Open to reasonable offers. Timeline: ASAP. If you have experience making scrapers stealthy a...

I need a skilled data scrapper to extract product data from a BookMyShow-like website and deliver the information in an Excel sheet. The ideal freelancer for this project should have: - Prior experience with data scraping, particularly from e-commerce or entertainment-related sites - Proficiency in Excel - Good attention to detail to ensure the data is accurately captured - Experience in cleaning and preprocessing extracted data to ensure its usability Please include details such as the artist's bio, name of movie, etc The data scraping task is a one-time requirement.

I need someone with experience in web scraping to collect email addresses and phone numbers from a list of companies. The data should be sourced from company websites and public directories. The final output should be delivered in an Excel spreadsheet. Ideal Skills: - Proficiency in web scraping tools - Attention to detail - Experience with data collection from company websites and public directories Experience: - Previous projects involving data scraping - Familiarity with collecting contact details from companies Please check the contact details to see which ones are on only need the numbers that are active on WhatsApp! Thank you! Total no of companies:10000

I'm in need of a skilled data extraction specialist who can efficiently gather product information from Amazon. The ideal freelancer for this project should have: - Proven experience in data scraping and extraction from e-commerce websites, with a particular focus on Amazon. - Excellent attention to detail to ensure the information gathered is accurate and complete. - Proficiency in using data extraction tools and software. - Ability to deliver the data in a timely manner and in a format that's easy to analyze.

There are a collection of lessons based at (they are all open source and free to use). I want a mysql database which contains the URL and source code of each of the lesson pages. Eg. There are about 10,000 lesson pages. The structure for almost all is Year -> Subject -> Unit -> Lesson But some (eg. Physics) in Year 10 and 11 have the structure Year -> Subject -> Unit -> Exam Board -> Level -> Lesson Thanks for your bid, Rob

We are looking for a freelancer to compile a structured dataset of consumer electronics officially released in India, including mobile phones, heads...ensuring accuracy and completeness. The final dataset should be delivered in an Excel or CSV format with all categories properly sorted in chronological order. Preference will be given to freelancers with experience in data collection, data scraping, or market research, especially in consumer electronics. Interested applicants should provide an estimated completion time and, if possible, a sample dataset for review. Include products released in the last 2 years. Ensure that all brands are included equally without prioritization. Prefer automated data scraping from multiple sources. Each category should include at least "A...

I'm looking for a Nodejs and web scraping expert, preferably new freelancers eager to showcase their skills. The primary goal of this project is to extract structured data from repositories for analysis. Ideal Skills: - Proficiency in Nodejs - Excellent web scraping abilities - Writing Data to CSV Experience: - Prior web scraping projects - Data extraction for analysis

...down and verify email addresses for the decision-makers we want to reach - Focus on US-based CMOs, Founders, Co-founders, and Brand Managers - Work with our existing Pipedrive database to find similar companies and contacts - Help us build killer sponsor lists across 20+ industries (from craft beer to car rentals!) Show Us You're The One: Tell us about: - Your favorite Chrome extensions for lead scraping - Whether you have Crunchbase Pro access - What data enrichment tools you're rocking (Clay, etc.) - Any other cool tools in your lead gen arsenal Industries We're Targeting: From energy drinks to airlines, we've got a diverse mix! You'll be diving into: - Auto industry - Banking & Insurance - Restaurant chains - Beverage companies (alcoholic & n...

I'm looking for a skilled data scraper who can extract emails, phone numbers, and addresses from business directories. The final product should be delivered in an Excel spreadsheet. Key Requirements: - Proficient in using web scraping tools. - Experience with extracting data from business directories. - Attention to detail to ensure data accuracy. - Ability to deliver in an Excel format. Please include samples of similar work in your proposal.

I'm currently utilizing a web scraping program for gathering product information from Ticketmaster, and I'm in need of assistance with the use of proxies to enhance the efficiency and effectiveness of the scraping process. Ideal Skills and Experience: - Proficiency in web scraping techniques and tools - Experience with using proxies for web scraping - Familiarity with Ticketmaster's website and its data structure - Knowledge of product information and ticket data - Excellent problem-solving skills to troubleshoot any issues that may arise Please reach out if you can assist with this project. Thank you!

I'm in need of an automatic script or program for posting adverts on www.milanuncios.com. This program must adhere to the following requirements: - Us...automatic script or program for posting adverts on www.milanuncios.com. This program must adhere to the following requirements: - Use a new instance (new user agent) or fresh browser for every posting. - Utilize a new proxy or IP for every posting. - Run completely automatically without manual intervention. This project is intended for a Windows compatible program. Ideal skills and experience for the job: - Proficiency in scripting and automation - Experience with web scraping and bot development - Familiarity with proxy and user-agent rotation - Knowledge of Windows programming environment - Understanding of ...

Task for UiPath Developer We are currently using UiPath for automation and need a developer to enhance workflow efficiency and ensure proper job handling. Scope of Work: 1. Prevent Unnecessary Execution: After completing the scraping process for a specific date, write "Done" in the corresponding Excel sheet. Ensure the process does not continue running when there are no new tasks. 2. Automate Video Upload & Processing: After uploading a video to YouTube, take the video file and upload it to for automatic processing and splitting into clips. 3. Upload Clips as Shorts: Once completes processing, upload the generated clips as YouTube Shorts and TikTok videos. Additional Information: A detailed video explanation of all tasks will be provided for clarity...

I'm in need of a seasoned data scraping expert to consistently extract court documents from over 15 jurisdictions in the United States. Your primary focus will be on judgements and orders. Key Responsibilities: - Web scraping and data filtering from various county clerk and court websites - Continuously gathering information on a regular basis - Filtering for targeted data Ideal Skills: - Proficiency in web scraping and data filtering - Experience with handling large datasets - Keen eye for detail If you have this skill set and experience, I would love to hear from you.

Web scraping from website - guitar tabs in photo format. Approximately 763 songs. More information in a private message.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...

I'm looking for a skilled professional in headless browser automation, primarily for the purpose of scraping product information. Key Responsibilities: - Implementing headless browser automation techniques for efficient data scraping. - Gathering comprehensive product information from various online platforms. Ideal Skills: - Proficiency in headless browser tools such as Puppeteer, Selenium, or similar. - Strong experience in data scraping, specifically from e-commerce platforms. - Excellent understanding of product information metrics and parameters. Please note that while I have not specified particular websites for data scraping, experience with e-commerce platforms will be advantageous.

I'm looking for a Python script that can download photos from specific pages on a site similar to Troostwijk Auctions. The script should save the photos...that can download photos from specific pages on a site similar to Troostwijk Auctions. The script should save the photos as JPEGs. Key Requirements: - The script should be able to navigate to specific pages and extract photos. - It should save the downloaded photos in JPEG format. - and download photos in a specific folder Ideal Skills: - Proficiency in Python, with particular experience in web scraping and automation. - Knowledge of handling and processing image files in Python. Please note that the specifics of which pages to extract photos from and the method of executing the script will be clarified after the ...

I need a skilled professional to create a website crawler for me. The primary goal of this crawler is data extraction from a single website. The data I need to be extracted includes text content, images, and links. Ideal skills for the job would include: - Proficiency in web scraping tools and programming languages (e.g., Python, Beautiful Soup, Scrapy) - Knowledge of data extraction techniques - Experience in handling and organizing large volumes of data - Understanding of ethical data scraping practices and website terms of service Please, when bidding, provide examples of similar projects you've completed in the past.