Web scraping for dummies jobs

...created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Libre and similar platforms sometimes update their anti-scraping security measures. Therefore, I need a long-lasting, robust code that will remain functional over time. In case of failure, I require lifetime support as this functionality is the core of my operation. My website is: Please provide the implementation timeline and cost. I’ve already had a freelancer do it poorly, resulting in wasted time and a refund. I ...

Please Sign Up or Login to see details.

I'm looking for a proficient web scraper who can extract the tokens from the GMGN website. The data should be delivered in a neatly organized CSV file. I want to scan this web: I want that every time a new token appears on the right side (Gastado en DEXScreaner) I save in a csv both the date/time, the token name and the token address. The website I pull from will keep the filters applied (I think if I'm logged in it will keep them). Python code to be able to do this scanning every minute. (En Jupyter notebook) When a new token appears in this window, add it to the CSV. Translated with (free version) Ideal skills for this project include: - Proficiency in web scraping tools and languages (like Python, BeautifulSoup, Scrapy etc....

I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.

I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.

...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data's from the stated Site in to o...

...site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site : Check the above websites and need something similar ASAP

I'm seeking a skilled data scraper to extract stock prices from Yahoo Finance. The data should cover both the NYSE and NASDAQ. Key Responsibilities: - Scrape real-time and historical stock prices from Yahoo Finance. - Implement data scraping in a way that it can be run periodically. - Store the scraped data into a MySQL database using "INSERT ON DUPLICATE KEY UPDATE" to handle potential duplicates. Ideal Skills: - Proven experience in web scraping, particularly finance data. - Strong knowledge in MySQL and data management. - Familiarity with Yahoo Finance and stock market data. Please bid if you can provide a prototype and have experience in similar projects.

I'm seeking an experienced researcher to compile a detailed list of private drum instructors across the entire East Coast of the US and ...aimed at enhancing outreach and potential engagement. Key Responsibilities: - Research and document private drum teachers who possess personal websites showcasing their drumming and teaching services. - Gather and verify essential contact details: First Name, Second Name, Email, Web URL, City. - This project requires search engine research and music teacher directories, NOT LinkedIn scraping. Deliverable: - The final list should be delivered in a Google Sheets or excel document. Ideal Skills: - Proficient in web research and data collection. - Familiarity with music teacher directories preferred. - Previous experience in lea...

I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and provide updates on their progress. Thank you for considering my project.

I'm in need of a seasoned sales professional with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note, this project requir...

I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I need assistance with extracting data from a PDF and placing it into an Excel format I will provide. Key Requirements: - Data extraction from the PDF should be done according to specific column headers in the provided Excel format. - Minor data cleaning is needed during the extraction process. Ideal Skills: - Experience in data scraping. - Proficient in Excel. - Attention to detail for data cleaning.

An AI-powered data extraction tool for marketing sector. The tool would be designed to scrape data from multiple sources, including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The ...

I'm looking for a skilled professional who can suggest a reliable, low-latency proxy service for my web scraping project. The script currently targets public APIs and without a proxy, it's taking around 200ms to hit the endpoints. With a proxy, I need the latency to be between 300-500ms max. Key Requirements: - The proxy service should be located in Australia - The IP rotation level should be low, with only a few changes per day - The service should not require any specific authentication methods, as the APIs I am using do not require authentication I've previously tested several proxy services but most of them resulted in latency around 750ms, which is not suitable for my needs. Please only bid if you have experience with a proxy service...

Another scraping project - Need cover art based on ISBN and Author Name

I need someone to scrape data from a service guide website into a Google Sheets document. The data includes Company Name, address, Name, email, phone, mobile, website etc etc from 9632 entries across 20 categories. Ideal candidates for this project should have: - Proficient data scraping skills - Experience with Google Sheets - Attention to detail to ensure all data is accurately captured from all 20 categories.

...such as ChatGPT’s API, and adapt it for this utility. The goal is to educate and fine-tune the ChatGPT API to perform the specific tasks of chatting, engaging, and selling content on while being fully integrated with a CRM system for easy management by agencies. About is a platform similar to OnlyFans, where creators sell private content (photos/videos) through direct messages (DMs). A unique aspect of is that media is sold as if it is being sent "live" in real-time, even though the content is pre-uploaded and organized in sequences called scripts. However, does not currently offer an API. This means the AI will need to interact with the platform through alternative methods, such as browser automation or scraping techniques, to send messages, m...

I'm looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone numbers, from various sources. Key Requirements: - Proficiency in data scraping from company websites, business directories, and social media platforms. - Experience in lead generation. - Expertise in logistics, warehousing, and ecommerce sectors is a plus. Ideal Skills: - Data mining - Web scraping - Lead generation - Knowledge of ecommerce and logistics industry

I'm seeking a detailed list of restaurants in the Australian Capital Territory for a new food delivery app. The list should encompass all types of eateries – from fine dining to fast food. Key Requirements: - Data Points: The list must include the restaurant's email addresses, phone numbers, website URLs, full addresses, as well as their Facebook pages, Instagram handles, X profiles, TikTok accounts, and YouTube channels. - Type of Restaurants: All types, not limited to a specific category. Ideal Skills: - Data mining and web scraping - Market research - Familiarity with the Australian restaurant scene is a plus Please note, the main purpose of this data will be to support the launch and growth of a new food delivery app. Your expertise and attentio...

I'm looking for a talented Indian developer who can create an automation system for stock trades on Angel One. Key Requirements: - The system must scrape stock recommendations from a designated website, which only provides BUY signals, up until 3:30 PM. - Trades should be automatically executed in MTF (Margin Trading Facility) options. - The system needs to ensure seamless, real-time order placement without any manual intervention. The system should check for new stock recommendations every minute. Ideal Skills: - Proficient in Web Scraping, particularly with tools like BeautifulSoup, Selenium, and API integration. - Experienced in working with Trading APIs, specifically Angel One. - Skilled in Python or Node.js for automation. - Previous ...

Start your reply with SCRAPER. Won't read any other post. I need a script that can scrape text and articles from a specific site and similar ones. The data should be delivered in a CSV file. The script only needs to run once. Ideal skills and experience for this job include: - Proficiency in web scraping tools and programming languages such as Python, Beautiful Soup, Scrapy, or similar. - Experience with data formatting and export to CSV. - Knowledge of how to make the script compatible with similar sites. Please include examples of previous similar projects in your bid. We have a tight budget as we know this is an easy job. We don't need the outcome. We need the script. Starting point: Data to be scraped on the next page of an item on image attac...

Title: Web Scraper Needed to Extract Data from UAE Websites: - "Mango" - "Marks & Spencer" - "H&M" Description: I am looking for an experienced web scraper to build a script that can reliably scrape product data from the "Mango", "Marks & Spencer" and "H&M" UAE websites. The end goal is to produce a CSV file for each brand containing all relevant product information as well as provide the code used for the scraping process. Project Requirements: Websites: "Mango" UAE (), "Marks & Spencer" UAE (), "H&M" UAE () Data Points Needed: Product name Product category Price Product description Product images (URLs) Shop Address Shop working hour...

I'm in need of a professional who can extract video links from a streaming service and enable me to embed these on my website. The essential requirement is for the videos to be playable directly on my site. Ideal skills and experience for the job include: - Knowledge of web scraping and link extraction - Experience with embedding video links on a website - Proficiency in web development - Familiarity with streaming services - Demonstrable integrity and respect for copyright laws

I need Power Automate Desktop developer to help me capture a certain data filed on a web page.

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.

I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).

I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.

I am in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance the efficiency of my data collection process. ...

I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.

Description over freelancer and Video Call

We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximity to transport, scho...

I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated

I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.

...professional who can scrape a Telegram group for content without crossing the platform's limits. The goal is to create a 24/7 with near realtime data and create either an application dashboard or simple csv with pivot/histogram for an easy visualization. Someone who already worked on similar request is preferred to avoid number being blocked so scheduled breaks are required in the code. Request is only to get the content and put in the easy readable format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless for ...

I need a skilled web scraper to assist with my real estate business. This involves scraping a real estate website that updates daily with 2,000–3,000 listings. The goal is to extract and match the data with realtor needs from my internal database. Requirements: - Daily scraping of 2,000–3,000 listings. - Extract relevant data such as price, property type, location, realtor name, contact info, and more. - Basic matching for a specific region. Budget: I’m ready to pay $40/month for this service. Ideal Skills: - Proficient in web scraping techniques and tools. - Experience in data extraction and analysis. - Familiarity with real estate data is a plus. - Able to perform basic data matching. Note: Please be aware that the l...

I'm looking for a data scraping expert to help me gather product information from three websites. The specific data I need includes product names and prices as well as product descriptions and specifications. The task is a one-time requirement, so I don't need ongoing updates. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience in extracting product information from e-commerce websites - Strong attention to detail to ensure accurate data collection

I have an existing scraper built in python for the website (CWH). It scrapes the following information: - product description, price, images - SEO metadata - Additional metadata Currently, all the scraped data is stored in a CSV file. I am looking for a developer who has expertise in python / scraping and postgres to do the following: [Phase / Milestone 1] 1. Convert the existing scraper (code attached - /site-packages removed for space) to load the data in a postgres database. 2. Scrape reviews of products from the (CWH) website and store them in the database. 3. Look up the availability of the product in specific stores and write the boolean value in the postgres database. (code attached - ) [Phase

I'm in need of a Python script that can download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from ...download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from a public website every hour. - Upload the report to a specific portal folder without any modifications. Ideal Skills: - Proficient in Python programming. - Prior experience with web scraping and automating tasks. - Familiarity with working with Excel files in Python. - Knowledge of file upload pr...

I'm in need of a versatile professional skilled in Squarespace and Canva. Your primary task will be to set up product pages on Squarespace, particularly focusing on integrati...tasked with creating a series of Canva social media posts and setting up an e-learning course in Squarespace (I will provide the written content). Additional responsibilities will include various general marketing tasks, such as scraping email addresses. Ideal Skills: - Proficiency in Squarespace and Canva - Experience in e-learning course setup - Knowledge of basic marketing tasks - Skills in data scraping Understanding of product fulfillment and delivery integration on e-commerce platforms is crucial for this role. Looking forward to your bids. Looking for ongoing pers...

I'm looking for a skilled PHP developer to create a dynamic web scraper for trading data. The scraper needs to collect price data from various sources, namely: - Stock market websites - Cryptocurrency exchanges - Forex trading platforms The data should be collected in real-time, so experience with PHP and web scraping is a must.

...provide a detailed description below. 1. Excel Spreadsheet: Please create an excel spreadsheet with the following columns. Column A: Label: “Video title” In this column, please provide the video title to match the title of the video download. For example, if you look at this TikTok video (@returnhomenor/video/7164090596796157230?lang=en), you would label the cell in this column: “Allow us to introduce ourselves!” Column B: Label: “Hashtags” In this column, please provide all of the hashtags included in the post. For example, for the same TikTok video shared above, you would put the following string in this cell in this column: “#terramation #humancomposting #naturalburial #greenburial #mortician #funeraldirector #greenfune...

I'm in need of a freelancer who can assist me with data entry of realtor information (name, company name, phone number, email, city) from multiple websites onto an excel sheet. This data needs to be formatted in a way that it can ea...freelancer who can assist me with data entry of realtor information (name, company name, phone number, email, city) from multiple websites onto an excel sheet. This data needs to be formatted in a way that it can easily be imported into my CRM. Key Tasks: - Source realtor information from multiple websites - A combination of web scraping and manual data entry - Processing of more than 500 entries Ideal Skills & Experience: - Proficient in Excel - Experience with web scraping - Detail-oriented to ensure data accuracy - Ab...

I am seeking a skilled freelancer to develop an online dashboard that consolidates data by scraping three specific webpages and processing files from an online consultation system with restricted access (user and password protected). The dashboard must include the functionality to download PDF reports and present the data in a user-friendly and analytical format. A detailed explanation of the webpages to be scraped is provided in the attached PDF. 1. Key Responsibilities: Design and implement an online dashboard with secure user authentication and restricted access. Scrape data from three specified websites, utilizing anticaptcha to bypass CAPTCHA requirements. Integrate uploaded files from an online consultation system. Enable the generation and downloading of PDF reports directl...

Please Sign Up or Login to see details.

I'm looking for a skilled WordPress developer to create a custom plugin for related posts. The plugin should be able to: - Search external websites based on a list I provide - Identify similar articles using the keywords in my site's post titles - Automatically posting 3-5 related titles with hyperlinks on the original site The ideal freelancer for this project should have a solid understanding of WordPress plugin development, web scraping, and SEO practices. Experience with creating similar plugins in the past will be a big plus. The objective is to increase my site's interactivity and improve its SEO ranking through relevant external links.

I need a software engineer to create a Python SDK/package for scraping Reddit data. The package should accept either an email address or a LinkedIn profile URL as input to identify and retrieve data from a person's Reddit account. Key Responsibilities: - Build a Python package that takes a person's identifier (an email address or LinkedIn profile URL, both are suitable as options) as input. - Implement logic or utilize third-party APIs to identify the person's Reddit account. - Scrape the person's Reddit activity, including posts, comments, and likes. - Structure the retrieved data for easy access by the package user. The choice of third-party APIs for identifying Reddit accounts is open. The freelancer may choose whatever they think is mos...