Baidu scraper jobs
I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.
I'm looking for a developer to create a scraper for dexscreener.com. Initially, it's about scraping a single coin's subpage, for example: and downloading the TopTraders for 30d and 7d, and Holders, at least the first 100 positions, preferably 250. Most likely we will be expanding the number of endpoints later. Please keep cloudflare in mind. I need your program to act as a local API endpoint, meaning I provide the address in the request and get a JSON with the data in response. I don't need to read data every second - let's say 1 coin per minute is enough for me (if that makes any difference).
I'm looking for an experienced web scraper to automate the collection of text data from various websites. Key Requirements: - Expertise in web scraping tools and techniques - Proficiency in programming languages commonly used for scraping (e.g., Python, R) - Ability to create automated scripts for repetitive tasks Ideal Skills: - Experience in handling large volumes of data - Understanding of data cleaning and processing Please note that the source websites and the intended use of the scraped data have not been determined yet, but they could range from e-commerce and social media to news sites. If you have a proven track record in web scraping and are comfortable working with text data, I would love to hear from you.
Description: I am looking for an experienced web scraper to extract product reviews and general product data for Alpine Baby Muffy and Kids Muffy hearing protection earmuffs. Project Requirements: 1. Data Extraction: Target Websites: E-commerce platforms (Amazon, eBay, Walmart, official retailers, review sites, etc.) Primary Focus: Extracting and categorizing customer reviews into: Positive remarks (what customers like) Negative remarks (what customers dislike) Additional Data Points: Product name Price Availability (in stock/out of stock) Retailer name & website URL Product specifications Customer ratings (e.g., average rating, number of reviews) 2. Data Processing & Output: Output the review remarks in a structured format (CSV, Excel, or JSON) Categorize review feedback...
I'm in need of a reliable and efficient data scraper who can pull order details from my Aliexpress account into an Excel file. The scraper should allow me to manually set a date range for the data I want to extract. -Data Requirements: I will provide a template for the data. - Frequency of Task: I would like the scraper to be user-friendly enough so that I can set a start and end date for future data scraping tasks each time I run the scrapper. Ideal skills for this project include experience with web scraping, familiarity with Aliexpress, and proficiency in Excel. A good understanding of data handling and the ability to create a user-friendly interface will be an added advantage. I have attached below a sample of output file
Website Data Scraping for The Electric Radiator Superstore Objective: To scrape and extract all relevant data from the above website for internal use. The extracted data must be well-organised, accurate, and easy to navigate for future reference. (Wordpress based but do not want to use the WP plugin) Scope of Work: 1. Data to Scrape: • Product details (e.g., product names, descriptions, specifications, features, images, pricing, and PDFs, if available). • Blogs and articles (titles, content, and associated metadata such as publication dates). • Contact details (email, phone, address, etc.). • Any other publicly accessible, relevant information. 2. Data Format: • Deliver all extracted data in a well-structured Excel/CSV format (with clear headings). &bul...
I need a proficient web scraper to extract 30,000 datasets from a single German fashion website. This includes product names, descriptions, prices, and product images (approximately 4 images per product, around 30 kB each). Key requirements: - Meticulous attention to detail to ensure accurate data capture - Experience with handling images during data scraping - Ability to deliver clean, well-organized data The final dataset should be delivered in either CSV or SQL format. Please be prepared to demonstrate your previous work in web scraping.
The product as requested, with adjustments made according to your specifications.
I'm in need of an expert data scraper who can help me gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names - General contact information Ideal Skills: - Proficient in data scraping - Familiar with Excel for data formatting Primary Deliverable: - A neatly organized Excel spreadsheet containing all the scraped data. Please note, the website is quite extensive and would require someone with expertise in data scraping.
I'm looking for a proficient web developer who can create a web scraper for a real estate website, specifically propertyfinder.com. The scraper should be able to extract comprehensive property details, agent information, size, pictures, bedrooms, and location. Key Requirements: - Extract data from - Save the scraped data in Excel/CSV format. Ideal Skills: - Proficient in web scraping - Familiarity with real estate websites - Excellent data handling skills. Please include examples of similar projects you've completed in your proposal.
I need a Python-based data scraper that can automatically scrape text data from vehicle dealership websites, such as: I would need the scraper to do multiple different URLs with the final of each CSV uploaded to my server. This scraper would need to run once a day. For example, the multiple URLs would need to be defined by the Porsche Centre search field which gives different IDs for each location, eg: I have a list of what data needs to get scraped and can help with the before/after code of where this information sites. I would also need to include some standard information to go in each CSV also. The project
I am seeking a skilled developer located in India to create a web scraper for me. The goal of this project is to collect open interest data from the National Stock Exchange of India (NSE). Key Responsibilities: - Design and implement a robust data scraping tool capable of extracting open interest data from the NSE. - Ensure the tool can operate continuously and efficiently, collecting data for analysis on a daily basis. Ideal Skills: - Proficiency in data scraping and web development. - Experience with financial market data, particularly from the stock market. - Familiarity with the National Stock Exchange of India and its data. I would prefer a freelancer who has prior experience in developing similar tools and can demonstrate their ability to deliver high-quality work in a time...
I'm in need of a skilled data scraper to extract information from a variety of sources. Website Scraping: - Text content - Links Social Media Scraping: - Data from Facebook - Data from Twitter - Data from Instagram The ideal freelancer for this project should have extensive experience in web scraping and social media data extraction. Proficiency in programming languages such as Python is a plus.
I'm seeking a proficient web scraper to extract contact details from the provided website. Ideal Skills: - Proficient in web scraping tools and software. - Experienced in data extraction from company websites. - Deliver the extracted data in Excel format.
I'm in need of a skilled web scraper to extract property listings from PropertyFinder. The project involves capturing essential details such as property descriptions, prices, locations, sizes, and pictures. Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Prior experience in scraping real estate data - Ability to handle large datasets - Attention to detail for accurate data capture - Familiarity with handling images in data scraping
I'm looking for a skilled Python developer to create a program that reads text content from the website and stores it in a Pinecone vector database, categorized by keywords. Key Requirements: - Proficient in Python programming - Experience with web scraping - Familiarity with Pinecone vector database - Ability to categorize data by keywords Please provide examples of your previous work in web scraping and vector database integration.
I need a skilled web scraper to gather data and images from residential real estate listings. The specific data fields I need are: - Property address - Price - Number of bedrooms Experience with web scraping and data processing is crucial. Please provide examples of similar projects you've worked on.
I'm looking for a skilled developer to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and export them into a CSV file via Excel. Key Requirements: - The script needs to operate automatically, without manual intervention. - It should meticulously gather: - Photos and text - Price and description - Category and SKU Ideal skills include web scraping, Python or similar programming language expertise, and experience with data handling in Excel and CSV formats. Please ensure your proposal includes relevant past projects, as well as your approach to this task.
I'm in need of a seasoned Data Scraper/Automation Specialist to create a systematic process for gathering data from multiple websites. Initially, this project will focus on 10 major brands. Key Responsibilities: - Scrape membership information, pricing, opening hours, and other relevant data weekly. - Structure and store this data in Google Sheets for straightforward analysis and historical tracking. - Set up the process so that new brands can be easily added. - Facilitate the assessment of variances within brands and the analysis of seasonal changes. Ideal Skills: - Proficiency in data scraping and automation. - Experience with Google Sheets. - Strong analytical skills to interpret the data and identify trends.
I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.
I need a proficient web scraper to extract car models and prices from various car rental websites, specifically Hertz, Avis, Sixt, and Budget. This data will be collected on a weekly basis.
Proposal for building a new scraper which contains feature. all sku from google sheet 2. Go to Website tradezone and serach for SKU 3. Fetch data like price and other required details. 4. Save Scraped data back to Google sheet Apart from all other feature you will get a two month of support as well.
I'm looking for a skilled web scraper with API development experience. The task involves extracting product information from three specific websites. Key Requirements: - Extract product descriptions from specified websites - Develop an API to facilitate this - Present data in a user-friendly JSON format Ideal Skills: - Strong background in web scraping techniques - Proven experience with API development - Attention to detail - Ability to work independently If you've successfully completed similar projects in the past, I would love to hear from you!
I need a skilled Python developer to create a web scraper for me. The scraper should be able to extract structured data, like tables, from various e-commerce websites. The project requires a deep understanding of web scraping techniques and best practices in Python.
I'm in need of an expert who can scrape live video data from video streaming services. The data should then be converted into an API, with the format being JSON. Ideal Skills: - Proficiency in web scraping - Experience in API development - Understanding of JSON format Your primary task will be to collect data from live videos on various streaming platforms and turn it into a usable API. Please note that the specific types of data to be collected have not been specified yet. Prior experience working with video data is a plus. Please bid if you have the necessary skills and experience. Looking forward to your proposals.
I'm in need of a skilled web scraper and automation expert to assist with a unique project. The task involves scraping phone numbers from a specific directory site. The project requires: - Proficient skills in web scraping, specifically targeting directory sites. - Experience with automation, particularly sending messages via WhatsApp. - Ability to create a system that triggers a WhatsApp message whenever a new phone number is detected. The ideal candidate would have a keen eye for detail, understand the importance of data privacy, and be able to deliver a seamless, efficient system.
I need a skilled web scraper who can extract data from a members area of a website. The data should be compiled and delivered in an Excel file. Website Scraping of Members Area Ideal Skills: - Web scraping expertise - Proficiency in Excel - Attention to detail
Hi. I would like to scrape oddsportal for game results,closing and opening all odds import them into excel. I am interested in soccer matches. The scraper should be able to scrape data according to date i.e. I would like to input a date range and sport (soccer) and get the match details for those matches. Further details will be discussed with bidder. I should also mention that date range for scrapping data could be quite long (i.e. months) so the output xls could be quite big. It is very important to me that scraping is done as quickly as possible (seconds) with as less clicks as possible and without hanging-up or crippling my PC while scraping. PROJECT DETAILS: Sport:----------------------Football Bookmaker:------------------Bet365, BWIN, Pame Stoixima, Stoiximan, Interwette...
I'm looking for a web scraper to help my asphalt sealing company find leads. The ideal freelancer would be able to extract information from Google, Zillow, and Chamber of Commerce websites to find both residential and commercial properties with driveways or parking lots in my local area. Key Requirements: - Ability to find and extract pertinent information from web sources, including the name, address, email, and phone number of property owners or managers. - Prior experience with web scraping and lead generation. - Capacity to prioritize the search for properties on the specified websites. Ideal Skills: - Proficient in web scraping tools and software. - Excellent data collection and analysis skills. - Familiarity with Google, Zillow, and Chamber of Commerce websites. - Exper...
I'm in need of a skilled data scraper who can extract phone numbers from various websites. Key Requirements: - Expertise in web scraping techniques and tools. - Proficiency in data sorting and filtering. - Prior experience in extracting contact details. Ideal Skills: - Web Scraping - Data Analysis - Python/Scraping Tools (like BeautifulSoup, Selenium, etc.)
I need a skilled data scraper who can efficiently extract text from JPEG images and organize it into a Google Sheet. Key Project Details: - Source Format: The images are in JPEG format. - Data Type: The data to be extracted is purely textual. - Organization: The extracted text needs to be placed in multiple columns in the sheet. Ideal skills for this task include: - Proficiency in data scraping - Experience with image data extraction - Familiarity with Google Sheets and its functionalities Please provide examples of your previous work, specifically any similar data extraction projects you've completed.
I'm looking for a skilled web scraper who can extract contact information from various e-commerce websites. Ideal Skills and Experience: - Proficiency in web scraping tools and software. - Familiarity with e-commerce platforms. - Data validation and cleaning skills. Please note, while I have not specified the exact types of contact information I'm looking for, a comprehensive understanding of e-commerce websites and their potential data points is crucial for this project.
I'm seeking a professional with expertise in data scraping, specifically with Sales Navigator, to gather leads from Sales Navigator for Indistry professional in Media Productions. You have to be based in Bangladesh to take this job. You have to have a paid Sales Navigator in order to take this job. This is a long term job. Ideal Skills and Experience: - Proven experience with data scraping and Sales Navigator. - Prior work within or knowledge of the media production industry will be highly regarded. - Excellent understanding of lead generation for email marketing purposes.
I'm in need of a skilled React developer to create a Chrome extension for me. This extension will be used to scrape product information from Aliexpress. Key Features: - The primary functionality of the extension will be product scraping. - The information should be updated in real-time. Ideal Skills and Experience: - Proficiency in React and Chrome extension development is a must. - Previous experience in creating product scrapers is highly desirable. - Knowledge of ecommerce platforms and their product data structures will be an advantage. Please provide examples of similar projects you have worked on in your bid.
The goal is to activate and configure workflow management scenarios based on specific YouTube videos and JSON file...interpret and implement instructions from YouTube videos and JSON files - Excellent communication skills for potential clarifications 1. Use the JSON from this and connect it with all connectors to make this work. 2. fix/run this and connect it with all connectors to make this work. 3. fix/run the N8N Ultimate Scraper - Workflow it with all connectors to make this work. 4. fix/run the Supabase_RAG_AI_Agent_PDFs_Excel - Workflow it with all connectors to make this work. than connect #3 to #4. need to make all 4workflows work end to end this is 5-6 hours if you are a professional with n8n
The scraper needs to perform three main tasks: 1. Collect detailed data for each SKU. This includes the full product description, images and SEO metadata. 2. Gather reviews for each SKU. 3. Monitor availability for each SKU. Store all this information in Postgres DB and push to Airtable or - Phase 1 - Budget 150 USD Enrich and push data to Shopify store(s) - Phase 2 - Budget 150 USD The attachment has details about each phase with CLEAR INSTRUCTIONS & REQUIREMENTS. Ideal candidate: Expert scraper w/ experience in getting around Cloudflare and anti-scraping mechanisms Strong scripting skills for cleaning html and unwanted JS Good command over Postgres DB for manipulating data Comfortable with Linux / WSL Extra bonus points if you have experience with Airtable and S...
I'm looking for a proficient web scraper who can extract company names and addresses from 5 specified business websites. The final data should be meticulously organized and delivered to me in an Excel spreadsheet. Ideal Skills: - Web scraping - Data entry - Proficient with Excel Please bid if you have relevant experience and can deliver quality work.
PLEASE READ CAREFULLY!!! IF YOU DON'T HAVE EXPERIENCE WITH BET365 DO NOT MAKE ANY OFFER!!! IT'S A VERY HARD WEBSITE TO SCRAPE WITH AN HIGH LEVEL OF PROTECTION I'm seeking a skilled web scraper to gather live match data from Bet365, specifically focusing on Football, Basketball, and Tennis. Key Requirements: - A script for a Connection to the socket. - Capture live odds on match events. - Experience with web scraping, specifically with sports data, is highly preferred. JAVA or PYTHON. Java is preferred Please provide examples of similar projects you've completed in the past.
I'm looking for a talented web scraper who can efficiently extract data from a specific website. The project involves navigating through pagination and scraping data from approximately 5,004 records. Requirements: - The data to be scraped is primarily text, specifically contact information from each record. - The scraped data needs to be delivered in a CSV file. Ideal Skills: - Proficiency in web scraping tools and programming languages (like Python, BeautifulSoup, Scrapy etc.) - Excellent attention to detail to ensure accurate data collection. - Previous experience in scraping websites requiring pagination and search inputs.
Hello. Could you make me a web scraper that would extract html from page? (CF protected)
...Ligna CRM: A centralized platform for managing leads, cases, and client services. • N8N Automation: An orchestration tool for workflow automation across all platforms. • SMS & Calling Tool: A communication solution for appointment scheduling and follow-ups. • Court Record Scraper: A data extraction tool for real-time public eviction record collection. 2. Workflow Steps Step 1: Court Records Scraping and Lead Generation Objective: Automate lead generation by scraping public court eviction records. Process: 1. Use a scraper to extract eviction case details (e.g., property address, landlord, case status). 2. Enrich extracted data by appending missing contact information (emails, phone numbers) via APIs. 3. Automatically upload leads to Ligna CRM using N8N. ...
I'm looking for an AI programmer to build a program that can scrape and scan various social media platforms. The goal is to gather specific information related to real estate. Target Platforms: - Facebook - Instagram - LinkedIn - X Criteria for Scraping: - The program should focus on posts from people discussing moving to Arizona, in any context. Data Classification: - The program should classify and upload posts and comments, engagement metrics, and contact information to a CRM program for marketing and lead generation. Ideal Skills: - AI programming - Data scraping - CRM integration - Real estate market understanding - Social media familiarity Experience with these platforms and understanding of real estate-related content will significantly improve the quality and efficiency ...
The goal is to activate and configure workflow management scenarios based on specific YouTube videos and JSON file...interpret and implement instructions from YouTube videos and JSON files - Excellent communication skills for potential clarifications 1. Use the JSON from this and connect it with all connectors to make this work. 2. fix/run this and connect it with all connectors to make this work. 3. fix/run the N8N Ultimate Scraper - Workflow it with all connectors to make this work. 4. fix/run the Supabase_RAG_AI_Agent_PDFs_Excel - Workflow it with all connectors to make this work. than connect #3 to #4. need to make all 4workflows work end to end this is 5-6 hours if you are a professional with n8n
I'm looking for a skilled data scraper to extract product details from a secure website. The data to be scraped includes: - Product name and price - Product description - Product specifications Ideal skills for this project include: - Proficiency in web scraping tools and techniques - Experience in handling secure sites - Strong understanding of JSON Please note, the primary focus of this project is on text content related to product details. Experience in scraping similar data will be an advantage.
Python Web Scraping Specialist with Advanced Scrapy Expertise Company Overview: We are an innovative tech company specializing in developing cutting-edge software solutions for the automotive industry. Our flagship platform aggregates and standardizes car data from various sources, enabling a seamless meta-search experience for users worldwide. Role Overview: We are looking for an Advanced Web Scraping Specialist with extensive Scrapy experience and exceptional Python skills to join our team. This role involves developing and integrating custom web scrapers into our sophisticated scraping automation system. You will handle challenges like bypassing complex web protections, managing proxy rotations, and working within a multi-layered software architecture. Key Responsibilities: Design, d...
I'm looking for a proficient data scraper who can extract comprehensive product information from a specific website. Key Requirements: - Data to be scraped includes: product names and descriptions, product prices, product specifications, make year, and color. Skills and Experience: - Prior experience in web scraping, particularly product data is highly preferred. - Proficiency in tools like Python, Beautiful Soup, Scrapy, or similar. - Ability to deliver the data in a CSV file as per my requirement. I look forward to your bids. Thank you.
I'm seeking a professional in web scraping to help me gather contact information for lead generation. The data will primarily be sourced from Company Websites and Industry Directories. - Specific Data: I need the following contact information: - Email addresses - Phone numbers - Website links Ideal candidates should have extensive experience in complex web scraping, with a proven track record of successfully generating leads. Proficiency in data extraction tools and software, along with excellent attention to detail, is crucial.
Description: I am looking for a skilled web scraping specialist to develop a program that scrap...com/uk/en/product/ATV212HD75N4/ Where ATV212HD75N4 is the product code. Deliverables Fully functional web scraping program (preferably in Python or a commonly used scraping language). Well-commented source code. Instructions for running the program. Sample output file based on test data. Notes The program should handle potential issues like missing products on specific localizations gracefully. The scraper must adhere to best practices and avoid triggering any anti-scraping measures. Skills Required Web scraping expertise (preferably with Python libraries such as Beautiful Soup, Scrapy, or Selenium). Experience with handling multi-localized websites. Data handling and export to CSV/XLS...
I'm in need of a skilled data scraper who can gather contact information for business owners in specific industries. Key Requirements: - Data to be collected includes: first name, last name, work and personal email address, and cell phone number. - More than 500 business owners' data is required. - Industries of interest: roofing, restoration, paving, and landscaping. Ideal Skills/Experience: - Proficiency in data scraping from various sources. - Familiarity with the specified industries. - Prior experience with lead generation or business contact data collection. - Ability to provide accurate and up-to-date information. LEAD RATE IS .15 PER LEAD
