Baidu scraper työt

Rekisteröidy tai kirjaudu sisään nähdäksesi tiedot.

I'm looking for a fast Waze scraper that covers all of Australia. The scraper should not rely on Georss. It needs to collect data on traffic incidents and submit it to a provided API endpoint in real-time. Ideal Skills: - Data scraping - API integration - Python or similar programming language expertise Experience: - Previous work with Waze data is a plus - Demonstrated ability to build real-time data scrapers - Experience with large scale data collection

I'm in need of a proficient data scraper who can extract the staff list from a specified university website. The data fields I require are: - Name - Email - Phone number - Department - Designation The scraped data needs to be delivered in CSV format. This is a one-time project, so I won't need recurring updates. Ideal skills and experience include: - Proficiency in data scraping tools and software - Experience with web scraping from .edu websites - Strong attention to detail for data accuracy - Ability to deliver data in specified format (CSV) Looking forward to your proposals.

I need a Telegram scraper that will collect user data from specific groups on Telegram. This data will be used to create a contact list. Key Responsibilities: - Scraping data from members of designated Telegram groups - Compiling this data into a usable contact list Ideal Skills: - Proficient in data scraping - Experienced with Telegram's platform - Able to respect privacy and ethical guidelines in data collection

I'm in need of a skilled data engineer to develop an automation scraper for me. The primary source for this project will be various websites, with the specific task of extracting the raw response from the API endpoint network response in JSON format. Key Requirements: - Development of a real-time data scraping tool - Experience and proficiency with web scraping - Ability to extract and process API network responses - Knowledge of working with JSON data - Familiarity with using Datadoom for data protection The ideal candidate for this project should have a strong background in data engineering, web scraping, and API interaction. If you are capable of creating a scraper that works in real-time and can handle the complexities of extracting and interpreting raw API respons...

I need a skilled data scraper to extract specific text content from a website. The data I need is the "Video Uploader URL". The challenge is that this information is only visible on the page, not in the HTML. Ideal Skills and Experience: - Proficient in web scraping techniques and tools - Experience with scraping data from websites that block data from showing in the HTML - Knowledge of programming languages such as Python, with libraries like BeautifulSoup and Scrapy - Attention to detail and ability to deliver clean, structured data The data extraction is a one-time process, with no need for future updates. Please deliver the scraped data in a CSV file format. Please ensure that anti-scraping measures on the website are handled properly. Please handle anti-scraping me...

I'm looking for a skilled web scraper who can extract historical data (pre-2024) from specific Twitter, Reddit, and Facebook accounts and forums. The task also includes scraping popular posts containing specific keywords on these platforms, as well as data from certain independent blogs. Key Requirements: - historical (pre-2024) social media platform content & engagement by specific accounts, pages, groups, or keywords Additional Information: - All the specific accounts, forums, and keywords, have been identified. - Summary of how data was scraped will be required for - Need both raw and basic cleaned copies of data. - Employer is an SME in topic that data is being collected about, and is available for consultation during scraping project. - There is also a potential o...

I'm seeking a professional web/API scraper with expertise in AI. The goal is to collect detailed information on business association conferences located in Sydney and the Gold Coast. You will need to find all the Australian Business associations first. Key Requirements: - Scrape conference dates and venue details - Deliver the data in a well-structured CSV file Ideal Skills: - Proficiency in web scraping tools and programming languages - Experience with AI development - Attention to detail and data accuracy Please only apply if you can demonstrate relevant experience in your proposal.

I'm looking for a skilled data scraper and processor. The project involves scraping image data from a website, opening attachments, extracting information from scanned image PDFs, consolidating and cleaning textual data, and then copying this data along with a prompt onto a second website. Lastly, you will need to capture the conclusion from this website and paste it onto Notepad. Ideal skills and experience for this job include: - Proficient in web data scraping - Experienced in data extraction from scanned image PDFs - Skilled in data cleaning and consolidation - Capable of accurately copying and pasting data - Familiar with Notepad for data entry Please apply if you are detail-oriented, efficient, and can handle large amounts of data.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.

I'm in search of a proficient web scraper to assist me in collecting the websites and emails of numerous service providers. The main objective is to compile this information for email marketing initiatives. Key Requirements: - The scraper needs to navigate standard HTML websites and those requiring logins. - Prior experience in web scraping with an emphasis on collecting contact details is highly preferred. - The scraper should also provide the tools or script used for data collection. Please bid only if you possess the necessary skills and experience. Your bid will be considered only if you have a proven record in web scraping and can demonstrate your ability to gather contact information efficiently.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.

I'm looking for an experienced web scraper to extract contact information from corporate websites. The required data includes emails, phone numbers, website addresses, country, and the physical address of the company. The final output should be delivered in an Excel format. Ideal skills for this job: - Proficiency in web scraping tools and techniques - Prior experience in data extraction from corporate sites - Strong attention to detail Please provide samples of previous similar work in your proposal.

I'm looking for a creative professional who can assist me with modern-style social media graphics, graphic design for a minimalist logo, and a web scraper to collect contact information. Ideal skills and experience include: - Proficiency in graphic design, particularly in creating social media graphics. - Experience in logo design, preferably in a minimalist style. - Ability to design in a modern aesthetic. - Proficient in web scraping, specifically in collecting contact information. - Experience in graphic design for creating .pdfs. - Proficient in typing and creating .pdfs.

I'm looking for a web scraper that can collect product details from eCommerce websites. The data I need includes the title and description, price and availability, as well as images and specifications. Ideal Skills: - Proficiency in web scraping tools and techniques - Experience with eCommerce website scraping - Familiarity with data handling and processing Please feel free to reach out if you have any questions or if you need further information.

I'm looking for a skilled developer to create a web scraping application that will extract data from the National Park Service and Reserve CA websites. Data Requirements: - The application should pull in data about wilderness permits and campsites, specifically their availability and booking details. - Include information on various types of wilderness permits available. - Capture detailed location information for each campsite and permit. - Scrape data on the limits or quotas for each permit type and campsite. - Extract data on the booking windows and timelines for each permit and campsite. - Extract detailed fee information for each permit and campsite. - Capture data on seasonal availability for permits and campsites. Frequency: - I need this data to be scraped daily. Ideal Ski...

I'm seeking a skilled Python and Selenium developer to create a user-initiated web scraper for Chrome. The script will gather contact data, basic information, email addresses, and social media profiles (specifically YouTube, Vimeo, and ), triggered by the Ctrl + M keyboard shortcut. Key Requirements: - Python and Selenium expertise - Web scraping proficiency, particularly from social media platforms - Ability to save scraped data to a .CSV file The desired basic information includes the contact's name, email, social media profiles, and profile image URLs. The scraper should be able to initiate data collection for each contact upon pressing Ctrl + M. Ideal Skills: - Python - Selenium - Web Scraping - CSV file handling Please bid if you have relevant experience a...

Update on scraper

I'm looking for a skilled web scraper to extract product details from a specific website's database. The information that I need includes product descriptions and specifications. The final output should be an Excel file with the data organized in separate columns for each detail. Ideal Skills and Experience: - Proficient in web scraping - Experience with Excel - Attention to detail - Ability to deliver data in specified format

My Rails 8 application scrapes specific Real Estate listings using Selenium. Since migrating from Heroku to Digital Ocean, the scraper is now getting blocked by Cloudflare and other anti-bot protections. Your tasks include: - Modifying the existing scraper code (which I can provide) to make it undetectable and robust. - Ensuring the scraper works consistently, not just occasionally. - Implementing stealth techniques to bypass bot detection. - Testing the solution in the Rails console. Skills Required: - Ruby on Rails 8 - Selenium & Web Scraping - Cloudflare Bypass Techniques - Experience with Proxies & Browser Fingerprinting Avoidance Budget: Open to reasonable offers. Timeline: ASAP. If you have experience making scrapers stealthy and reliable, apply now...

I'm looking for a skilled data scraper who can extract emails, phone numbers, and addresses from business directories. The final product should be delivered in an Excel spreadsheet. Key Requirements: - Proficient in using web scraping tools. - Experience with extracting data from business directories. - Attention to detail to ensure data accuracy. - Ability to deliver in an Excel format. Please include samples of similar work in your proposal.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.

...powerful framework for large-scale scraping. Selenium: For dynamic websites that require interaction (e.g., clicking buttons or loading more products). 2. No-Code Tools (for non-programmers) Octoparse: A visual web scraping tool. ParseHub: Another no-code tool for extracting data. WebHarvy: A point-and-click web scraper. 3. APIs (if available) Check if PB Tech NZ provides an official API for accessing product data. If not, scraping is the only option. Step 3: Write a Web Scraper (Python Example) Here’s an example of how to scrape product data using Python: Install Required Libraries bash Copy pip install requests beautifulsoup4 pandas Scrape Product Data python Copy import requests from bs4 import BeautifulSoup import pandas as pd # URL of the PB Tech categor...

I need an experienced web scraper to urgently scrape product name, price, and ratings from Amazon. Ideal Skills: - Proficient in web scraping tools and software - Excellent attention to detail - Able to deliver data in a clean, organized format Please note, this is a one-time project.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.

I'm looking for a skilled data scraper who can extract all available information from a specific e-commerce website. This includes, but is not limited to, product details, customer reviews, and pricing information. I need all available information. Please consider that there are also product variants. Work needs to be done today! The ideal candidate should: - Have a strong background in data scraping - Be proficient in using data extraction tools - Have experience dealing with e-commerce websites. The scraped data should be delivered in an Excel format. Please note, this is a one-time project, I do not require ongoing data scraping. If you read everything, please write "DATA" in your message.

I'm in need of a skilled data scraper who can extract text data from various websites and deliver it in a JSON format suitable for training a Language Learning Model (LLM). Key requirements: - Proficient in web scraping and familiar with extracting text data. - Experienced in structuring and delivering data in JSON format. - Understanding of the requirements for LLM training data. Please provide examples of previous similar projects in your bid.

I'm currently using a Selenium driver via Excel VBA to scrape a website, but I'm running into some issues that I need help fixing. The project involves a scrollable table where the link element needs to come into view before data can be extracted. Key Problems: - Extracting data from the table consistently fails. - Many elements are not found when trying to scroll the table into view. Methods Tried: - I have attempted using Execute JavaScript to scroll the table into view. I am happy to share my current code and provide access to the website so that you can see the problem first hand. I am looking for a freelancer who has experience with Selenium and Excel VBA and can help me fix this quickly.

I'm currently using a Selenium driver via Excel VBA to scrape a website, but I'm running into some issues that I need help fixing. The project involves a scrollable table where the link element needs to come into view before data can be extracted. Key Problems: - Extracting data from the table consistently fails. - Many elements are not found when trying to scroll the table into view. Methods Tried: - I have attempted using Execute JavaScript to scroll the table into view. I am happy to share my current code and provide access to the website so that you can see the problem first hand. I am looking for a freelancer who has experience with Selenium and Excel VBA and can help me fix this quickly.

I need a proficient web scraper to extract detailed shipping data from AliExpress products. Key Information to be Scraped: - Shipping options - Shipping costs - Estimated delivery times - Shipping Country - option to add the countries i want to scrape Need to be able to scrape all shipping methods/options and cost. I should be able to add the link(s) of the products i want to scrape and output to be in file format for easy view. i should also have the option to choose the countries all or specific countries i want.

I'm looking for an experienced data scraper who can gather information from various social media platforms. Ideal Skills: - Proficient in web scraping techniques - Familiarity with social media platforms - Excel data management skills The scraped data needs to be compiled in an Excel format. The specifics of the data to be scraped will be discussed in further detail with the chosen freelancer. Please include relevant experience in your proposal.

...detection of meme and microcap tokens. The system should analyze trading and social media data to identify potential trends, assess security aspects, and minimize fraud risks (e.g., rug pulls). Key Requirements: 1. Data Sources & Processing Twitter Scraper Utilize the Twitter API to capture mentions of new tokens ($TOKEN_NAME, #TOKEN, etc.). Analyze tweet frequency, engagement (retweets, likes), and influencer participation (>30k followers). Perform sentiment analysis (positive/neutral/negative) to assess the overall sentiment. DexScreener Scraper Retrieve new token trading pairs via the DexScreener API. Collect data on volume, number of trades, and identify sponsored listings. Automatically filter based on trading activity (>100 trades/hour, >20 trades/5 min...

...connect to Ali's voice API and OpenAI's real-time API) Add AI thinking logic effects (similar to OpenAI o1, add the effect of the thinking process, and modify the steps of the AI response. The AI can give the user the answer to the reasoning (reasoning logic: first generate the content framework, and in the second step, improve the content of the framework). Optimize the AI search function (add the Baidu search API, and after searching, the content should be organized and fed back to the user with the AI). When there is a problem with the AI response/call, display a message saying “The system is busy, please try again later.” Add a prompt to the bottom of the AI frame page. Add AI fixed commands, download file function, and speech-to-text function. AI drawi...

More details: What is the main source of the data you want to scrape? API Which website do you need to scrape data from? E-commerce site Which specific data do you need to scrape from the e-commerce site? Product details, Pricing information

Scrape agent's full name, company, mobile number, and suburb from the provided RealCommercial link. Store the data in a structured spreadsheet format. Remove duplicate entries to ensure clean data. Deliver the final CSV or Excel file.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from these news sites.

I'm looking for a developer to create a scraper for dexscreener.com. Initially, it's about scraping a single coin's subpage, for example: and downloading the TopTraders for 30d and 7d, and Holders, at least the first 100 positions, preferably 250. Most likely we will be expanding the number of endpoints later. Please keep cloudflare in mind. I need your program to act as a local API endpoint, meaning I provide the address in the request and get a JSON with the data in response. I don't need to read data every second - let's say 1 coin per minute is enough for me (if that makes any difference).

I'm looking for an experienced web scraper to automate the collection of text data from various websites. Key Requirements: - Expertise in web scraping tools and techniques - Proficiency in programming languages commonly used for scraping (e.g., Python, R) - Ability to create automated scripts for repetitive tasks Ideal Skills: - Experience in handling large volumes of data - Understanding of data cleaning and processing Please note that the source websites and the intended use of the scraped data have not been determined yet, but they could range from e-commerce and social media to news sites. If you have a proven track record in web scraping and are comfortable working with text data, I would love to hear from you.

Description: I am looking for an experienced web scraper to extract product reviews and general product data for Alpine Baby Muffy and Kids Muffy hearing protection earmuffs. Project Requirements: 1. Data Extraction: Target Websites: E-commerce platforms (Amazon, eBay, Walmart, official retailers, review sites, etc.) Primary Focus: Extracting and categorizing customer reviews into: Positive remarks (what customers like) Negative remarks (what customers dislike) Additional Data Points: Product name Price Availability (in stock/out of stock) Retailer name & website URL Product specifications Customer ratings (e.g., average rating, number of reviews) 2. Data Processing & Output: Output the review remarks in a structured format (CSV, Excel, or JSON) Categorize review feedback...

I'm in need of a reliable and efficient data scraper who can pull order details from my Aliexpress account into an Excel file. The scraper should allow me to manually set a date range for the data I want to extract. -Data Requirements: I will provide a template for the data. - Frequency of Task: I would like the scraper to be user-friendly enough so that I can set a start and end date for future data scraping tasks each time I run the scrapper. Ideal skills for this project include experience with web scraping, familiarity with Aliexpress, and proficiency in Excel. A good understanding of data handling and the ability to create a user-friendly interface will be an added advantage. I have attached below a sample of output file

Website Data Scraping for The Electric Radiator Superstore Objective: To scrape and extract all relevant data from the above website for internal use. The extracted data must be well-organised, accurate, and easy to navigate for future reference. (Wordpress based but do not want to use the WP plugin) Scope of Work: 1. Data to Scrape: • Product details (e.g., product names, descriptions, specifications, features, images, pricing, and PDFs, if available). • Blogs and articles (titles, content, and associated metadata such as publication dates). • Contact details (email, phone, address, etc.). • Any other publicly accessible, relevant information. 2. Data Format: • Deliver all extracted data in a well-structured Excel/CSV format (with clear headings). &bul...

I need a proficient web scraper to extract 30,000 datasets from a single German fashion website. This includes product names, descriptions, prices, and product images (approximately 4 images per product, around 30 kB each). Key requirements: - Meticulous attention to detail to ensure accurate data capture - Experience with handling images during data scraping - Ability to deliver clean, well-organized data The final dataset should be delivered in either CSV or SQL format. Please be prepared to demonstrate your previous work in web scraping.

The product as requested, with adjustments made according to your specifications.

I'm in need of an expert data scraper who can help me gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names - General contact information Ideal Skills: - Proficient in data scraping - Familiar with Excel for data formatting Primary Deliverable: - A neatly organized Excel spreadsheet containing all the scraped data. Please note, the website is quite extensive and would require someone with expertise in data scraping.

I'm looking for a proficient web developer who can create a web scraper for a real estate website, specifically propertyfinder.com. The scraper should be able to extract comprehensive property details, agent information, size, pictures, bedrooms, and location. Key Requirements: - Extract data from - Save the scraped data in Excel/CSV format. Ideal Skills: - Proficient in web scraping - Familiarity with real estate websites - Excellent data handling skills. Please include examples of similar projects you've completed in your proposal.

I need a Python-based data scraper that can automatically scrape text data from vehicle dealership websites, such as: I would need the scraper to do multiple different URLs with the final of each CSV uploaded to my server. This scraper would need to run once a day. For example, the multiple URLs would need to be defined by the Porsche Centre search field which gives different IDs for each location, eg: I have a list of what data needs to get scraped and can help with the before/after code of where this information sites. I would also need to include some standard information to go in each CSV also. The project

I'm in need of a skilled data scraper to extract information from a variety of sources. Website Scraping: - Text content - Links Social Media Scraping: - Data from Facebook - Data from Twitter - Data from Instagram The ideal freelancer for this project should have extensive experience in web scraping and social media data extraction. Proficiency in programming languages such as Python is a plus.

I'm seeking a proficient web scraper to extract contact details from the provided website. Ideal Skills: - Proficient in web scraping tools and software. - Experienced in data extraction from company websites. - Deliver the extracted data in Excel format.

I'm in need of a skilled web scraper to extract property listings from PropertyFinder. The project involves capturing essential details such as property descriptions, prices, locations, sizes, and pictures. Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Prior experience in scraping real estate data - Ability to handle large datasets - Attention to detail for accurate data capture - Familiarity with handling images in data scraping

I'm looking for a skilled Python developer to create a program that reads text content from the website and stores it in a Pinecone vector database, categorized by keywords. Key Requirements: - Proficient in Python programming - Experience with web scraping - Familiarity with Pinecone vector database - Ability to categorize data by keywords Please provide examples of your previous work in web scraping and vector database integration.