Data scraping website using jobs

...attorney specializing in copyright law and web scraping legalities to provide legal guidance for my automated YouTube channel project. About Me: I operate a YouTube channel that leverages automated tools to produce videos by referencing articles sourced from various online platforms. My process involves scraping content via RSS feeds and utilizing keywords to generate scripts, which are then transformed into engaging video content. Project Scope: Legal Assessment: Evaluate the legality of my current web scraping practices, particularly in relation to copyright laws and terms of service agreements of the sources I use. Compliance Strategy: Develop strategies to ensure my operations comply with relevant laws, including fair use/fair dealing principles, data ...

I need a skilled programmer experienced in Python or Node.js, who can create a script for me that will parse Google SERP data through our rotating proxy provider. The script needs to extract data points such as Titles and URLs, Meta descriptions, and Search result rankings. Key Requirements: - The script should run daily as an API enpoint which will get settings for scraping (google domain, language code, country code, proxy settings, keywords) - The output data needs to be in JSON format Since Google has recently updated its system to block bots/scrapers, the script needs to effectively navigate through this challenge. Experience with web scraping, working with proxies and understanding of Google SERP is a plus. Please apply if you have the relevant s...

NO .ai If it looks like .ai we will not accept and not actively making a list for those who spam our contest!!! We need a simple graphics design explaining we visited their location. The text should be: WE RODE IT! This pump track was reviewed by Pump Track Locator! FREE DECALS HERE! Please take one. Look out for your track at and youtube (Icon) @pumptracklocator We than have one graphic we would like to use along with any design elements or borders. Attached is the colors we use. Must be 300DPI high res image in PNG with EPS file

I'm seeking assistance to extract data from a conference website. The task involves gathering information on all attendees and their respective companies. Key Requirements: - Extract a list of attendees and their information (Name, Title, and Company) and export it into a CSV file. - Create a secondary CSV file that lists all the companies in attendance (one column: Company). The data needs to be extracted from a publicly accessible section of the conference website. The task needs to be completed before noon EST on January 21st. I will make a decision on whom to select by 9:00pm EST on January 19th. Ideal Candidate: - Previous experience with data extraction and web scraping is preferred. - Proficient in using tools like Python, E...

Need someone adjust the scripts in order to work with FP8 on Nvidia Ada Lovelace and later GPUs with minimal changes. - I will not give any compute resource to do the job; - After you give me minimal evidences that the work was done (prints of the training process using FP8), we will proceed with our tests using a workstation with 2 GPUs (2 x RTX 4000 SFF Ada). - Use Huggin Face tools/libraries or another approved by us.

I'm looking for a professional video editor skilled in Descript, Minvo, and Pictory to assist in editing my marketing videos. I have access to these tools, but I need someone with expertise to help with the editing and adding b-roll. You will be editing long-form videos fo...Potentially incorporate elements like text overlays, background music, and transitions Ideal Skills and Experience: - Proficiency in Descript, Minvo, and Pictory - Experience in editing marketing videos - Strong understanding of branding consistency - Creative mindset for video editing I am not looking for manual editing using Adobe or similar tools that take hours. We budget 1 hour per long-term video (20-30 min raw footage) and 15 minutes per short (2-3 min raw) by using the AI tools listed in ...

I'm seeking a professional with deep expertise in Puppeteer and the Google API. I am open to various tasks including web scraping, automation of tasks, and data extraction and analysis. Your role will involve employing Puppeteer for web automation and using the Google API for data management. Ideal Candidates Should Have: - Extensive experience with Puppeteer - Proficiency in using various Google APIs - Strong skills in web scraping and data analysis - Able to automate tasks efficiently - Good understanding of working with structured, text, and image data.

I need an expert in PLS CADD software to analyze a transmission line and deliver within 5days. Ideal Skills: - Proficiency in PLS CADD software - Experience in transmission line analysis - Ability to interpret survey data Please note that specific aspects of the line's analysis may be determined during the course of the project.

I need a skilled professional who can help me resolve Pe...I'm encountering access difficulties due to this anti-bot solution. What I require: - Solving the PerimeterX blocking issue to access the main endpoint: /niles/partners/{partner_id}/menus - Providing a solution that enables unrestricted requests. Necessary headers and cookies will be provided. I am not looking for assistance with logic or general scraping—just with bypassing this specific block. Key skills and experience: - Proficient with using a headless browser, specifically Selenium. - Familiar with session-based authentication mechanisms. Please provide: - Any additional information you need from me to give an accurate quote. - Examples of prior experience with systems like this. I look forward to...

I'm in need of a compre...information for Real Estate Professionals (Agents and Brokers) associated with @properties, covering all cities they operate in. The data should be structured in an Excel spreadsheet and must include: - Name - Address - City - Email (Any email addresses available) - Phone number - Company name Key Requirements: - I'm looking for as many contacts as possible, ideally in the thousands. - The email addresses do not need to be verified, but any available email is acceptable. - Prior to engaging in further conversation, I would like to see at least 10 examples of the data you've gathered. Please note that this task may be straightforward for those experienced in data scraping. A successful completion of this project could l...

...you’re passionate about coding, optimizing performance, and building high-quality tools, this is the perfect role for you! WHAT YOU’LL BE WORKING ON: PROJECT 1: HOSTED PLATFORM WEBSITE -Technologies: HTML, CSS, JavaScript, jQuery, PHP, MySQL -Tasks: --Fixing UI bugs. --Adding features via API requests. --Enhancing server-side functionalities. PROJECT 2: CUSTOM WEB APPLICATION Technologies: Laravel (PHP), HTML, CSS, JavaScript, jQuery, MySQL, Python Tasks: -Bug fixes and feature development. -Database optimization. -Web scraping using Python. Additional Requirement: -Strong knowledge of Python for website scraping using tools like BeautifulSoup, Scrapy, or Selenium. PROJECT 3: ADMIN TOOLS AND INTERNAL FEATURES Technologies: H...

Python Web Scraping Specialist with Advanced Scrapy Expertise Company Overview: We are an innovative tech company specializing in developing cutting-edge software solutions for the automotive industry. Our flagship platform aggregates and standardizes car data from various sources, enabling a seamless meta-search experience for users worldwide. Role Overview: We are looking for an Advanced Web Scraping Specialist with extensive Scrapy experience and exceptional Python skills to join our team. This role involves developing and integrating custom web scrapers into our sophisticated scraping automation system. You will handle challenges like bypassing complex web protections, managing proxy rotations, and working within a multi-layered software architecture. Key...

hey Richard, help me enhance my scrapping code for machines

I'm looking for a Python expert to help me create an automation script that scrapes news articles from the US scheduler. Requirements: - Experience in Python and web scraping - Ability to work with scheduling systems - Understanding of news article structure and scraping techniques Please reach out if you can assist with this project.

I'm looking for a skilled data extractor with LinkedIn experience. The task is to extract specific information from user profiles on LinkedIn. Key Requirements: - Extract user profiles data from LinkedIn, focusing primarily on contact information. - Deliver the extracted data in CSV format. Ideal Skills: - Proficient in data extraction and web scraping. - Familiar with LinkedIn's platform and its user profiles. - Experience in delivering data in CSV format.

I'm seeking assistance to extract email addresses from a dynamic website. I only have frontend access and this task is a one-time requirement. Ideal skills and experience for this job would include: - Proficiency in web scraping tools and techniques - Understanding of dynamic websites and their structures - Ability to extract data efficiently and accurately Please note, the task requires a thorough and meticulous approach to ensure all relevant email addresses are captured. website: (follow instructions by this video:

We have rigged 3D characters that need to be animated. The animations should involve the characters interacting with various types of equipment. We are building a large animation library of looped animations. Key Requirements: - Create animation loops of 3D characters climbing and interacting with playground equipment, fitness equipment, and obstacle course equipment. - The animations should be smooth and seamless, suitable for a library of character animation loops. Ideal Skills: - Proficiency in 3D animation software (preferably either 3Ds Max or Maya) - Experience with character animation - Attention to detail and ability to create realistic and engaging animation loops.

I'm looking for a proficient data scraper who can extract comprehensive product information from a specific website. Key Requirements: - Data to be scraped includes: product names and descriptions, product prices, product specifications, make year, and color. Skills and Experience: - Prior experience in web scraping, particularly product data is highly preferred. - Proficiency in tools like Python, Beautiful Soup, Scrapy, or similar. - Ability to deliver the data in a CSV file as per my requirement. I look forward to your bids. Thank you.

I need a web crawler that can capture video stream data to trigger real-time notifications. The specific types of notifications and data formats for saving the crawled data will be discussed later. Ideal Skills: - Proficiency in web scraping - Experience with video stream data - Programming skills in Python, Java or similar languages Please note, the specifics of the project may evolve as we progress.

I'm seeking a skilled Python developer with AWS experience to assist me in deploying an existing Amazon scraping script onto the Amazon EC2 platform. Key Project Details: - Deployment: Deploy the existing Python script on Amazon EC2. - Libraries: No specific Python libraries or frameworks are required, only standard ones. - CI/CD: Set up a simple deployment process for the script without a full CI/CD pipeline. Ideal Skills and Experience: - Proficiency in Python and experience with web scraping. - Proven track record of deploying Python scripts on AWS. - Strong familiarity with Amazon EC2. - Knowledge of standard Python libraries is necessary. - A comprehensive understanding of the deployment process is required. Additional Information: - The deployment should be effi...

I'm in need of a professional who can assist with web scraping to collect valuable contact information. This project focuses on gathering data from various websites, specifically targeting: - Email Addresses - Phone Numbers - Mailing Addresses - Contact Person - Their Position Ideal candidates should have experience in web scraping, lead generation, and data cleaning. Proficiency in using scraping tools and ensuring data accuracy is crucial.

My current Python project needs an update. I have two solutions to check if a number is registered on a website, but they are too slow. I've attempted to use multi-threading to increase speed, but the website blocks me. I currently utilize proxies and a captcha solver, but the slowest part of my process is bot detection. I need a professional who can enhance my current system to better handle bot detection, so I can avoid being blocked by the website. Skills and Experience: - Proficient in Python - Experience with web scraping and bot detection - Knowledge of multi-threading - Familiarity with proxies and captcha solvers Please start your proposal with the word 'binance'. Thank you.

I'm seeking a professional in web scraping to help me gather contact information for lead generation. The data will primarily be sourced from Company Websites and Industry Directories. - Specific Data: I need the following contact information: - Email addresses - Phone numbers - Website links Ideal candidates should have extensive experience in complex web scraping, with a proven track record of successfully generating leads. Proficiency in data extraction tools and software, along with excellent attention to detail, is crucial.

...management companies, including the following information for each company: 1. Company Name 2. Website URL 3. Phone Number 4. Email Address 5. Headquarters Address (if available) 6. Other Relevant Contact Information (e.g., contact person, LinkedIn profiles) Requirements: • Scrape Google, business directories, or other publicly available resources to find relevant companies. • Ensure the list includes only companies with a national presence or significant operations in multiple states. • Deliver the data in a well-organized spreadsheet format (Excel or Google Sheets). Ideal Freelancer: • Experience with web scraping tools (e.g., Python, BeautifulSoup, Scrapy, etc.). • Familiarity with data verification to ensure the infor...

Need someone adjust the scripts in order to work with FP8 on Nvidia Ada Lovelace and later GPUs with minimal changes. - I will not give any compute resource to do the job; - After you give me minimal evidences that the work was done (prints of the training process using FP8), we will proceed with our tests using a workstation with 2 GPUs (2 x RTX 4000 SFF Ada). - Use Huggin Face tools/libraries or another approved by us.

Happy New year Sinisia! Hope your well. I need DXFs for the attached drawings for 3D Numbers from CORTEN steel. Ill send through the PDF I have. The font is IMPACT. let me know if you have any .

...Location Sharing: • Allow the driver’s live location to be shared with the user. • Provide a public link to the user, enabling anyone with the link to access the live location of the driver in real time. 2. Chat Functionality: • Implement real-time chat between the driver and the user. Technical Requirements: • Backend Framework: Java Spring Boot • Real-time Data Sharing: WebSocket (or any suitable alternative for live data sharing) • Database: PostgreSQL Development Scope: • The module must be developed as a standalone component to ensure it can be integrated with our existing Spring Boot application by our in-house team. • Access to our application’s source code will not be provided. The developer is expected...

...specific data from a website for me. The goal is to replicate certain features on a new site, specifically the filter options. Data to be Scraped: - Text data: This is the primary type of data that needs to be scraped. It could include anything from product descriptions to user comments. - Gallery images: These are the images that need to be scraped. They will be used to build a similar visual experience on the new site. Key Requirements: - Extensive experience in web scraping and data extraction. - Proven ability to replicate website features on a new site. - Familiarity with image data and its usage in website development. - Ability to work independently and deliver on time. Your task will primarily involve s...

I am looking for assistance in collecting and org...327 products Kama: 294 products Max Fritid: 1169 products Movera: 545 products Deliverables: Structured Data: Use the provided Excel sheet and fill in the designated columns with extracted information, including: 1) Product Name 2) Description 3) Product page URL 4) Image URLs (usually only one, but up to four images per product, if available) 5) Additional description, if available If any errors or issues occur (e.g., missing data, broken links, unavailable products), leave a clear comment in the designated "Comments" column explaining the problem. This can be done manually with copy paste, og with web scraping tools, as long as you got attention to detail to ensure high-quality data entry. Pay p...

Description: I am looking for a skilled web scraping specialist to develop a program that scrapes product data from the Schneider Electric website. The program should meet the following requirements: Program Requirements Input: Accept a list of product codes (e.g., ATV212HU40N4, ATV212HU55N4) provided in a CSV or XLSX file. Accept a list of specific parameters to scrape, such as "Device short name," "Motor power kW," "EMC filter," etc. Output: Generate a CSV or XLSX file with: Column A: Product codes. Row 1: Names of the selected parameters. Rows below: Data for each product. Additional Data to Scrape: For each product, the following should also be scraped: Link to the main product image. Link to download the "Produc...

Please Sign Up or Login to see details.

I'm looking to create a bot using Python and JavaScript for automation purposes. The specifics of the automation tasks, the platforms it needs to interact with, and the user interface requirements are still to be determined. Ideal Skills: - Proficiency in Python and JavaScript - Experience in creating automation bots - Knowledge of web scraping, task automation, and data processing - Ability to create both command-line and graphical interfaces Potential Tasks: - Defining the type of automation tasks the bot will handle - Determining the platforms or environments the bot will interact with, such as websites, APIs, or local files - Designing and implementing a user interface if necessary I am open to suggestions and discussions on these points.

I'm in need of a skilled data scraper who can gather contact information for business owners in specific industries. Key Requirements: - Data to be collected includes: first name, last name, work and personal email address, and cell phone number. - More than 500 business owners' data is required. - Industries of interest: roofing, restoration, paving, and landscaping. Ideal Skills/Experience: - Proficiency in data scraping from various sources. - Familiarity with the specified industries. - Prior experience with lead generation or business contact data collection. - Ability to provide accurate and up-to-date information. LEAD RATE IS .15 PER LEAD

I'm in need of a skilled web scraper (proficient with AI) capable of extracting data from a webpage with 5,500 products. These products do not have variants, which should simplify the task. The data to be scraped includes: - Product name - Product Part Number - Product description (The product descriptions aren't formatted the same way for each product. They are inconsistent but similar.) - UPC - How many sold The final deliverable should be an Excel/CSV file containing all the scraped data, sorted by product name with separate columns for each data point. Ideal skills for this project include: - Proficient in web scraping - Proficient with AI - Experienced in data organization and Excel/CSV Please, only bid if you can deliver quality...

Project Goal Enhance an existing Python web scraper to process 20 websites per second, achieving a total of 1,200 websites in under 60 seconds, without data storage. Scope of Work Performance Analysis Analyze the current scraper code for performance bottlenecks, focusing on areas such as network latency, processing delays, and inefficient code structures. Implementation of Parallel Processing Integrate asynchronous processing using libraries such as asyncio and aiohttp for non-blocking HTTP requests. Explore multiprocessing or threading to handle 20 websites in parallel efficiently, ensuring resource utilization is optimized. Code Optimization Optimize the scraper code to reduce the processing time per site to 1 second or less, focusing on efficient parsing and minim...

I'm in need of a scraping tool that can help me identify potential bids from various government bid sites. This tool will need to access the API from known bid sites, and pull specific information from these sites. Key Requirements: - Target Government bid sites exclusively - Extract bid titles and descriptions - Extract submission deadlines - Extract bidder requirements Data Delivery: The extracted data will need to be delivered to me in a CSV file daily. Ideal Skills: - Proficiency in web scraping and API integration - Experience with government bid sites preferred - Strong skills in data extraction and CSV generation

I'm in need of a data scraping expert who can collect email addresses and phone numbers from specified company websites. The extracted data should be delivered in an Excel spreadsheet. Ideal Skills: - Data Scraping - Proficient in using Excel - Attention to Detail Experience with previous data scraping projects is preferred. Please provide examples of your work in your bid.

More details: Content must be generated using AI tools, the model does not exist physically What is the target audience for the Instagram account? Males aged 30-50 What type of content do you want to focus on for the Instagram account? Lifestyle Here I attach 2 examples of accounts to replicate

...is huge with over 2.3M entries, we had already been Abel to scrape 2.1M entries but didn't have any data on which cases were missed out. This functionality should include: - Storing all the cases into Postgres with proper indexes/partitions to allow FTS(Full text search) - Scraping only new cases and not re-scraping previously scraped cases. - Progress on which cases were successfully scraped and which ones were left out. We would prefer having a scraper built from scratch rather than fixing the existing one , unless you can make use of it. Existing repo: and issues: - The CSS selectors and database mapping is correct, as it is scraping data for some cases(needs verification) - It crashes for some cases with the following errors (https://pas...

A demo app to be designed and built on a basic level on no code platform like platform. We have figma designed file for UI. Need to design app/web based on the UI.

I'm in urgent need of a professional to extract specific Text and Tables from PDF files using LLAMA2. Skills and experiences needed for this task include: - Proficiency in LLAMA2 - Experience in data extraction from PDF files - Ability to work dynamically based on user prompts Your task will be to create a system that can take user prompts and accurately extract the requested text and tables from the PDF. The deadline is as soon as possible. Please provide a timeline along with your bid. Previous experience in related projects will be highly valued.

I am confident that I can assist you in efficiently extracting URLs and images related to Google AdSense from the designated blog. With extensive experience in web scraping technologies like Python, BeautifulSoup, and Scrapy, I will ensure accurate extraction of all URLs across the site and gather images associated with Google AdSense, overcoming any challenges related to dynamic or JavaScript-loaded content. I’ll use advanced techniques such as headless browsers (e.g., Selenium or Playwright) to handle dynamic elements, ensuring a comprehensive data extraction process. All extracted data will be saved in a clean and structured JSON format for easy access and analysis. With my expertise and understanding of Google AdSense protocols, I’m confident I can prov...

I'm in need of a proficient web scraper to extract data from a property listing on a daily basis. The specific data points of interest are user reviews and the availability and booking status of listings. Key Project Aspects: - **Data Points**: Scrape price, user reviews and availability/booking status of property listings. - **Frequency**: Data needs to be scraped and delivered daily. - **Purpose**: The primary goal of this project is to gain real-time booking insights. Ideal skills for this project would include: - Proficient in web scraping - Experience with scraping data from property listing or similar platforms - Ability to deliver data on a daily basis - Capable of providing insights from the scraped data

i need help scrape linkedin using just slack user names, first name and last name, there is 600 data

I am looking for an Excel expert who can create a shortest distance freight matrix for me using Australia's NHVR route planning tool. The matrix will be based on specific truck combinations that I will provide. Initially, I will supply a list of origins and destinations, but I need the matrix to be easily expandable for future use. Key Requirements: - Creation of a simple distance-only freight matrix - Integration of a user-friendly Excel form to add new locations - Incorporation of specific truck combinations into the route planning I am not familiar with programming or VBA, and I would like to know if this project is feasible before awarding it. Please, check the NHVR API tool link: Ideal candidates should have

We are looking for a skilled Python developer to help us integrate and automate processes using the Manatal API. The project involves fetching, processing, and updating candidate data within Manatal and streamlining recruitment workflows. Key Deliverables: 1)Fetch candidate data from Manatal using the API. 2) Process resumes and job descriptions using OpenAI's API for evaluation (resume match, skillset match, etc.). 3) Update candidate profiles in Manatal with evaluation scores and custom fields. 4) Automate assessment progress monitoring and status updates via scraping. 5) Implement centralized logging and error handling. We have part of the code done that can be reused and tweaked.

I need a professional 3D Product Designer. You will be responsible for designing parts that could be used in various applications. Ideal freelancers for this project should have: - Extensive experience in 3D design - Proficiency in using SolidWorks, AutoCAD, or Fusion 360 Please include relevant examples of your work in your bid.

...complete project on GitHub: a chatbot designed to assist migrants in finding job opportunities. Unfortunately, the application has some functionality issues, particularly with the chatbot responses, scraping and parsing. Key Issues to Address: - Improving the speed of the chatbot responses - Fixing minor details that are affecting the overall functionality - Enhancing the job opportunity search and alternatives for new candidates Ideal Skills and Experience: - Proficient in Django and Python - Strong understanding of REST APIs - Experience in optimizing chatbots - Skills in web scraping and data parsing - Familiarity with GitHub for code review and collaboration The ultimate goal is to make this chatbot a reliable and efficient tool for job seeking migra...

I'm looking for a bot that can operate on the Target website. The bot's primary focus should be on toys, specifically hot items that are in high demand. Once an item is back in stock, the bot needs to check out that item instantly. Ideal skills and experience for the job: - Proficient in web scraping and automation - Prior experience with e-commerce bots - Understanding of the Target website's architecture - Knowledge of toy trends and hot items

...and documents from various sources within Namibia. The scraper should be capable of the following: Scraping Websites in Namibia: Scrape almost all Namibian websites for tender advertisements and tender documents. Scraping Social Media Platforms: Scrape LinkedIn, Instagram, X (formerly Twitter), and Facebook for tender-related adverts or documents localized to Namibia. Scraping Local Newspapers: Collect tender advertisements published in local Namibian newspapers. Scraping Specialized Websites: Scrape two key websites that focus on advertising tender documents: A government-owned website (URL to be provided). A subscription-based website (URL to be provided). Data Output: The scraped data should be exported to an Excel file wi...