Web data scraping jobscông việc

...to manage information about cars, service jobs, and associated costs. It should also support multimedia attachments such as photos and videos. ### Requirements: 1. **Car Details Table:** - Fields: Car Make, Model, Year, VIN, License Plate, Purchase Date, and other relevant details. - Multimedia: Allow uploading photos and videos of the cars. 2. **Service Job Table:** - Fields: Date of Service, Job Description, Labour Cost, Parts Cost, and Total Cost. - Multimedia: Allow attaching photos and videos showing the work done. 3. **Summary Table:** - Automatically calculate and display summaries, such as: - Total spending on labour and parts. - Breakdown of costs per car. - Total number of service jobs performed. ### Ke...

...design should feel PERSONALIZED the user’s profile and journey. • Easy use: The user interface (UI) should be intuitive, visually appealing, and straightforward. • Candidate engagement: Prototype UX/UI should feel engaging, empowering, and transparent to the candidate. Design Requirements: 1. Personalized Dashboard: o Job Match: Show candidates the jobs that best match their skills and preferences (e.g., location, salary, etc.). o Team Match: Display jobs that align with the candidate's personality or work style. o Company Match: Present companies that align with the candidate’s values or preferences. o Emotional Match o Include options for candidates to filter or sort job listings by relevance. 2. Onboarding Process: o Welcome Screen: After comp...

Python and Visual Studio Code Data Processing Data Entry Web Scraping Data Mining The project involves creating a script to mine text data . Key Responsibilities: - Develop a text mining script that can efficiently extract and process data from various fields in the database. - The script should be able to handle large volumes of data and return results in a timely manner. Ideal Skills: - Proficiency in SQL and data mining techniques. - Experience with developing scripts for database text extraction. - Ability to work with large datasets.

I need a script that can scrape manifests from an online website and insert the data into a MySQL database. Ideal Skills: - Proficient in Python or similar languages - Experience with web scraping tools (BeautifulSoup, Scrapy) - Familiarity with MySQL and database management - Ability to write efficient, clean code Responsibilities: - Develop a web scraping script - Ensure data is accurately inserted into MySQL - Make the script run at specified intervals Please note, the specific website and data fields have not yet been determined. The freelancer will need to be flexible and ready to adapt the script as needed.

We are seeking a skilled freelancer to work on a comprehensive project that involves data scraping, visualization, and prediction of stock market data. The ideal candidate will have experience in web scraping, data analysis, and machine learning. Key Requirements: 1. Data Scraping: - Scrape historical stock data from reputable sources (e.g. Yahoo Finance, Quandl, etc.) - Extract relevant data points such as open, high, low, close, volume, etc. - Store data in a structured format (e.g. CSV, JSON, etc.) 2. Data Visualization: - Create interactive and dynamic visualizations using libraries such as Matplotlib, Seaborn, Plotly, etc. - Visualize stock price movements, trends, and patterns ...

I'm looking for a skilled professional to help me build a comprehensive email list that will be used primarily for client communication. Key Responsibilities: - Scrape relevant websites to gather potential email addresses. - Ensure the email addresses ar...professional to help me build a comprehensive email list that will be used primarily for client communication. Key Responsibilities: - Scrape relevant websites to gather potential email addresses. - Ensure the email addresses are valid, relevant, and appropriate for client communication. Ideal Skills and Experience: - Proficient in web scraping techniques and tools. - Previous experience in creating email lists for business purposes. - Understanding of data validation and filtering processes to ensure quali...

I need a Python expert to scrape tweets from a specific Twitter account using the Twitter API. The scraped tweets should be inserted into a MySQL database. Key Requirements: - Experience with Python and Twitter API - Familiarity with MySQL - Ability to scrape and process data efficiently What You Will Do: - Watch the provided video for guidance - Scrape tweet text from a specific account - Insert new data into the database without deleting existing records Please check the video and let me know if you're capable of doing this.

...Suspend/Unsuspend/Terminate/Change Package/Change Password - Use only HestiaCP - User email notification Available options in the admin panel: - Create users - Suspend users - Terminate users - Unsuspend users - Change password - Change Package Available options in the client panel: - WEB domain management. Adding, deleting, editing - Adding a new alias and deletion alias to a domain - Generating and deletion a certificate Let's Encrypt for a domain - Changing the backend (for example PHP version) for a domain - Suspend / unsuspend web domains - User FTP management. Adding, deleting, editing - User FTP management. For each domain separately - Ability to set a specific directory for each FTP user - Adapted file manager for easy access to website files - DNS zone ma...

...primarily phone numbers and LinkedIn profiles. - The data should be delivered in a Google Sheets format. Ideal Skills and Experience: - Previous experience in lead generation and data extraction. - Familiarity with the construction industry in Bangalore. - Proven track record of sourcing high-quality prospects. - Proficient in using Google Sheets for data organization. Requirement: 100 Profiles Industry: Construction Tools: LinkedIn, Lusha, ZoomInfo, LinkedIn Recruiter, Job Overview: We are looking for a skilled Data Extraction Specialist to source and extract contact details of Inside Sales Representatives, Telecallers, Inside Sales Managers, and Sales Executives from top construction companies in Bangalore. The extracted data will be used for hea...

I'm looking for a skilled data entry specialist with web scraping experience to assist in entering product details into our database. The data is currently housed in Airtable and will need to be meticulously transferred and updated. Key Responsibilities: - Data Entry: Accurately inputting product details from Airtable into our database. - Web Scraping: Gathering product prices, descriptions, and images from various websites. Ideal Skills: - Proficiency in Airtable - Experience with data entry and web scraping - Attention to detail - Ability to meet deadlines

...to create a software capable of scraping user data from APIs. Before I officially list this project, I would like to receive estimates from potential candidates. The key elements of the project are: - Development of scraping software specifically designed to extract user data from various APIs. - Providing an estimate for the cost and time required for such a project. - All responses will be considered for a launch date that is to be announced. Ideal freelancers for this project should have: - Proven experience in developing scraping software. - Strong understanding and experience working with APIs. - Ability to provide accurate project estimates. The format for the scraped data is currently undecided, so flexibility and ability to adapt to d...

...attorney specializing in copyright law and web scraping legalities to provide legal guidance for my automated YouTube channel project. About Me: I operate a YouTube channel that leverages automated tools to produce videos by referencing articles sourced from various online platforms. My process involves scraping content via RSS feeds and utilizing keywords to generate scripts, which are then transformed into engaging video content. Project Scope: Legal Assessment: Evaluate the legality of my current web scraping practices, particularly in relation to copyright laws and terms of service agreements of the sources I use. Compliance Strategy: Develop strategies to ensure my operations comply with relevant laws, including fair use/fair dealing principles...

...interactions: The website should facilitate user registration and login, allow users to post and edit their ads, and support messaging between users. - Payment Features: The site should have integration with various payment gateways, offer premium ad listings, and support in-app purchases. - Diverse Ad Categories: The platform should accommodate a variety of ad categories including Real estate, Jobs, and Vehicles. Ideal Skills and Experience: - Proficient in Laravel PHP - Previous experience in developing classified websites - Expertise in implementing secure and reliable payment features - Ability to create a user-friendly interface facilitating seamless user interactions - Knowledge in categorizing content on a website. The website is almost completed but certain areas lack ...

I need a skilled programmer experienced in Python or Node.js, who can create a script for me that will parse Google SERP data through our rotating proxy provider. The script needs to extract data points such as Titles and URLs, Meta descriptions, and Search result rankings. Key Requirements: - The script should run daily as an API enpoint which will get settings for scraping (google domain, language code, country code, proxy settings, keywords) - The output data needs to be in JSON format Since Google has recently updated its system to block bots/scrapers, the script needs to effectively navigate through this challenge. Experience with web scraping, working with proxies and understanding of Google SERP is a plus. Please apply if you have the rel...

I'm seeking assistance to extract data from a conference website. The task involves gathering information on all attendees and their respective companies. Key Requirements: - Extract a list of attendees and their information (Name, Title, and Company) and export it into a CSV file. - Create a secondary CSV file that lists all the companies in attendance (one column: Company). The data needs to be extracted from a publicly accessible section of the conference website. The task needs to be completed before noon EST on January 21st. I will make a decision on whom to select by 9:00pm EST on January 19th. Ideal Candidate: - Previous experience with data extraction and web scraping is preferred. - Proficient in using tools like Python, Excel, or any o...

I'm seeking a professional with deep expertise in Puppeteer and the Google API. I am open to various tasks including web scraping, automation of tasks, and data extraction and analysis. Your role will involve employing Puppeteer for web automation and using the Google API for data management. Ideal Candidates Should Have: - Extensive experience with Puppeteer - Proficiency in using various Google APIs - Strong skills in web scraping and data analysis - Able to automate tasks efficiently - Good understanding of working with structured, text, and image data.

I need ...site. My project logic is fully implemented, but I'm encountering access difficulties due to this anti-bot solution. What I require: - Solving the PerimeterX blocking issue to access the main endpoint: /niles/partners/{partner_id}/menus - Providing a solution that enables unrestricted requests. Necessary headers and cookies will be provided. I am not looking for assistance with logic or general scraping—just with bypassing this specific block. Key skills and experience: - Proficient with using a headless browser, specifically Selenium. - Familiar with session-based authentication mechanisms. Please provide: - Any additional information you need from me to give an accurate quote. - Examples of prior experience with systems like this. I look forward to your p...

I'm in need of a compre...information for Real Estate Professionals (Agents and Brokers) associated with @properties, covering all cities they operate in. The data should be structured in an Excel spreadsheet and must include: - Name - Address - City - Email (Any email addresses available) - Phone number - Company name Key Requirements: - I'm looking for as many contacts as possible, ideally in the thousands. - The email addresses do not need to be verified, but any available email is acceptable. - Prior to engaging in further conversation, I would like to see at least 10 examples of the data you've gathered. Please note that this task may be straightforward for those experienced in data scraping. A successful completion of this project could l...

...--Enhancing server-side functionalities. PROJECT 2: CUSTOM WEB APPLICATION Technologies: Laravel (PHP), HTML, CSS, JavaScript, jQuery, MySQL, Python Tasks: -Bug fixes and feature development. -Database optimization. -Web scraping using Python. Additional Requirement: -Strong knowledge of Python for website scraping using tools like BeautifulSoup, Scrapy, or Selenium. PROJECT 3: ADMIN TOOLS AND INTERNAL FEATURES Technologies: HTML, CSS, JavaScript, jQuery, PHP, MySQL Tasks: -Developing tools for managing ratings, invoices, and workflows. -Improving existing UI components. WHAT WE’RE LOOKING FOR: -Proficiency in Python, PHP, MySQL, HTML, CSS, JavaScript, jQuery -Strong experience with Laravel framework -Python expertise for web scrapi...

Python Web Scraping Specialist with Advanced Scrapy Expertise Company Overview: We are an innovative tech company specializing in developing cutting-edge software solutions for the automotive industry. Our flagship platform aggregates and standardizes car data from various sources, enabling a seamless meta-search experience for users worldwide. Role Overview: We are looking for an Advanced Web Scraping Specialist with extensive Scrapy experience and exceptional Python skills to join our team. This role involves developing and integrating custom web scrapers into our sophisticated scraping automation system. You will handle challenges like bypassing complex web protections, managing proxy rotations, and working within a multi-layered...

I am seeking a professional app developer for creating a handyman application compatible with both iOS and Android platforms. This app should embody the following key features: - Job posting and bidding: The platform should allow users to post jobs needing handyman services, and enable handymen to bid on these tasks. - User and handyman profiles: Each participant in the app should have a customizable profile, with handymen's profiles showcasing their skills, reviews, and bid history. - In-app messaging: A secure, efficient messaging system is essential for communication between users and handymen. The app should also integrate the following: - Payment Method: The app needs to facilitate transactions via Credit/Debit Card. Other payment options like PayPal and an in-app walle...

hey Richard, help me enhance my scrapping code for machines

I'm looking for a Python expert to help me create an automation script that scrapes news articles from the US scheduler. Requirements: - Experience in Python and web scraping - Ability to work with scheduling systems - Understanding of news article structure and scraping techniques Please reach out if you can assist with this project.

...Beyond the $3,000 awarded to top developers, testing software will eventually allow you to develop and grow your freelance business further. This is an exciting opportunity for both beginners looking to kickstart their freelancing career and established developers looking to stay relevant in a fast-changing and unstable market with a new set of exciting tools. Hi, I’m Louis—a seasoned full-stack web developer with years of experience and thousands of dollars earned on freelancing platforms like Freelancer, Upwork, and Fiverr. I’ve started an exciting experiment to help freelance developers like you get more clients and long-term opportunities while making the client communication process easier and more effective. I’m looking for 3 more freelance develop...

I'm seeking a professional resume writer to help me craft a compelling resume tailored for the corporate job market. Key aspects: - Target: Corporate/Office jobs - Experience Level: Mid-level The ideal freelancer will have extensive experience in corporate resume writing and a proven track record of helping mid-level professionals secure interviews. The aim is to highlight my skills and experiences in a way that resonates with corporate recruiters. Please share examples of your previous work in your proposal.

I'm looking for a skilled data extractor with LinkedIn experience. The task is to extract specific information from user profiles on LinkedIn. Key Requirements: - Extract user profiles data from LinkedIn, focusing primarily on contact information. - Deliver the extracted data in CSV format. Ideal Skills: - Proficient in data extraction and web scraping. - Familiar with LinkedIn's platform and its user profiles. - Experience in delivering data in CSV format.

Hello, I’m looking for a fluent English developer, an expert in coding and WordPress, who is serious and doesn't have 500 other jobs, as I’ve already worked with a couple of freelancers who wasted my time. The main task is to create a chat feature that connects to each order we receive on our website (an order means when a customer makes a purchase). Once we have the chat feature connected to the orders, we will create a dashboard for my employees so they can log in to the website. The employee will log in from the website as the client, but they will be assigned a role that allows them to see the dashboard as an employee. I will connect the order with the employee, allowing them to complete the job and communicate with the customer. These are the important aspects....

...progress for fixed-price engineers, update project budget and schedule, report update in a minute of meeting - Review the internal project folders and check if they are aligned with quality standards (the order is in the right subfolder, requirements, technical documentation) - update this list of routine and on-demand routine Support for HR is required - Recruiting on online platforms - Opening jobs, - making interview and tests ( We will share a technical test to be done), - first selection - Payments and follow up document template creation (Word, Excel), Marketing material, like power point presentation, brochures, business proposal lead verification and generation from Linkedin, mail and follow feedbacks Required skills - SELF SUFFICIENCY in completing required technical t...

I am seeking assistance to start an online freelancing career focused on writing and translation. Key Responsibilities: - Help establish my profile on various freelancing platforms. - Provide guidance on best practices for securing jobs. - Share insights on how to improve writing and translation skills. - Assist in finding and applying for relevant job postings. Ideal Skills: - Expertise in writing and translation. - Proven experience in freelancing. - Knowledge of various online freelancing platforms. - Good communication and teaching skills.

I'm seeking assistance to extract email addresses from a dynamic website. I only have frontend access and this task is a one-time requirement. Ideal skills and experience for this job would include: - Proficiency in web scraping tools and techniques - Understanding of dynamic websites and their structures - Ability to extract data efficiently and accurately Please note, the task requires a thorough and meticulous approach to ensure all relevant email addresses are captured. website: (follow instructions by this video:

I'm seeking assistance with my WooCommerce site. I've configured my tour package to accept payments in installments and set up a WordPress cron job for future payments. However, I'm encount...Optimization of the current PayPal setup to ensure smooth processing of the initial $22 payment and the subsequent three installments. Ideal Skills and Experience: - Extensive experience with WooCommerce, WordPress, and PayPal integrations. - Familiarity with troubleshooting PayPal Vault errors. - Knowledge of setting up and managing bi-weekly payment plans. - Experience with webhooks and cron jobs in a WordPress environment. Please note, the necessary webhooks have already been set up for PayPal Vault to handle future transactions. The project involves working with my store&#...

I'm looking for a proficient data scraper who can extract comprehensive product information from a specific website. Key Requirements: - Data to be scraped includes: product names and descriptions, product prices, product specifications, make year, and color. Skills and Experience: - Prior experience in web scraping, particularly product data is highly preferred. - Proficiency in tools like Python, Beautiful Soup, Scrapy, or similar. - Ability to deliver the data in a CSV file as per my requirement. I look forward to your bids. Thank you.

I need a web crawler that can capture video stream data to trigger real-time notifications. The specific types of notifications and data formats for saving the crawled data will be discussed later. Ideal Skills: - Proficiency in web scraping - Experience with video stream data - Programming skills in Python, Java or similar languages Please note, the specifics of the project may evolve as we progress.

I'm seeking a skilled Python developer with AWS experience to assist me in deploying an existing Amazon scraping script onto the Amazon EC2 platform. Key Project Details: - Deployment: Deploy the existing Python script on Amazon EC2. - Libraries: No specific Python libraries or frameworks are required, only standard ones. - CI/CD: Set up a simple deployment process for the script without a full CI/CD pipeline. Ideal Skills and Experience: - Proficiency in Python and experience with web scraping. - Proven track record of deploying Python scripts on AWS. - Strong familiarity with Amazon EC2. - Knowledge of standard Python libraries is necessary. - A comprehensive understanding of the deployment process is required. Additional Information: - The deployment should ...

I'm in need of a professional who can assist with web scraping to collect valuable contact information. This project focuses on gathering data from various websites, specifically targeting: - Email Addresses - Phone Numbers - Mailing Addresses - Contact Person - Their Position Ideal candidates should have experience in web scraping, lead generation, and data cleaning. Proficiency in using scraping tools and ensuring data accuracy is crucial.

My current Python project needs an update. I have two solutions to check if a number is registered on a website, but they are too slow. I've attempted to use multi-threading to increase speed, but the website blocks me. I currently ...slow. I've attempted to use multi-threading to increase speed, but the website blocks me. I currently utilize proxies and a captcha solver, but the slowest part of my process is bot detection. I need a professional who can enhance my current system to better handle bot detection, so I can avoid being blocked by the website. Skills and Experience: - Proficient in Python - Experience with web scraping and bot detection - Knowledge of multi-threading - Familiarity with proxies and captcha solvers Please start your proposal with the...

I'm seeking a professional in web scraping to help me gather contact information for lead generation. The data will primarily be sourced from Company Websites and Industry Directories. - Specific Data: I need the following contact information: - Email addresses - Phone numbers - Website links Ideal candidates should have extensive experience in complex web scraping, with a proven track record of successfully generating leads. Proficiency in data extraction tools and software, along with excellent attention to detail, is crucial.

Position Title: Data Entry Operator ChatGPT 4o mini Log in You said: Create a job description of data entry operator and it's eligibility and per hour rate in 1000 words ChatGPT said: ChatGPT Job Description: Data Entry Operator Position Title: Data Entry Operator Job Location: [Insert Location] Department: [Insert Department] Reports to: [Insert Supervisor/Manager] Employment Type: [Full-Time/Part-Time/Contract] Working Hours: [Insert Working Hours] Salary: [Insert Salary Range] Per Hour Rate: [Insert Per Hour Rate] Job Code: [Insert Job Code] Overview: We are seeking a diligent, efficient, and detail-oriented Data Entry Operator to join our growing team. The primary responsibility of the Data Entry Operator is to accurately input, update,...

I'm seeking an e...need to build a robust and scalable cloud infrastructure tailored to our needs. - Writing custom scripts: This will involve scripting in Python to meet our specific data handling requirements. - Data processing workflows: You will design and implement efficient data processing workflows using Airflow. Main project is to create views from google bigquery dataset and read it in aws emr using Workload identity federation ,create airflow jobs and then dump it to sql server. Shall be expert in terraform scripting as well Your expertise in these areas will be critical to the success of this project. Prior experience with large-scale data processing and cloud infrastructure is highly desirable. Please ensure your bid reflects your level ...

...the list includes only companies with a national presence or significant operations in multiple states. • Deliver the data in a well-organized spreadsheet format (Excel or Google Sheets). Ideal Freelancer: • Experience with web scraping tools (e.g., Python, BeautifulSoup, Scrapy, etc.). • Familiarity with data verification to ensure the information is accurate and up to date. • Knowledge of facility management or related industries is a plus. Budget & Timeline: • Please include your proposed budget and estimated timeline for completion when submitting your bid. Additional Notes: • The data collected must be publicly available. • No use of illegal or unethical scraping methods. • Please inclu...

I'm seeking an experienced UX designer to enhance the user experience of a job posting portal. Key Responsibilities: - Clients can login and post the jobs - Vendors and candidates can login and apply for the jobs - The process goes all the way to Offer letter or contract signing Ideal Skills: - Proven experience in UX design, specifically with dashboard layouts. - Proficiency in creating engaging data visualizations. - Strong understanding of intuitive navigation principles. Your bid should reflect your ability to deliver an upgraded, user-friendly UX for this job portal.

I am looking for assistance in collecting and org...327 products Kama: 294 products Max Fritid: 1169 products Movera: 545 products Deliverables: Structured Data: Use the provided Excel sheet and fill in the designated columns with extracted information, including: 1) Product Name 2) Description 3) Product page URL 4) Image URLs (usually only one, but up to four images per product, if available) 5) Additional description, if available If any errors or issues occur (e.g., missing data, broken links, unavailable products), leave a clear comment in the designated "Comments" column explaining the problem. This can be done manually with copy paste, og with web scraping tools, as long as you got attention to detail to ensure high-quality data entry....

Description: I am looking for a skilled web scraping specialist to develop a program that scrapes product data from the Schneider Electric website. The program should meet the following requirements: Program Requirements Input: Accept a list of product codes (e.g., ATV212HU40N4, ATV212HU55N4) provided in a CSV or XLSX file. Accept a list of specific parameters to scrape, such as "Device short name," "Motor power kW," "EMC filter," etc. Output: Generate a CSV or XLSX file with: Column A: Product codes. Row 1: Names of the selected parameters. Rows below: Data for each product. Additional Data to Scrape: For each product, the following should also be scraped: Link to the main product image. Link to download the "Produc...

I'm looking to create a bot using Python and JavaScript for automation purposes. The specifics of the automation tasks, the platforms it needs to interact with, and the user interface requirements are still to be determined. Ideal Skills: - Proficiency in Python and JavaScript - Experience in creating automation bots - Knowledge of web scraping, task automation, and data processing - Ability to create both command-line and graphical interfaces Potential Tasks: - Defining the type of automation tasks the bot will handle - Determining the platforms or environments the bot will interact with, such as websites, APIs, or local files - Designing and implementing a user interface if necessary I am open to suggestions and discussions on these points.

I'm in need of a skilled data scraper who can gather contact information for business owners in specific industries. Key Requirements: - Data to be collected includes: first name, last name, work and personal email address, and cell phone number. - More than 500 business owners' data is required. - Industries of interest: roofing, restoration, paving, and landscaping. Ideal Skills/Experience: - Proficiency in data scraping from various sources. - Familiarity with the specified industries. - Prior experience with lead generation or business contact data collection. - Ability to provide accurate and up-to-date information. LEAD RATE IS .15 PER LEAD

Hello, I’m looking for a fluent English developer, an expert in coding and WordPress, who is serious and doesn't have 500 other jobs, as I’ve already worked with a couple of freelancers who wasted my time. The main task is to create a chat feature that connects to each order we receive on our website (an order means when a customer makes a purchase). Once we have the chat feature connected to the orders, we will create a dashboard for my employees so they can log in to the website. The employee will log in from the website as the client, but they will be assigned a role that allows them to see the dashboard as an employee. I will connect the order with the employee, allowing them to complete the job and communicate with the customer. These are the important aspects....

1. "3 Common Resume Mistakes You Might Be Making": Create a post highlighting three frequent resume errors: Including irrelevant information. Poor formatting and structure. Lack of quantifiable achievements. Add quick tips on how to fix each mis...quantifiable achievements. Add quick tips on how to fix each mistake. "How to Make Your Resume ATS-Friendly": what ATS (Applicant Tracking System) is and why it matters. Provide actionable tips: Use standard fonts and simple formatting. Avoid graphics and images. Incorporate relevant keywords from job descriptions. Success Stories of Clients Landing Jobs with Your Resumes: 3. Share testimonials from clients who secured jobs with your help. Include their field, the position they applied for, and how your resum...

As a car bodyshop owner, I'm looking for a skilled web developer to create a simple yet sleek modern website for my business. Key Features: - About Us: A section detailing our story and mission. - Services: A comprehensive list of our offerings in car bodywork. - Contact Information: Easy access to our location and ways to get in touch. - Testimonials: A dedicated section for customer reviews to establish trust and credibility. - Gallery: Showcase our previous work and projects. - Insurance Work: A segment explaining our capability and experience in dealing with insurance jobs. The ideal freelancer for this project should have a strong portfolio in creating modern and sleek websites, preferably for service-oriented businesses. Experience in integrating customer review...

I'm in need of a skilled web scraper (proficient with AI) capable of extracting data from a webpage with 5,500 products. These products do not have variants, which should simplify the task. The data to be scraped includes: - Product name - Product Part Number - Product description (The product descriptions aren't formatted the same way for each product. They are inconsistent but similar.) - UPC - How many sold The final deliverable should be an Excel/CSV file containing all the scraped data, sorted by product name with separate columns for each data point. Ideal skills for this project include: - Proficient in web scraping - Proficient with AI - Experienced in data organization and Excel/CSV Please, only bid if you can d...

Project Goal Enhance an existing Python web scraper to process 20 websites per second, achieving a total of 1,200 websites in under 60 seconds, without data storage. Scope of Work Performance Analysis Analyze the current scraper code for performance bottlenecks, focusing on areas such as network latency, processing delays, and inefficient code structures. Implementation of Parallel Processing Integrate asynchronous processing using libraries such as asyncio and aiohttp for non-blocking HTTP requests. Explore multiprocessing or threading to handle 20 websites in parallel efficiently, ensuring resource utilization is optimized. Code Optimization Optimize the scraper code to reduce the processing time per site to 1 second or less, focusing on efficient parsing and minim...