Web scraping using selenium and beautifulsoup jobs

...skilled developer to create a dynamic reverse proxy solution using and http-proxy-middleware. The proxy must function similarly to , offering seamless web proxy functionality with integration of a Service Worker on the frontend for advanced request handling. Requirements: Backend (Proxy Server): Build a reverse proxy using and http-proxy-middleware. Support dynamic target selection, routing requests to different backends based on specific rules (e.g., request paths, query parameters, or custom headers). Forward headers, cookies, and other request/response metadata correctly to emulate CroxyProxy's behavior. Implement custom middleware to modify or log requests and responses as required. Fro...

mohawk products 162 @.25 per record

... and update my Shopify store. The existing products in my store must be updated with the following parameters: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Inventory by Variant - Variants (color, size, etc.) - SKU If the products on the supplier's site are not in my store, they should be created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Lib...

I have to do the coding for attiny 85 to control the led and buzzer based on the buzz wire.

Project Description: Turnkey Web Application Development Using Django MAXIMUM BUDGET: USD 2,250. 1. Project Conditions Exclusive internal use: The application is intended only for the employees of the importing company. No external users will have access or be able to make purchases through the application. Deadline: 3 weeks from the project award. Current status: The project is already 20% complete. Partial deliveries: At least 2 partial revisions are required before the final delivery for feedback. 2. Objective Develop a turnkey web application for an importing company that facilitates: - Management of customer orders. - Consolidation of purchases made from factories. - Administration of an inventory. - Registration and customization of client informatio...

I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.

I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.

...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data&...

I'm in need of a modern e-commerce website designed to sell mobile devices, laptops, tablets, and consoles. The site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site :

I'm seeking a skilled data scraper to extract stock prices from Yahoo Finance. The data should cover both the NYSE and NASDAQ. Key Responsibilities: - Scrape real-time and historical stock prices from Yahoo Finance. - Implement data scraping in a way that it can be run periodically. - Store the scraped data into a MySQL database using "INSERT ON DUPLICATE KEY UPDATE" to handle potential duplicates. Ideal Skills: - Proven experience in web scraping, particularly finance data. - Strong knowledge in MySQL and data management. - Familiarity with Yahoo Finance and stock market data. Please bid if you can provide a prototype and have experience in similar projects.

...to compile a detailed list of private drum instructors across the entire East Coast of the US and Canada. The goal is to generate a comprehensive document with 500-1000 leads, aimed at enhancing outreach and potential engagement. Key Responsibilities: - Research and document private drum teachers who possess personal websites showcasing their drumming and teaching services. - Gather and verify essential contact details: First Name, Second Name, Email, Web URL, City. - This project requires search engine research and music teacher directories, NOT LinkedIn scraping. Deliverable: - The final list should be delivered in a Google Sheets or excel document. Ideal Skills: - Proficient in web research and data collection. ...

...seeking an experienced and skilled developer to create a feature-rich web application for controlling smart lighting devices via the Tuya API. The application should leverage the capabilities of the Tuya API library to offer seamless control over various aspects of smart lighting systems. Pre-designed templates and assets for the web app interface, as well as a pre-built backend library for API interactions, will be provided to accelerate development. Core Features: - On/Off Control: Allow users to power smart lights on and off individually or as a group. - Dimmer Control: Enable users to adjust light brightness with a slider or percentage input. - Color Adjustment: Provide a color picker or similar interface for changing the light colors, including s...

I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate p...for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and ...

...with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note, this project requires persistence, cre...

I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and...

I'm facing a compatibility issue with my React Native app on iOS devices which is using NativeEventEmitter. The error is either `new NativeEventEmitter()` requires a non-null argument or listener not found I need an expert in React Native with Objective C skills to fix this problem as soon as possible. TASK TO BE DONE ON ANYDESK....

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I need assistance with extracting data from a PDF and placing it into an Excel format I will provide. Key Requirements: - Data extraction from the PDF should be done according to specific column headers in the provided Excel format. - Minor data cleaning is needed during the extraction process. Ideal Skills: - Experience in data scraping. - Proficient in Excel. - Attention to detail for data cleaning.

We are looking for an experienced Android developer to create an APK similar, with features like real-time audio communication, text messaging, and a user-friendly interface. The project involves using NIO (Non-blocking I/O) and WebRTC libraries for high-performance, low-latency communication.

...including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The t...

I'm looking for a skilled professional who can suggest a reliable, low-latency proxy service for my web scraping project. The script currently targets public APIs and without a proxy, it's taking around 200ms to hit the endpoints. With a proxy, I need the latency to be between 300-500ms max. Key Requirements: - The proxy service should be located in Australia - The IP rotation level should be low, with only a few changes per day - The service should not require any specific authentication methods, as the APIs I am using do not require authentication I've previously tested several proxy services but most of them resulted in latency around 750ms, which is not suitable for my needs. Please only bid if you have experience with a proxy service that h...

Another scraping project - Need cover art based on ISBN and Author Name

I'm seeking a skilled professional who can create an educational brain model using Meta Sam and a MRI dataset. This model is intended for undergraduate students, so it needs to be detailed yet comprehensible. Key Requirements: - Model should include: - Detailed anatomical structures - Functional areas of the brain - 3D interactive elements - Proficiency in using Meta Sam - Experience with MRI datasets - Ability to create educational content

i will do the designing of the PCB in altium

I need someone to scrape data from a service guide website into a Google Sheets document. The data includes Company Name, address, Name, email, phone, mobile, website etc etc from 9632 entries across 20 categories. Ideal candidates for this project should have: - Proficient data scraping skills - Experience with Google Sheets - Attention to detail to ensure all data is accurately captured from all 20 categories.

...accounts on platforms like MYM.Fans. These platforms allow creators to monetize private content by selling photos, videos, and live interactions directly to their subscribers. One of the most time-consuming aspects of this process is chatting with subscribers. Currently, agencies hire human chatters to engage with subscribers, build relationships, and sell content. This approach is labor-intensive and not scalable. Objective: Instead of developing a completely new AI from scratch, we want to leverage existing AI technology, such as ChatGPT’s API, and adapt it for this utility. The goal is to educate and fine-tune the ChatGPT API to perform the specific tasks of chatting, engaging, and selling content on while being fully integrated with a...

...of a diver location application for Android, using OpenCPN. The app's primary function is to help locate divers using a radio beacon attached to each diver. Key Features: - Real-time location tracking of divers using radio beacons - List of Divers associated with the vessel to be managed - Each diver will be displayed on the screen and Divers not currently transmissing will be displayed to ensue they are accounted for. - A radio reciever to bluetooth serial adapter has been developed and the location information is sent as LAT/LON and radio ID using the NEMA AIS format - Ability to save detailed dive notes with each location. the project is anticipated to be based on OPENCPN for android Ideal Skills and Experience: - Pr...

I meed a website built using a template. I will purchase. It needa to have a booking and payment added ao people can book tours each day. Need within 5 days. Examples must be provided.

I'm looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone numbers, from various sources. Key Requirements: - Proficiency in data scraping from company websites, business directories, and social media platforms. - Experience in lead generation. - Expertise in logistics, warehousing, and ecommerce sectors is a plus. Ideal Skills: - Data mining - Web scraping - Lead generation - Knowledge of ecommerce and logistics industry

I need an experienced professional who can perform regression testing on my web application using Selenium with Java. Key Requirements: - Proficiency in Java and Selenium - Experience in performing regression tests - Capability to conduct tests on Chrome browser - Understanding of data creation through API - Data writing and extraction from excel/CSV - Page Object Model The focus of this project is to ensure that all features of the web application are working as intended after updates or changes, and to identify any potential issues before they impact users. The ideal freelancer will be detail-oriented, capable of developing comprehensive test cases, and able to communicate findings clearly and effectively.

I have a WordPress account and an Envato-Codecanyon account and have need to build a website using the platforms mentioned to do it. I am looking for a website builder to use the above to develop the site.

Job Overview: I’m looking for an experienced front-end developer to design a professional invoice template using HTML and CSS. This template will be integrated into my CRM, which uses a built-in Chrome engine to generate PDF files. Requirements: Clean, responsive, and professional invoice design. Compatibility with the Chrome PDF engine. Well-structured HTML and CSS code optimized for print. Customizable fields, including: Logo, Client Name, Products/Services, Amounts, Taxes, Totals, etc. Deliverables: A complete HTML/CSS file ready for use. Instructions for integration into the CRM (if needed). Notes: I can provide an example of the desired style for reference. Ideal Candidate: Proficient in HTML/CSS. Familiar with how PDF rendering engines like Chro...

I am seeking 4 skilled QA engineers to bolster my team's automated testing efforts, specifically using Selenium. Key Responsibilities: - Conducting automated testing across various aspects of our product, including the User Interface, API, and Database. - Identifying bugs and issues and ensuring they are addressed before product release. Ideal Skills and Experience: - Proficiency in automated testing, particularly with Selenium. - Strong understanding of testing User Interfaces, APIs, and Databases. - Excellent problem-solving skills and attention to detail.

...fast food. Key Requirements: - Data Points: The list must include the restaurant's email addresses, phone numbers, website URLs, full addresses, as well as their Facebook pages, Instagram handles, X profiles, TikTok accounts, and YouTube channels. - Type of Restaurants: All types, not limited to a specific category. Ideal Skills: - Data mining and web scraping - Market research - Familiarity with the Australian restaurant scene is a plus Please note, the main purpose of this data will be to support the launch and growth of a new food delivery app. Your expertise and attention to detail will be crucial in helping us make this a success....

I'm looking for a talented Indian developer who can create an automation system for stock trades on Angel One. ...Trades should be automatically executed in MTF (Margin Trading Facility) options. - The system needs to ensure seamless, real-time order placement without any manual intervention. The system should check for new stock recommendations every minute. Ideal Skills: - Proficient in Web Scraping, particularly with tools like BeautifulSoup, Selenium, and API integration. - Experienced in working with Trading APIs, specifically Angel One. - Skilled in Python or Node.js for automation. - Previous experience in algorithmic trading and order execution is a plus. This is a freelance project, not a full-time job. Please provide examples of s...

Start your reply with SCRAPER. Won't read any other post. I need a script that can scrape text and articles from a specific site and similar ones. The data should be delivered in a CSV file. The script only needs to run once. Ideal skills and experience for this job include: - Proficiency in web scraping tools and programming languages such as Python, Beautiful Soup, Scrapy, or similar. - Experience with data formatting and export to CSV. - Knowledge of how to make the script compatible with similar sites. Please include examples of previous similar projects in your bid. We have a tight budget as we know this is an easy job. We don't need the outcome. We need the script. Starting point: Data to be scraped on the next pa...

I am looking for a Selenium expert who can implement a python code to automate booking appointment for a web application. More details will be shared via chat... Ideal Skills: - Expert in Selenium - Experience with functional testing - Proficient in testing web applications - Familiar with Chrome and Firefox testing - Able to deliver quality test automation

Title: Web Scraper Needed to Extract Data from UAE Websites: - "Mango" - "Marks & Spencer" - "H&M" Description: I am looking for an experienced web scraper to build a script that can reliably scrape product data from the "Mango", "Marks & Spencer" and "H&M" UAE websites. The end goal is to produce a CSV file for each brand containing all relevant product information as well as provide the code used for the scraping process. Project Requirements: Websites: "Mango" UAE (), "Marks & Spencer" UAE (), "H&M" UAE () Data Points Needed: Product name Product category Price Product description Product images (URLs) Shop Address Shop working hours Any availabl...

I'm in need of a professional who can extract video links from a streaming service and enable me to embed these on my website. The essential requirement is for the videos to be playable directly on my site. Ideal skills and experience for the job include: - Knowledge of web scraping and link extraction - Experience with embedding video links on a website - Proficiency in web development - Familiarity with streaming services - Demonstrable integrity and respect for copyright laws

I need Power Automate Desktop developer to help me capture a certain data filed on a web page.

... Conversion, and Optimize Website for High Performance I’m seeking a highly skilled and efficient full-stack developer to modernize my existing website and complete an ongoing migration. The project involves upgrading our legacy tech stack, completing the frontend conversion from AngularJS to Vue.js, and optimizing the platform for high performance to support many concurrent users. The ideal candidate should: Be proficient in Symfony, Vue.js, PHP, and MySQL. Have experience working with legacy systems and migrating/upgrading older frameworks. You must be heavily using AI tools like ChatGPT o1 and sonnet 3.5 to accelerate development and ensure quality output (I will provide access to best LLMs if you need) Be able ...

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and...

...communication and project management, we've identified the need to integrate WhatsApp as a primary tool. We aim to establish a structured system that allows for streamlined messaging, task coordination, and project tracking. - Objective: Implement a WhatsApp-based communication system to improve daily interactions and project workflows within our team. - Scope of Work: * Set up WhatsApp Business API or appropriate version for business communication. * Create guidelines for internal messaging, including response times, message formatting, and usage protocols. * Develop a task coordination process that leverages WhatsApp features, ensuring all team members are aligned and accountable. * Integrate a project management approach using...

I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).

I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.

I am in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance the efficiency of my data...

I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.

...experienced in Shopify and the PageFly app to design and build a 2-page sales funnel for our brand. The funnel will be designed to align seamlessly with our website’s design aesthetics and overall branding. The project will involve the creation of two essential pages: 1 - Lead Capture Page 2 - Upsell Page Project Goals: 1 - Create a visually appealing and conversion-optimized Lead Capture Page where visitors will exchange their email addresses for a freebie. 2 - Design an engaging Upsell Page to offer a complementary product to the lead. Both pages should: 1 - Reflect our brand’s design and tone. 2 - Be responsive and user-friendly across all devices. 3 - Utilize proven design principles to maximize conversions. 4 - Be fully f...