Web scraping using selenium and beautifulsoup jobs

...Zonation of Flash Floods in Urban Areas Using SAR Data. Task: Develop risk maps for urban flash floods using Synthetic Aperture Radar (SAR) data. Region Focus: Urban areas of Mumbai prone to flash floods. Data Collection: Use SAR data to analyze impervious surfaces, drainage, and flood-prone zones in cities. -Objective: Assess urban vulnerability to flash floods through remote sensing data. -Methodology: - SAR data analysis for surface mapping. - Identify drainage inefficiencies and infrastructure weaknesses. - Topographical analysis to detect water flow and flood-prone areas. Deliverables: - Risk zonation maps highlighting high-risk flash flood zones. - A comprehensive report on urban flood vulnerability. - Recommendations for urban flood ...

I'm looking for a seasoned web automation specialist with a minimum of 5 years of experience. The project primarily involves automating interactions with web applications. Key Requirements: - Proficiency in Selenium and JavaScript - Experience in extension development - Skillful in handling multi-threaded tasks - Ability to deliver high-quality, organized code without broken solutions Task Overview: - The primary focus of the role is web automation, which includes form filling and submission, web scraping, and data extraction and processing - All automation needs to be compatible with Chrome and a third party chrome driver Please only bid if you meet the above qualifications and can guarantee qualit...

...looking to create a colorful and vibrant progressive web app for hotel booking using IONIC framework and Angular. The core functionalities of the app include: - Room booking and availability: The app should be able to show real-time room availability and facilitate bookings. - Payment gateway integration: This should be secure and seamless, providing a variety of payment options. User authentication features won't be required for this app, so the focus should primarily be on the booking and payment aspects. Ideal candidates for this project should have proven experience with IONIC and Angular, specifically in developing progressive web apps. They should also have a strong understanding of integrating secure p...

I am looking for an experienced software developer to create a desktop application for me. The primary functio...software developer to create a desktop application for me. The primary function of this application will be automating certain tasks, specifically data entry and extraction from websites. Key Requirements: - The application should be able to manage data entry and extraction tasks efficiently from various websites. - A good understanding of web scraping techniques would be beneficial. - The software should be user-friendly and easy to operate for someone with basic computer skills. Ideal Skills: - Proficiency in desktop application development. - Experience in task automation software. - Strong skills in data extraction and web ...

I have a website that allows me to check all the mobile SIMs registered under a person's name, using their ID card. However, the current process is incredibly time-consuming as I have to check each ID card one by one. I need a solution that can automate this process for me. - Input: I have millions of ID card numbers stored in a text file. - Output: I would like the results saved in a separate text file. - Details: The results should include the mobile number associated with each ID card. Ideal skills for this project would include experience with web scraping, data processing, and automation. Familiarity with Python or similar programming languages would be a strong advantage.

I'm looking for a web scraping expert who can extract contact information, including email and mobile numbers, from Autobody shops across Ireland and the UK. Requirements: - Data should be compiled and delivered in an Excel format. - This is a one-time project, with no requirement for data updates post-delivery. Ideal Skills and Experience: - Proficient in web scraping tools and techniques. - Prior experience in data extraction from business directories or similar sources. - Excellent attention to detail to ensure data accuracy. - Proficient in Excel for data compilation.

I need assistance downloading my video courses from a personal website. I have the login credentials to access the content but there are more than 10 courses to download. Ideal Skills and Experience: - Proficient in data downloading and web scraping - Familiarity with video format and ability to ensure all content is correctly downloaded - Experience with personal website data extraction preferable Please bid if you are able to help with this project. Thank you!

...simultaneously (up to 500 accounts) and provides easy account management, including messaging and sending contact requests to multiple users at once. The key requirements of this application are: Multi-account login: Ability to log into up to 500 Skype accounts simultaneously within one application. Account management: View all active accounts in a single interface and manage them (e.g., show login status, switch between accounts). Messaging automation: Reply to incoming messages from any account and send messages to multiple contacts at once. Contact management: Send contact requests to multiple users at the same time from any selected account. Requirements: Strong experience in C# WinForms development. Experience with managing multiple accounts using...

I'm seeking assistance in analyzing financial data with the aim of assessing various risks. This project specifically involves: - Utilizing Oracle Crystal Ball to process the data - Focusing on different types of financial risks including Market risk, Credit risk, and Operational risk Ideal candidates should have extensive experience with financial data analysis and Oracle Crystal Ball, with a strong understanding of various financial risks.

I'm seeking a professional who can craft tailored financial and sales reports in Zoho Books using Zoho Analytics. Key requirements include: - Creating comprehensive financial and sales reports - Customizing layouts and templates for these reports - Integrating with Zoho Books Ideal candidates should have: - Proficiency in using Zoho Books and Zoho Analytics - Experience in creating and customizing financial and sales reports - Skills in integrating software and creating custom layouts and templates Looking forward to your proposals.

I am looking to develop a scraping system that automatically collects and monitors data from the SEACE (Peru's State Electronic Contracting System). The system must allow for custom searches and generate personalized reports on bidding processes, with specific filters. It should include alerts and reminders for deadlines and progress, and provide a tracking system to detail the status of each bidding project. Experience with Python, Selenium, and automated reporting is required.

I'm looking for a proficient Python developer with a strong background in web scraping. The primary purpose of this project is to scrape data for potential market research and content aggregation. Key Responsibilities: - Develop a Python script for web scraping. - Ensure the script is able to handle various types of data. - Deliver the scraped data in a pre-defined format. Ideal Skills and Experience: - Proficient in Python, with extensive web scraping experience. - Familiarity with data analysis and market research. - Ability to deliver data in CSV, JSON, or Excel format. I would appreciate a freelancer who can work independently and is able to troubleshoot any issues that may arise during the scraping p...

2 scraping scripts described in chat/xlsx file

I'm in need of a professional with web scraping experience to extract data from TripAdvisor. The main focus will be customer reviews, prices, and amenities. The final deliverable will be a structured and clean dataframe in a CSV file containing approximately 10,000 rows. Key tasks: - Scrape customer reviews (both text and numeric ratings, in English only), prices, and amenities from TripAdvisor listings. - Deliver a cleaned, structured CSV file without any code. Additionally, I require simple Python code based on open-source libraries to clean the text data, perform tokenization, stemming, and lemmatization. The code should also conduct a basic sentiment analysis, categorizing each review as positive, neutral, or negative. Furthermore...

bot extraction images, remove watermark and extrac data using llm

I'm looking for an experienced Python developer who can help me with a data scraping project. The primary focus will be on extracting text data from various news websites. Key Requirements: - Proficiency in Python with a strong emphasis on data scraping libraries such as BeautifulSoup, Scrapy, or Selenium. - Previous experience in scraping text data from websites, specifically news sites. - Ability to handle large volumes of data efficiently and effectively. - Knowledge of data cleaning and preprocessing techniques. Please include examples of similar projects you've completed in your proposal.

I'm in need of a Python expert who can write code to automate data entry tasks from databases. Key requirements: - Proficiency in Python - Prior experience with automation - Familiarity with databases Skills and experiences that would be beneficial: - Experience with data entry tasks - Understanding of file management and web scraping - Ability to write clean, efficient, and well-documented code

I need a website that allows users to paste a link of a phone, and in return, they get to know the current price of that phone from the manufacturer's website. The site should focus on providing: - Current price only: The website will solely display the current price of the phone, not historical price trends. - English: The website will only support English. Multi-language support is not required for now. Ideal candidates for this project should have extensive experience in web development, specifically in creating price tracking websites. A strong understanding of web scraping from manufacturer websites is crucial. i what that pricing to be show from an app called cashify super sale

I need assistance configuring UIPath (free version) to automatically generate invoices every 10 minutes for all 'Pending' statuses using our desktop installed erp system Key Requirements: - The orders should be filtered using specific statuses, then right click -generate invoice and repeat Ideal Skills: - Proficiency in UIPath, particularly the free version. - Experience with invoice automation and filtering by status.

I'm encountering a dependency version mismatch with the Selenium Chrome Driver while trying to build the axe-core-maven-html project using Maven. The specific issue arises during the "mvn clean install" command. I need this resolved so I can proceed to dockerize the code post-build. Key Issues: - Dependency version mismatch: The Selenium Chrome Driver is causing the conflict. - Current Driver Version: I'm using Version 4.x of the Selenium Chrome Driver. I would appreciate it if you could help fix the errors occurring during the test stage, and get this build successful.

I'm looking for an expert to configure PowerMTA SMTP on a cluster server across multiple domains to enhance high email deliverability. Key Requirements: - Extensive knowledge and experience in PowerMTA SMTP configurations. - Previous work with cluster servers and multiple domain configurations. - Skills in optimizing for high email deliverability. Please note, this project is time-sensitive, so I need a professional who can deliver efficiently. Experience with tracking and improving email deliverability metrics will be an added advantage.

am lo...a website that scrapes data from Google Map, similar to what XXX offers. (website in DM) Main Features: Google Map Scraping: Extract data such as business names, addresses, GPS coordinates, phone numbers, reviews, etc. User-friendly Interface: A modern and simple design allowing users to easily run scrapes. Report Generation: The scraped results should be exportable in various formats (CSV, Excel, etc.). Task Automation: Ability to schedule scrapes on a regular basis. API Limits Handling: Management of Google API quotas and restrictions to avoid any blocking issues. I am looking for someone with expertise in scraping, APIs, and creating a smooth and intuitive user interface. If you have experience in building similar ...

I'm looking for a professional data scraper who can extract structured data (like tables and lists) from a specific website. The data will need to be compiled into a CSV file. Ideal skills for this project include: - Proficiency in web scraping tools and software - Experience with data extraction from complex websites - Strong attention to detail to ensure data accuracy - Ability to deliver the final output in a clean and organized manner

...looking for a skilled video editor or production company to create a heartfelt 3-minute memorial tribute video using a photograph of a deceased family member. The video will be part of a special celebration and should be emotionally impactful, combining photo animation, old footage, and AI-based enhancements. Project Requirements: Photo Animation/AI Enhancement: Animate a still image of the deceased person using AI technology to create realistic facial movements (blinking, smiling, etc.). Use AI-generated speech to make the person “speak” based on a provided script Incorporate Old Clips: Blend the animated photo with existing video clips, to make the video more personalized and authentic. Background Music: Add appropriate background musi...

I'm looking for an expert to set up PowerMTA SMTP with multiple domains, using specific authentication methods including DKIM, SPF, and DMARC. using cluster server This is Very Urgent i have to start it by today

...online store and need a Shopify expert who can assist us in setting up a new e-commerce platform similar to , utilizing the Shopify Dawn theme. This project requires working directly with us via screen-sharing tools like Zoom or AnyDesk. We are offering $3 per hour for this ongoing collaboration. The ideal candidate will have deep experience with Shopify, especially in customizing and setting up the Dawn theme. You should be adept at live communication, comfortable with sharing your screen, and capable of providing step-by-step guidance and troubleshooting in real-time. Please provide details of your experience with Shopify, especially any projects involving the Dawn theme or similar websites. Include your availability, how you handle interactive sessions, ...

I'm looking for a skilled data scraper who can help me extract product descriptions and prices from various my e commerce website. This information will then be scraped into an email template that is sent to customers and will match the design of my website. Key Responsibilities: - Scrape website content from my travel agency e-commerce site. - Focus on gathering product descriptions and prices In addition to web scraping, I also need assistance with designing ZOHO emails to convey this information in a clear and appealing manner. Ideal Skills and Experience: - Proficiency in data scraping tools and techniques - Experience with e-commerce websites - Prior experience with ZOHO email design - Excellent attention to deta...

I'm looking for a Python and database expert with knowledge of Generative AI. The task involves writing code and utilizing the Langgraph framework for a multi-agent collaborative approach. This system will gather data from the internet using OpenAI or other LLM models, and save the retrieved results in a structured format - specifically JSON. Key tasks for the multi-agent system: - Web scraping: Collecting data from various online sources. - Data summarization: Processing the collected data into concise, informative summaries. Please note that I have not specified a preferred database for storing the retrieved results, so I am open to your recommendations based on your expertise and the needs of the project. Ideal candidates for th...

...video on the topic of dirty and clean air in Formula 1. The video should visually explain how airflow affects car performance, combining clear visuals with a provided voiceover to engage and inform the viewer. Responsibilities: - Storyboard Execution: You will be provided with a storyboard that outlines the structure and key points of the video. Your task will be to follow the storyboard closely and bring it to life through 3D animation. - Asset Creation: Important assets such as Formula 1 cars and track environments will be provided. However, if additional assets are required to enhance the scene, you will be responsible for creating these. - Creative Visualization: Ensure the video is visually appealing while accurately portraying the effects o...

I need a system that sends real-time notifications to my Telegram group every time a ticket is purchased from www.moonshotboxes.com. Specific Details to Include: - Round Name - Prize amount - Amount of tickets purchased I envision this system as a way to keep my group updated instantly after each purchase. Ideal Skills and Experience: - Proficiency in Telegram Bot development - Strong understanding of web scraping - Experience with real-time notification systems - Ability to work with e-commerce websites - Good communication skills for understanding project requirements

Please do not apply if you have not read this description. I have art fairs, the cities they take place in, dates and a source link for the data in many instances. I need you to fill in a few columns: - Average number of exhibitors - Average number of visitors - Average ticket price - Source link for ticket price and/or date The final file is longer than the sample, and has 365 rows. Note that a lot of work has already been done on this, including the source links are mainly all there, which helps when using Chat GPT for scraping the other data. Please provide a competitive rate, I have lots of related work and hire a lot of freelancers.

I'm looking for a simple yet effective iOS/Android app that scans a specific website for ...appointments via push notifications. Key Features: - Cross-platform compatibility: The app should be designed for both iOS and Android. - Customizable alerts: Users should be able to select which type of government appointment they would like to be notified about. - Real-time updates: The app should monitor the website for new appointments and send out notifications promptly. Ideal Skills and Experience: - Proficiency in iOS and Android app development. - Experience with implementing push notification systems. - Knowledge of web scraping techniques to monitor the specified website for new appointments. - A strong understanding of user interface design...

I need a proficient data scraper to extract text data from a specific website. The data should be delivered in an Excel format. There is 2 Scrape job...Excel format. There is 2 Scrape job to do. This is a one-time project with no recurring scrapes needed. Ideal skills for this project include: - Proficient with data scraping tools - Excellent attention to detail - Ability to deliver data in specified format First Url# Second Url# Enclose, the Excel file I wish to have. There will be 2 Sheet, one for Man and one for Woman

I'm looking for a skilled web scraper to gather product data from a specific e-commerce website. Optional scraping with screaming frog. Vid tutorial attatched. Example of product page to scrape Need to extract: Product name Product image Items in pack Barcode SKU Brand Category (not sure it's possible. I don't see it in page code) Data Delivery: - The scraped data should be delivered in an Excel file. The ideal freelancer for this job should have: - Extensive experience in web scraping. - Proficiency in data extraction and Excel. - Ability to work autonomously and with minimal guidance.

I'm looking for a proficient data scraper with expertise in TikTok to help extract user data...addresses - Number of followers I plan to use the extracted (1000 USER) data primarily for direct phone calls. Therefore, the quality and accuracy of the phone numbers is crucial. The data should be delivered in an Excel spreadsheet. Proficiency in data organization and presentation in Excel is a plus. Skills and experience that would be beneficial for this project include: - Proficiency in data scraping tools and techniques - Experience with TikTok data extraction - Ability to deliver accurate and well-organized data - Familiarity with lead generation processes - Proficiency in Excel Please note that the extraction of personal data must compl...

I need basic protection for my Web API against unauthorized endpoint access. Ideal Skills: - Basic Web API Security Implementation - Understanding of Unauthorized Access Prevention Techniques -Python -DOcker -Automation - Selenium Webdriver Experience: - Previous work with basic Web API protection - Proven track record of preventing unauthorized endpoint access

I need a skilled Python developer with expertise in Selenium for automating data extraction and processing tasks from various websites. The ideal freelancer will have experience working with Docker, MySQL, and FastAPI, as these tools will be integral to the project. Key Responsibilities: - Automate data extraction tasks from multiple websites using Selenium. - Process the extracted data for further analysis. Skills and Experience Required: - Proficient in Python with strong Selenium skills. - Experience with data extraction and processing. - Familiarity with Docker, MySQL, and FastAPI. - Previous work with web scraping is a plus.

I'm looking for a Python expert who can help me scrape statistical data from various websites. Key Requirements: - Proficiency in Python and web scraping libraries - Ability to gather and organize data efficiently - Experience in working with statistical data

...build a demo in ASP.Net core scraping editing and running engine, i.e. the asp.net portal allows you to log in via Google, you can save your code on a page, and the engine will compile it upon my approval with a click. The code will run automatically according to the schedule, just like Visual Studio 2022 on asp.net + a task scheduler. Your colleague can also work on their scrapes individually, but you cannot see their code, and they also cannot see your code. Only the admin can view and approve all the code with a click. Your project will be tested on real data scrapes. • Bidding Your bid is my budget. If you deliberately put in a low bid to attract me to speak to you, you either revise your bid, or I will ignore you. • Delivery We need...

...All-in-One Lead Generation and Sales Enablement Platform with CRM Integration, Multi-Language Support, and Lead Verification Project Overview: The project will create a platform for Business Development and Sales Teams that generates leads by leveraging the Bright Data API to extract a list of leads and their websites. The API will then generate additional contact information (emails, phone numbers, etc.) based on the websites provided by Bright Data. The platform will also include multi-language support, CRM integrations, and a referral program. Project Objectives: 1. Build a lead generation platform that extracts leads and websites using Bright Data API and generates lead contact details using API. 2. Integrate Bright...

I have a Python Beautiful Soup script that needs modifications after a website's layout has changed. The script used to work flawlessly, but it's no longer able to scrape the site cleanly. Key Requirements: - Proficiency in Python, particularly with Beautiful Soup. - Experience with web scraping and handling changes in website structures. - Ability to troubleshoot and resolve issues swiftly. Please apply if you can help me get this sorted as soon as possible. I need the <!-- Main content --> of each page. I'll provide my existing code to the person I select It would be nice if this includes the css

I'm looking for a freelancer to scrape data from a specific website and gather details about its mentors and page specifics. Ideal Skills: - Web Scraping - Data Analysis - Attention to Detail Experience in similar projects will be a plus.

I have a task that involves scraping image links from a specific website. I will provide a list of approximately 200 part numbers. For each part number, I need the corresponding image links compiled into a Google Sheets spreadsheet. Please note that many parts will have multiple images. Requirements: - Scrape image links from the website: - Compile the links for each part number into a Google Sheets spreadsheet - Organize the image links in separate columns for each link Ideal Skills and Experience: - Proficiency in web scraping - Experience with Google Sheets - Attention to detail Deadline: The project needs to be completed within a week. I look forward to your bids.

I need assistance with data scraping from an Excel file containing a list of Organization Numbers. The task involves extracting data from a specific website using these numbers as input. The process should include: Reading the Organization Numbers from the Excel file. Inputting the numbers into a search field on the website. Scraping the relevant data from the search results page. Exporting the extracted data back into Excel or a similar format. Familiarity with web scraping tools (like Python, BeautifulSoup, or Selenium) and experience with handling anti-scraping measures (e.g., CAPTCHAs) is essential. Accuracy and attention to detail are key for this task. Thank you MD

I'm looking for someone who can scrape a specific website database for personal use. Please include in your application: - Your past work, particularly if you've done similar website scraping tasks before. I'm looking to have this completed as soon as possible.

I'm looking for a skilled freelancer to help me with a project involving browser automation with Selenium. I have existing code written in the Python programming language that needs improvement or modification. Specifically, the task I need help with is browser automation. I'm looking for someone who is experienced and knowledgeable in this area, and is confident they can help me take my project to the next level. If this sounds like you, please feel free to apply and discuss details.

I'm looking for an experienced Node.js developer to create APIs for my existing business. Key Requirements: - Proficient in Node.js with a strong understanding of its ecosystem - Proven experience in API development - Ability to work under pressure and deliver ASAP In your application, please highlight your relevant experience, particularly any previous work with API development using Node.js. I'm looking to get this project done as soon as possible.

...various tech-related tasks and projects. I offer a work-from-home role. It involves working with a range of technologies, so a strong background in Python, NodeJS, NextJS, and general Python/node libraries is essential. Key Responsibilities: - Assisting with AI agent development using Langchain, RAG Agents, and general AI agents - Utilizing Azure OpenAI, Perplexity, OpenAI APIs & Open Source LLM's - Python scripting and automation tasks - Contributing to web development projects using NextJS, Javascript, and ReactJS - Working with several Node libraries, and Node JS in general - Ensuring production-ready deployments - Handling API integrations, Github workflows, and Linux administration - Managing databases...

I would like to develop a GUI setting and a simple login system for programs developed with current Python. The login system is Simple Administrators page - Create a User - Delete User - Modifying User Information

I'm seeking a Python programmer with Selenium experience to create a script that automates the process of booking appointments on a specific website. The script should be able to: - Continuously loop and check for the first available appointment, as slots appear randomly. - Navigate through the website and click through the booking process. - Integrate with an API captcha service to bypass the website's captcha. This is a personal project and the script needs to be completed as soon as possible. In your application, please provide a detailed project proposal outlining how you plan to tackle this task. Prior experience with similar projects will be a significant advantage.