Web scraping using selenium and beautifulsoup jobs
I am looking for a Selenium expert who can implement a python code acting like a real human. OS: Vps windows remote desktop pc, Vps ubuntu remote desktop pc Requirement: Transmit all requests through residential proxy. Actions: Head over to booking appointment website url, Search for the term "All services from AZ" on the new page, Click on "All services from AZ" Click on the letter N button, Choose the service type we need to grab, ( we will let you know ) Click on reservations, Select "all locations" tick. Click on "book an appointment on this location button" Calendar pops up when you confirm. It shows two months later, selenium should go back to current month and search the nearest available day.(max two days later is expe...
Need to implement 4 motorized faders using Atmega 328P to existing esp32 project. I'm looking for a professional skilled in embedded systems and motor controls. The task is to implement 4 motorized faders in an existing ESP32 project, using an Atmega 328P microcontroller. Key Requirements: - The motorized faders will primarily be used for audio mixing, so previous experience with audio-related projects could be beneficial. - The faders need to be synchronized with software, so proficiency in software integration is necessary. Ideal Skills: - Extensive knowledge of Atmega 328P and ESP32 - Experience with motorized faders - Proficiency in software integration - Background in audio mixing hardware would be a plus.
...Python developer to create a custom tool to assist with business origination. The tool should enable efficient data scraping from True Local Australia () and include features for data collection. Key Requirements 1. User Inputs in Python: - Industry/Business type. - Location (e.g., New South Wales). 2. Functionality: - Automate input of specified criteria into (). - Scrape business information from multiple result pages, including: - Business name, location, website, phone number, and email address. - Click into each result to capture additional details: - Business description - Year established. - Number of staff. - ABN and ACN (if available). 3. Output: - Save scraped data into Excel/CSV format. 4. Advanced Capabilities: - Handle scenarios
...for a Python Developer with strong experience in Django and web scraping to help build and enhance chatbot applications. You will develop backend services, integrate web scraping tools, and manage data to improve chatbot functionality. Responsibilities: Develop and maintain backend services using Python and Django. Implement web scraping techniques to gather data from external websites. Integrate scraped data into chatbot systems for improved responses. Work with databases (SQL/NoSQL) and APIs to support chatbot features. Collaborate with frontend developers to ensure smooth integration. Requirements: Strong experience with Python, Django, and web scraping tools like Bea...
My project involves extracting specific CAD data using a LISP routine in ZWCAD. The data to be extracted primarily consists of attribute data from 2D drawings, 3D models, and BIM data. Key Responsibilities: - Use LISP to extract attribute data from CAD files - Work with 2D drawings, 3D models, and BIM data Ideal Skills: - Proficiency in ZWCAD - Experience with LISP programming for CAD data extraction - Ability to work with various CAD data types Please provide examples of similar past projects when bidding.
I'm seeking a skill...individually. Tasks to be Automated: - Data Processing: Handling and analyzing numeric data efficiently. - Web Scraping: Gathering necessary information from the web. - Report Generation: Creating insightful reports based on processed data. Typical Data: - Primarily numeric data, so experience with handling and analyzing numeric data is crucial. Data Sources: - Primarily sourced from emails, web pages, and documents. Ideal Skills and Experience: - Proficiency in Python with a strong portfolio of automation scripts. - Experience with data processing and web scraping. - Ability to generate comprehensive reports. - Familiarity with extracting and processing data from emails, ...
...Title: Computer Programmer (Web Scraper/Software Developer) Job Location: Remote Job Type: Contract Job Overview: We are looking for a skilled and self-motivated Computer Programmer to develop a software solution that will automate the process of collecting property tax delinquent data from public property records. The solution will allow for filtering and sorting between different property types (houses and land) and should extract specific property-related information including owner names, addresses, APN (Assessor’s Parcel Number), delinquency status, county details, lot size, assessed value, and market value. The ideal candidate should have experience building web scrapers, APIs, or data collection tools, with strong program...
...Familiarity with Python for data extraction and processing. Project Description --------------------------- We are seeking a freelancer to automate the process of updating our Shopify inventory. This project involves adding approximately 8,000 new products from a supplier while ensuring compatibility with the existing catalog of 7,000 products already on our platform. The supplier’s inventory data is provided in an Excel file and must be adjusted to match our current Shopify format. Tasks to Complete Data Structure and Formatting: ------------------------------------------ Align the supplier's data to match the format of existing product listings. Ensure the HTML templates maintain the current design standards, including device ...
I'm seeking a professional with expertise in malware detection and classification to leverage the MalConv architecture for my project. The primary objective is to classify known malware types using a publicly available malware dataset. Key requirements: - Proficiency in machine learning and specifically in the application of the MalConv architecture for malware classification. - Experience with publicly available malware datasets. - Ability to deliver a robust and efficient classification model. Please note that the specific types of malware to be classified have not yet been determined, so flexibility and a broad understanding of different malware types will be beneficial.
...expertise in web scraping to create a script that extracts product information from websites. The solution must be efficient, reliable, and capable of handling diverse website structures. Project Requirements: Domain Extraction: Start with a large array of email addresses and extract their respective domains. PDF Search: For each domain, search for downloadable product sheets in PDF format. HTML Product Extraction: If PDFs are unavailable, extract product information directly from the HTML content of the website. Robustness: Ensure the script is adaptable to handle varying formats and structures of product information across different websites. Desired Qualifications: Proven experience in Python web scraping (e.g., using librari...
...must be mobile-friendly, easy to maintain, and hosted on CrazyDomain. Key Requirements: 1. Platform: Use the latest version of WordPress as the website platform. 2. Database: Use the latest version of MySQL as the database. 3. Theme: Use the latest version of the Flatsome WordPress theme with necessary customizations to match the current design. 4. Content Migration: o Migrate all articles, images, videos, and metadata. o NO need to maintain the current URL structure. 5. Responsive Design: Ensure the website is mobile-friendly and optimized for all devices. 6. Ease of Maintenance: Ensure the WordPress backend is user-friendly for future content updates. 7. Hosting: Host the new website on CrazyDomain, ensuring compatibility with the latest WordPress and MySQL...
Hi Motiur, I'd like to scrape a number of entries off of a webpage list of 232 different law firms. Most I'd like are shown on the primary page. If possible, I would also like to pull the description of the firm on the profile page linked to the primary page (I've called this the "clickthrough description" in the excel template). Do you think you can get all this information for the firms? Best, Will
I'm making a Fortnite map using UEFN and in need of a custom code editor who use verse, specifically designed for the Unreal Engine Framework (UEFN). Key Features: The code editor should include robust syntax highlighting capabilities to assist in coding within UEFN. An efficient auto-completion feature is essential to enhance coding speed and efficiency. The code editor should have seamless version control integration for easy tracking of code changes. Ideal Skills: Extensive experience with UEFN is a must. Proficiency in creating code editors or similar software. Knowledge and experience in implementing syntax highlighting and auto-completion features. You should be comfortable working with UEFN and have a solid understanding of wha...
I'm seeking a developer to create a bot for data collection. This bot will need to interact with various websites and databases to gather different types of data. Key Requirements: - The bot should be able to collect text data, images, and numerical data. Ideal Skills and Experience: - Proficiency in bot development and programming. - Experience with web scraping and database interaction. - Knowledge of collecting and processing various data types: text, images, and numerical data.
I need a Java automation script that has been designed for data extraction. The script is not functioning properly at the moment and requires a skilled programmer to perfect its logic flow. Key Responsibilities: - Analyze the existing Java code - Improve and perfect the logic flow - Ensure the script runs properly and correctly Ideal Skills: - Proficient in Java programming - Experience with writing and debugging automation scripts - Knowledge of web scraping techniques - Strong problem-solving skills
...looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to ...
I need an expert in web scraping and MS Power Automate to help me set up a project. The site we will be working with requires scrolling and clicking to access data fields. - You will remotely connect to my Windows server via AnyDesk to do the work. - The site is not specified yet, but it requires interaction to retrieve data. - Your main tasks will involve setting up the scraping process and ensuring it runs smoothly. Ideal skills for this job include: - Proficiency in MS Power Automate - Extensive experience with web scraping - Familiarity with handling AJAX-loaded content - Ability to work remotely and troubleshoot in real-time. Please note, this project may involve working with various types of data fields, so flexibili...
I'm in need of a professional designer to create a minimalist logo for me. The design should be purely monochrome, without any colors. The logo should incorporate my initials/letters, and convey a sense of trust and reliability. Ideal Skills and Experience: - Proficiency in minimalist design - Experience in creating letter-based logos - Strong understanding of design principles - Ability to convey specific emotions/messages through design - Excellent communication skills to understand and incorporate client feedback
Connect to Rupeezy API for live data, buy/sell orders, and account details. Optional: Integrate ICICI Direct API for additional functionality. *1by4vdz*_gcl_au*MjEzNDUzOTMzMC4xNzI5Nzc0MjU4 Automate below Google Sheet. Development in Python, Node.js, or GoLang. Libraries: pandas, openpyxl, gspread, axios, etc. Timeline: Flexible but strict adherence to deadlines. Note: This is my second attempt after being scammed by a freelancer previously. If you are able to deliver this project, transparency and timely delivery are critical, with payments made based on milestones.
I'm in need of a skilled web scraper to update my contact directory. The task will involve scraping public directories for contact details. Key Requirements: - The websites to be scraped are primarily public directories. - The information that needs to be updated includes names and titles, phone numbers, and email addresses. This is a one-time update. Ideally, the freelancer should have experience in web scraping and data management. Proficiency in Python, BeautifulSoup, or similar web scraping tools is a plus.
I need a script that scrapes the site for PDF files, downloads them and saves them to my S3 bucket. The script only needs to run once, and there are no filtering criteria for the PDFs to be downloaded. Ideal skills and experience: - Proficient in Python or similar programming languages - Familiar with web scraping frameworks like Scrapy or BeautifulSoup - Knowledgeable in AWS S3 for file storage - Experience in working with PDF files
...developer to create an interactive and engaging chatbot for X. The primary purpose of this chatbot is to attract and gain users. Key Responsibilities: - Design and implement an AI chatbot on Twitter - Ensure the bot is engaging and user-friendly to promote user acquisition - Gather and provide a technical analysis summary of random of 3 AI bots in X (I will give you a list of bots). Elaboration: There are many AI bots in X which provide technical analysis on crypto coins. For our bot, if a user asks about a coin, we will in turn gather info from any 3 bots in the lists (there will be more and more) and provide the user with a summarized version. We will also give credit to the bots who provided the insights Ideal Skills and Expe...
I'm looking for a Python expert to scrape restaurant data from the first page of the Lieferando website. The data fields I need include: - Restaurant Name - Cuisine Type - Number - Address The scraped data should be saved in a CSV format. Please note, I only need the code file, not t...expert to scrape restaurant data from the first page of the Lieferando website. The data fields I need include: - Restaurant Name - Cuisine Type - Number - Address The scraped data should be saved in a CSV format. Please note, I only need the code file, not the data itself. Ideal Skills: - Proficient in Python - Experience with web scraping - Knowledge of data handling in Python - Familiar with saving data in CSV format Please ensure that the code is efficient and well-commen...
...trademark applications filed and updated that in our software. Now, we want you to develop scrapper: i. that can update data and documents of existing 6.75 million trademark stored on aws server, and ii. that can scrap all data and document of newly filed trademark application, which are not in our database. Watch for understanding. --------------------------------------------------------------------------------------------------------------------------- For your knowledge: 1. Our SaaS is hosted on EC2 server of AWS 2. Data is hosted on RDS server of AWS, 3. Documents are stored on S3 server of AWS, thus, you will need to update data to RDS server and documents to S3 server. 4. Our SaaS is built using Laravel PHP 5. The primary
...trademark applications filed and updated that in our software. Now, we want you to develop scrapper: i. that can update data and documents of existing 6.75 million trademark stored on aws server, and ii. that can scrap all data and document of newly filed trademark application, which are not in our database. Watch for understanding. --------------------------------------------------------------------------------------------------------------------------- For your knowledge: 1. Our SaaS is hosted on EC2 server of AWS 2. Data is hosted on RDS server of AWS, 3. Documents are stored on S3 server of AWS, thus, you will need to update data to RDS server and documents to S3 server. 4. Our SaaS is built using Laravel PHP 5. The primary
I am in need of a seasoned developer or technology expert with extensive experience in Telegram API integrations. The primary goal is to manage and filter high volumes of data from specific Telegram groups and implement scraping functionality for targeted user activity. Key requirements: - Advanced Telegram API expertise - Ability to filter and scrape data - Efficient in collecting real-time data - Able to scrape messages and posts - Reliable and communicates effectively Ideal candidates should have a proven track record working with Telegram API and can demonstrate their ability to handle large data volumes efficiently.
...adept web scraper capable of accurately and efficiently extracting URLs and images related to Google AdSense from a specific blog. Key Responsibilities: - Extracting URLs from the designated blog. - Gathering images associated with Google AdSense. - Ensuring all data is retrieved from all pages of the site. Challenges: - Currently facing difficulties in retrieving details specifically from Google AdSense. Skills Needed: - Proficient in web scraping technologies (e.g., Python, BeautifulSoup, Scrapy). - Understanding of Google AdSense protocols and restrictions. - Experience with data extraction and handling. - Familiarity with both static and dynamic web content. Data Format: - All extracted URLs and images ...
I'm looking for a professional data miner to scrape product information from several specific South African e-commerce sites. ...data from include: - - - - - Ideal candidates for this project should have: - Proven experience in web scraping, particularly from e-commerce sites. - Proficiency with data mining tools and software. - Ability to handle large datasets and deliver clean, structured data. - Understanding of product data fields (like price, description, availability, etc.) I need the product data to be gathered in a timely manner, and delivered in an accessible format. Please include examples of similar projects you've completed in your proposal.
I need a web scraping expert who can extract soccer odds statistics from various websites for my personal analysis. Key Requirements: - Scraping specific soccer odds and stats from the web - Implementing 'auto scraping' on specific buttons and menus for data comparison - Saving all scraped data in an Excel spreadsheet Ideal Skills: - Proficiency in web scraping tools and techniques - Experience with Excel and data analysis - Knowledge of soccer odds and statistics is a plus
I'm looking for a Data Scraper specialist who can extract specific information from an app for me. The data to be scraped includes: - Images - Product Information - Compatibility Details - Product Descriptions The final deliverable should be all this data neatly organized in a CSV file. Ideal skills and experience: - Proficiency in web scraping tools and techniques - Experience in data extraction from mobile apps - Ability to organize data into a specified format - Attention to detail for accurate data collection
... We are seeking an experienced web developer to fully redevelop our website with the following specifications: Core Requirements: Listings Features: Sales Properties: Display Sales Price, Net Operating Income (NOI), and CAP Rate (calculated as NOI ÷ Sales Price). Lease Properties: Include NNN, NN, or N status, monthly lease payment, and lease term (in years). Option to hide sensitive details if requested by the seller/landlord, displaying "Inquire" instead. Excluded Pages: Omit Business listings, the News, Books for Sale, and Directory pages from the new website. Keyword Matching Algorithms: Develop algorithms for matching users with properties based on specific keywords like location, property type, and investment criteria. Desi...
my company is called and I need classy designs for t-shirts
I'm looking for a Data Scraper specialist who can extract specific information from an app for me. The data to be scraped includes: - Images - Product Information - Compatibility Details - Product Descriptions The final deliverable should be all this data neatly organized in a CSV file. Ideal skills and experience: - Proficiency in web scraping tools and techniques - Experience in data extraction from mobile apps - Ability to organize data into a specified format - Attention to detail for accurate data collection
I'm looking for an expert in web scraping who can extract product data from two specific e-commerce sites. I need the data to be organized in a well-structured Excel file, categorizing the products into 'product family', 'sub family', and 'product'. Key Requirements: - Extracting the 'Product name' and 'Price' for each product. - Excluding product images; scraping should only focus on product name and price. - Delivering the data in a clear, organized manner in an Excel file. Ideal Skills and Experience: - Proven experience in web scraping, particularly with Shopify and WordPress. - Proficiency in Excel and data organization. - Attention to detail to ensure...
I'm looking for a talented professional with expertise in MERN and data scraping. This project involves building a website for my automation business, which primarily focuses on tax and email handling services. Key Responsibilities: - Developing a comprehensive website using MERN. - Implementing data scraping functionalities to support business operations. Ideal Skills: - Proficiency in MERN stack (MongoDB, , React.js, Node.js). - Extensive experience in data scraping. - Understanding of automation services, particularly in tax and email handling. The goal is to create a platform that can effectively manage and automate these services. Your expertise will be instrumental in building a robust and efficient website.
I'm seeking a Python expert to c... The task involves downloading documents from the former site and uploading them to the latter for the corresponding client. Key Requirements: - The script should allow for manual input of login credentials each session. - It should automatically detect and transfer PDFs and JPEGs. - The automation needs to be seamless and efficient to save time and reduce manual effort. Ideal Skills: - Proven proficiency in Python, particularly in writing automation scripts. - Familiarity with web scraping and browser automation tools like Selenium. - Competence in working with various file types (PDFs, JPEGs). Please note, the script should be capable of detecting and transferring documents a...
...problems that necessitate Python code execution. - Ensure tasks include generating, executing, and interpreting the results of Python code. - Adhere to guidelines which include: - Dependency on code execution for task completion. - Incorporation of dynamic problem-solving elements. - Providing clear reasoning and intermediate feedback during task iterations. Deliverables: - A set of Code Interpreter SFT tasks, complete with all necessary metadata and annotations. - Each task should consist of 4 turns: - User prompt. - Assistant acknowledgment. - Code generation. - Execution. - Output explanation. Example tasks should cover: - Data analysis - Automation scripts - Web scraping Ideal Skills and Experience: - Proficiency in Python...
I am looking for an experienced freelancer to build a custom AI chatbot that answers questions related to laws, policies, and regulations for specific countries (Arab countries). The chatbot must: 1) Support the Arabic language and provide accurate, context-aware responses. 2) Be trained on custom legal documents (PDFs, Word files, images, or web pages) that I will provide. 3) Provide responses with references to specific legal articles or clauses. 4) Be integrated into my website or WhatsApp for easy access. To reduce cost and time, the freelancer must: - Use ready-made models (e.g., OpenAI GPT, Claude, or open-source models like LLaMA 2) and avoid building models from scratch. - Use no-code or low-code platforms (e.g., CustomGPT, Botpress, or Rasa) f...
...experienced Python & Selenium Developer to join our team full-time. The ideal candidate will have a strong background in web scraping and web development, with proficiency in various Python libraries and frameworks such as BeautifulSoup, Requests, Scrapy, and Selenium WebDriver. Responsibilities: -- Build and maintain automated web scraping solutions using Python and Selenium. -- Scrape data from websites and efficiently process it. -- Develop and integrate databases with frontend applications. -- Work closely with the frontend team to ensure seamless integration and functionality. -- Collaborate in building and maintaining the business’s web...
I need help scraping an Australian government website with public information on 100,000 individual addresses. The goal is to create a comprehensive spreadsheet containing the following details: - Property details: strata plan number, address, strata manager, number of lots - Owner details The ideal freelancer for this project should be proficient in web scraping, ideally with experience working with large datasets. They should also be able to deliver the data in a clean, well-organized spreadsheet.
I've set up Kannel, SMSbox, and MySQL on my Ubuntu server and can send SMS without issues. I need assistance with permanently storing both delivery confirmations and failure notices from my SMS DLR reports into the MySQL database. Requirements: - I need the following specific data fields to be stored: Timestamp, Message ID, Recipient number, header, SMS content, and Delivery Status. - The selected freelancer should be able to handle both inserting new records and updating existing ones. Ideal Skills and Experience: - Extensive experience with Kannel and SMSbox. - Strong proficiency in MySQL database management. - Prior work with SMS DLR report processing is a plus. - Ability to write efficient and reliable scripts for data han...
I need a freelancer who can help me scrape a certain platform for the times and dates of bookable activities. wite python code to extract available dates and times for a link supplied an example link of booking dates and times available ,1 Ideal Skills: - Web scraping - Data management - Python/R programming (or similar) Experience with scraping mobile apps will be a plus.
...front-end Android application designed (MVP) for scheduled web scraping and data downloading. The app will be retrieving mixed data, encompassing both text and images. Key Requirements: - The app should be able to download data and perform web scraping at scheduled intervals. - Strong integration with a custom backend API is necessary. - The app should store data both locally and in the cloud. - Excellent user management features are a must. - Hosting support Ideal Skills: - Extensive experience in Android mobile app development. - Proficient in developing apps that interact with REST APIs. - Understanding of data storage, scheduling, and user management. - Previous experience with apps focused on data downloading and...
Project Title: Data Export & Shopify Product Import with Tags and Filters Setup Project Description: I need assistance migrating product data from my existing website hosted on City Hive () to Shopify. City Hive does not have a direct export function, so I need someone to scrape product data and prepare it for import into Shopify, ensuring all relevant details are included. Key Project Requirements: 1. Data Extraction: • Scrape or extract product data from the website (including product titles, descriptions, pricing, images, tags, and options/variants). • Example product page: Legend Vineyard Exclusives LVE Cabernet Sauvignon. • Ensure that product categories (e.g., Wine, Spirits), brands (e.g., John Legend), and relevant filters (e.g....
...with all trading pairs available. 2. Arbitrage Features: • The bot must use both own funds and flash loans from AAVE to maximize arbitrage opportunities. • A minimum of 1,000,000 arbitrage opportunities per day should be identified and exploited. 3. Smart Contracts: • All necessary smart contracts for the bot’s operation must be developed and deployed as part of this project. 4. Data Integration: • The bot will be integrated with our analytics platform: • Use our RPC node for blockchain data access. Details and access will be provided once the project is awarded. 5. Performance: • The bot must execute trades efficiently, considering network fees and slippage. • It should optimize for maximum profit a...
I'm looking for an experienced Python developer who can create an automation script for me. The script will primarily be used for data scraping from various sources including websites, APIs, and databases. Key requirements: - Proficiency in Python, with a strong emphasis on automation and data scraping - Experience in web scraping, API interaction, and database querying - Ability to write clean, efficient, and well-documented code Please do not hesitate to reach out if you have the necessary skills and experience.
I'm seeking an expert in web scraping to extract property listings from The data should include the address and location, amenities and features, as well as the price and availability of the properties. Key Requirements: - Proficient in data scraping without using Selenium, but can leverage - Ability to format the extracted data into JSON and print it in the console Ideal Skills: - Web scraping - JSON formatting The project involves: - Scraping property listings from the website - Extracting specific details from the listings - Printing the data in a specified format in the console Please note, all data should be printed in JSON format, as specified.
I need a professional WordPress developer...professional WordPress developer to customize the WordPress Automatic Plugin for my theme. Requirements: - The main functionality to be customized is content scraping and auto-posting from various blogs. - The plugin should be tailored to scrape content specifically from blogs, enhancing the quality and relevance of the content being posted on my site. Skills and experience needed: - Proficiency in WordPress and PHP. - Experience customizing WordPress plugins, particularly the WordPress Automatic Plugin. - Familiarity with content scraping and auto-posting functionalities. - Understanding of blog structures for effective content scraping. The plugin I want to customize from ThemeForce
