Web scraping using selenium and beautifulsoup trabalhos

I'm seeking a professional to assist with scraping data from an online store and subsequently uploading this information onto a Shopify platform. Key Responsibilities: - Capture comprehensive product details including: - Product name - Product photo - Price - Description - Measurements - Publish the gathered data onto Shopify Ideal Skills and Experience: - Extensive experience with E-commerce platforms, particularly Shopify - Proficient in data scraping techniques - Attention to detail to ensure accurate data capture and posting - Prior experience in product uploading on Shopify is a plus.

I'm in need of a Python script designed for automating web scraping tasks aimed at uploading PDF and collecting data related in Excel CSV File. Key project components: - Utilize Beautiful Soup for scraping tasks. - Store all collected data in a Database. - Focus on collecting data about conversion speed and quality. Ideal candidates should have: - Proficient understanding of Python, particularly in relation to Beautiful Soup. - Experience in developing automation scripts for data collection. - Strong problem-solving skills to troubleshoot and refine the script as needed. Please bid if you can deliver a well-structured and efficient Python script for this task.

I'm in need of a proficient, reliable, and efficient Google Maps scraper. I have a list of specific addresses from which I want to gather data. The data to be collected includes: - Business names - Contact details - Full addresses - Phone numbers For example I want to search on gmaps - 1761 W HILLSBORO BLVD, DEERFIELD BEACH, FL, 33442, and scraper all business data at that location. The scraped data should be delivered in a CSV format. Ideal Skills: - Proficiency in web scraping tools and techniques - Experience with data collection from Google Maps - Ability to deliver data in CSV format Experience with handling large datasets is a plus. Please, only bid if you can strictly adhere to the requirements.

...seeking a developer skilled in API development and screen scraping. The task involves interfacing with a public API of a third-party address verification tool. Key Requirements: - Build an API that can process requests to this third-party tool. - Screen scrape the tool's responses concerning the availability of a given phone number and address. - Format the API responses in JSON. Responses from the tool will yield one of three results: Available | Not Available | Limited Availability. I would like to discuss: - The necessity of maintaining multiple servers for each screen-scraping request. - Your strategies for efficient screen scraping and API development. Ideal candidates will have: - Proven experience with API development and...

I'm in need of a robust Python-based web crawler that can efficiently scrape and aggregate data from multiple news sites. The crawler will need to extract various types of data including article content, author information, publication dates, tags, and cover thumbnails. Key Features: - Proxy Support: The crawler should be equipped with proxy support to bypass geographic and IP restrictions, ensuring uninterrupted access to these news sites. - Configurable: It should be configurable via environment variables, dynamically adjusting proxy usage and frequency to comply with site terms and avoid bans. - Resume Feature: The crawler should include a resume feature, allowing it to track and stop at the last crawled position, making subsequent...

I need a python script that fetches all the URLs from a news website every 5 minutes. The script should run on and post all the URLs to an API. Key Requirements: - The script should be able to ignore duplicate URLs - Ideally, the freelancer should have experience with web scraping and working with APIs. - The ability to write clean, efficient code is a must. Please note that the specific structure of the news website is currently unknown, as the client has not specified. Therefore, the script should be flexible enough to handle different types of content (static HTML pages, JavaScript-rendered content, API-based content).

...looking for an expert in data scraping to help me gather business contact information within the healthcare industry, specifically targeting doctors. Key Requirements: - Scraping of business contact information, primarily focused on healthcare providers, real estate dealers and home improvement providers in the UK - Generating lists suitable for cold email and SMS outreach - Experience in data scraping and list building - Verify the authenticity and reliability of data sources - Deliver scraped data in a specific, easy-to-use format (e.g., CSV, Excel) Ideal Skills: - Proficiency in data scraping tools and techniques - Ability to generate high-quality, targeted lists for outreach Please note, this project requires meticul...

Here are some samples of my past project.

...one website. The primary purpose of this project is to gather public information. Key Requirements: - Proficiency in data crawling techniques. - Experience with web scraping tools and software. - Ability to filter and organize data effectively. - Experience in handling CAPTCHA challenges during web scraping to ensure uninterrupted data collection. - Knowledge in managing proxies to avoid IP bans while crawling large amounts of data. - Experience in scheduling and automating scraping tasks for regular data updates. - Understanding of and compliance with legal standards and guidelines for data scraping. Ideal Skills: - Web Scraping - Data Analysis - Python or similar programming language - Attenti...

We are seeking a proficient developer with expertise in Excel and VBA/Macro development to create an automated system capable of fetching ISIN and SEDOL codes for investment funds directly within Excel. The system should handle partial fund names and manage variations due to different share classes, ensuring that all possible ISIN/SEDOL codes for each fund name are retrieved and populated in the spreadsheet. The goal is to automate the retrieval process to enhance our investment operations while eliminating the need for external platforms and maintenance fees.

I have a current project that is using the M

...information that will form Titles, Headings, Subheadings, and Tables. - Directly uploading the extracted data to a database. Ideal Skills and Experience: - Proficient in data mining and web scraping. - Familiar with database management systems. - Able to identify and extract relevant information effectively. Database: - Each example of website has different formats, but need to mine same information. - I will supply database information, tables, rows, etc. Needs to be automated without human interaction to try to mine every weekday after noon until data has been mined. If no information is available, then it mas input information into database that no inforamation was published. I need a professional who can undertake this task efficiently...

...information that will form Titles, Headings, Subheadings, and Tables. - Directly uploading the extracted data to a database. Ideal Skills and Experience: - Proficient in data mining and web scraping. - Familiar with database management systems. - Able to identify and extract relevant information effectively. Database: - Each example of website has different formats, but need to mine same information. - I will supply database information, tables, rows, etc. Needs to be automated without human interaction to try to mine every weekday after noon until data has been mined. If no information is available, then it mas input information into database that no inforamation was published. I need a professional who can undertake this task efficiently...

Images data scraping project from google to csv file

I am seeking a machine learning expert to develop an application for analyzing MRI scans in the healthcare sector. The primary function...this application will be to assist in medical image analysis. Key Requirements: - Proficiency in machine learning, particularly in developing applications for medical purposes. - Experience in analyzing MRI scans using machine learning techniques. - Ability to create predictive models based on the analysis. The ideal candidate for this project should not only have technical skills but also an understanding of healthcare needs. Previous experience in the healthcare industry will be an added advantage. Healthcare applications. Tell us what you have worked with. PhD graduates and PhD students preferred. Don't bid if you are from P...

I'm looking for a dedicated Web Developer with expertise in , Postgres, NestJS, and Mongo, for a long-term project. The ideal candidate would be a strong team player, with an understanding of web scraping and DevOps, although the latter isn't mandatory. Key Requirements: - Proficiency with - Experience with both relational and NoSQL databases - Strong web development skills - Understanding of web scraping - Knowledge of DevOps practices (preferred but not required) I value collaboration and communication, and I'm looking for someone who is interested in a really long-term relationship. Please only apply if you are committed to working with me for the long haul.

...understanding of various machine learning and nature-based algorithms to help optimize some algorithms for a project. Key Responsibilities: - Implement and optimize a range of machine learning algorithms, specifically neural networks, decision trees, and support vector machines - Utilize the latest nature-based algorithms for optimization - Deliver high-quality, efficient code in Matlab Ideal Skills: - Proficient in Matlab with extensive experience in algorithm development - In-depth knowledge and practical experience with neural networks, decision trees, and support vector machines - Familiarity with the latest nature-based algorithms, particularly genetic algorithms, particle swarm optimization, and ant colony optimization - Strong problem-...

I'm looking for a professional data collector to extract contact information from TruePeopleSearch. The data should be delivered in a CSV file. This is a one-time project but if your approach is successful, I will continue to use your service. Ideal skills for this project include: - Proficiency in data collection and web scraping - Familiarity with TruePeopleSearch - Experience in data formatting for CSV files Please only apply if you can deliver high-quality work in a timely manner. Thank you!

I'm looking for a Python expert who can help me scrape government websites on a weekly basis for data collection and analysis. Ideal Skills: - Proficiency in Python, especially libraries like BeautifulSoup, Scrapy, or Selenium. - Experience in web scraping, with a focus on government websites. - Understanding of data analysis techniques. - Ability to set up and maintain a weekly scraping schedule. Please provide examples of your previous web scraping projects, particularly if they involved government websites.

...will take as input a page of data from any known format/layout and parse out specific information for use by downstream modules. The kind of data to be extracted is similar to RRP/RFI data (including project information, contact data, department information, etc.). Key Requirements: - Expertise in Python and data scraping - Experience with developing flexible, modular software - Ability to handle and parse diverse data formats - Familiarity with strict data validation processes - Familiarity with Python scraping modules such as Beautiful Soup or automation frameworks like Selenium. The data extracted will be part of a GenAI pipeline. As such, the data will need to undergo strict validation, including checks on format, data type, and co...

...developer with experience in Streamlit and QT5 to convert my existing QT5 data visualization app into a Streamlit app. The conversion should maintain the original app's menu and ensure high-quality results. Key Requirements: - Conversion of a QT5 data visualization app to Streamlit - Retention of the original app's menu - High-quality output Ideal Skills and Experience: - Strong programming skills in Python - Proficient in using Streamlit and QT5 - Previous experience with data visualization apps - Attention to detail for menu accuracy and output quality Ideal Skills and Experience: - Proficient in Python - Experience with a variety of Python projects - Familiarity with Django/Flask, Pandas/Numpy, and Scrapy/BeautifulS...

I'm looking for a talented web scraper expert who can create a MacOS application for me. This app should be capable of scraping content from an adult website. The specific content that needs to be scraped includes: - Videos - Thumbnails - Video names - Categories and probably some more info The format for the scraped data hasn't been decided yet, so your expertise in this area would be appreciated. It could be stored in a variety of formats such as CSV, JSON or XML. This project is for personal use, so the app needs to be user-friendly and efficient. Ideal skills and experience for the job include: - Proficiency in web scraping - Experience in MacOS app development - Knowledge of data storage formats - Understanding of user-f...

...comprehensive Excel spreadsheet listing daycare centres, childminding centres, and private kindergartens across Western Australia (WA). The information should be meticulously grouped by region, with the Perth metro region further divided into local government areas. Additionally, the other regions of WA such as Peel, Southwest, Great Southern, Wheatbelt, Goldfields/Esperance, Kimberley, Pilbara, Gascoyne, and Mid West should also be included. Specific Requirements: - For each centre, the list should include the name and contact information (comprising of phone numbers, email addresses, and physical addresses), as well as the operating hours. - It will be beneficial to also include details about the owner of the daycare centre and when it was establish...

My Python script is intended ...user reviews from review aggregation sites, but it's currently collecting incorrect data. Key Requirements: - Diagnose and correct the issues causing the data collection errors. - Ensure the script is accurately scraping and collecting user reviews. - Optimize the script for efficient and reliable performance. Ideal Skills: - Proficiency in Python and web scraping techniques. - Experience with review aggregation sites. - Problem-solving skills to troubleshoot and rectify issues. - Ability to optimize scripts for improved performance. - Experience with Beautiful Soup for parsing HTML and XML documents. - Proficiency in using Selenium for browser automation and scrap...

Hi Saurabh, I hope you're well. As I mentioned the other day, we have another similar yet smaller project for image scraping (500 images) This time I will provide you with a spreadsheet that indicates the product we need as an image and where to find it. We will request again a folder with the images with each named with its code. I hope you can work with us again :)

Looking for someone to design and implement a template into Lightspeed E-Series Ecom system, our website is already functional we just need a design created and implemented into the system to hold it within our brand and make it look more professional. Website is: More about Lightspeed E Series:

I'm in need of a web-based script that automates the process of checking real-time restaurant availability and making reservations. The script should be capable of: - Real-time availability checking: The script should continuously monitor the availability of tables at various restaurants. - Automated booking confirmation: Once a reservation is successfully made, the script should automatically confirm the booking. It's crucial that this script operates seamlessly without requiring any user interaction. Ideal skills and experience for this job include: - Proficiency in web programming languages (such as JavaScript, Python, etc.). - Experience with web automation tools and libraries (like Selenium, Beautiful Soup, etc.) - Knowledg...

I'm seeking a professional WordPress developer to create a portfolio website for me...to create a portfolio website for me. The primary goal of this site is to showcase my previous samples to potential clients and employers. Ideal Skills: - Proficiency in WordPress - Experience in building portfolio websites - Understanding of SEO principles - Good design sense for a clean, professional look - Ability to integrate social media links and contact forms I have not outlined any specific features for the site yet, but I am open to suggestions. A testimonials section could be useful if I have enough positive feedback to use, and I would certainly need a contact form for potential clients to reach me. Please share examples of similar work you've done and...

...that streams movies and TV shows from a specific website. The ideal candidate should have a strong understanding of streaming formats, performance optimization, and web scraping. Key Requirements: - Experience with tvOS development - Proficiency in streaming formats, particularly .mp4 - Skills in web scraping - Ability to create a smooth and fast search functionality This project is about creating a seamless viewing experience for users. The app should support the best streaming format for Apple TV, ensuring high quality and performance. The main functionality of the app will be to allow users to search for and stream movies and TV shows. Hence, the focus should be on creating a fast and efficient search fun...

Improve business process using Sharepoint, Power Apps, Power Automate and Power Bi I have already have implemented Power Automate process and now want to introduce additional functionality and reporting. Pls provide PDF examples of your previous work, relevant to the skills Sharepoint, Power Apps, Power Automate and Power Bi

...Social login and sign up (Via Google and Facebook) 2. Sign up via mobile number 3. Left Right Swipes 4. Profile matches through location basis (nearest to farthest), interests 5. In app messaging 6. Profile verification percentage (Email, Mobile Number, Live photo capture along with identity proof, Profile Picture) 7. Premium plan. 8. Live streaming facility 9.. Push notifications 10. In app purchase of premium plans and unlocking limits of feature usage. 11. Government identity verification 12. Auto caption generation in live stream 13. Seperate referral links along with invite code. 14. Admin dashboard 15. Seperate Moderator rights in dashboard 16. App submission on playstore and App Store 17. Source code 18. AI Mechanism that can identify the abusive wor...

...art pieces and auction results. - The script should specifically collect the artist's name and title, along with all details available, as well as images of the art pieces. - The output should be a CSV file containing the requested data (along with some custom columns calculated from data collected), and folders with images included. - The script will be launched in a Mac environment (macOS 15) > Detailed requirements (what data to be stored and the format) will be provided to the selected developer. > The script will be tested on past auctions and validated based on the output. > Looking for a clean commented Python script, for self-debugging in the future (should the auction website change). Ideal Skills and Experience: - Prof...

I'm looking for a skilled Python developer to create a Telegram bot that collects and saves relevant information from Wallapop ads. The bot should capture photos, descriptions, titles, prices, and weights when I send it a link to an ad. Key Requirements: - Proficient in Python - Experience with Telegram bot development - Knowledge of web scraping techniques - Understanding of local data storage - Ability to format data appropriately for storage - Experience with Telegram Bot API or a suitable Python framework like python-telegram-bot. The data collected should be stored on my local machine. The ideal candidate will be able to ensure the data is stored in a clear, accessible way.

I'm looking for a Telegram bot that can track prices for Amazon and Flipkart products. This bot should send me alerts when prices increase or decrease. The bot needs to check for price updates every 5 to 10 minutes. Ideal skills and experience for the job: - Proficiency in developing Telegram bots - Experience with web scraping, specifically on eCommerce platforms - Knowledge in setting up price tracking algorithms - Ability to create a user-friendly interface within Telegram - Experience with Python or similar programming languages

I'm needing an experienced professional who can assist with automating tests for an bank product. Key Requirements: - Develop automated test scripts for product. - Ensure these scripts are compatible specifically with browser. ...bank product. Key Requirements: - Develop automated test scripts for product. - Ensure these scripts are compatible specifically with browser. Ideal skillset for this project includes: - Proficiency in Behaviour Driven Development (BDD) - Extensive experience with C#, PowerShell and jenkins - Solid understanding of C# PowerShell and jenkins, SVN. Improve existing framework plus need to run parallel execution Capability to timely deliver high-quality scripts is paramount for this project. Flexibility and consistent communicatio...

I'm looking for a Junior Level Android Developer based in Pakistan or India. It is simple work of coding. I need a person who may work for long term in android apps I need work at low budget but for long term

as discussed

I'm looking for an experienced developer who can convert my Chrome extension into a .dll file with a custom self-browser. The primary purpose of this task is to add specifi...file with a custom self-browser. The primary purpose of this task is to add specific custom functionalities to the extension. Key requirements: - The self-browser should be able to perform a series of automated tasks. - These tasks include data scraping, form submission, and routine web navigation. Ideal skills for the job include: - Proficiency in C# or any language compatible with .dll files - Experience in developing custom browsers - Understanding of Chrome extension architecture - Familiarity with automated tasks such as data scraping and form submission. Please provide...

I'm doing website development using somehow i want to speed up the project, the based code is already there, so you need to code with my code structure and integrate with the backend service that I provide there are 3 page you need to develop: 1. merchant page -> to list & register merchant 2. patch page -> to upload file and send to the backend 3. transaction page -> show transaction history & show the detail of each trx as a bills document my design is already on figma, so you need to follow that

I'm looking for a Junior Level Android Developer based in Pakistan or India. It is simple work of coding. I need a person who may work for long term in android apps I need work at low budget but for long term

...information that will form Titles, Headings, Subheadings, and Tables. - Directly uploading the extracted data to a database. Ideal Skills and Experience: - Proficient in data mining and web scraping. - Familiar with database management systems. - Able to identify and extract relevant information effectively. Database: - Each example of website has different formats, but need to mine same information. - I will supply database information, tables, rows, etc. Needs to be automated without human interaction to try to mine every weekday after noon until data has been mined. If no information is available, then it mas input information into database that no inforamation was published. I need a professional who can undertake this task efficiently...

I am looking for a professional with expertise in web scraping, specifically for extracting email addresses from various websites. Key Requirements: - Proficient in web scraping tools and techniques. - Ability to identify relevant websites for email extraction. - Prior experience in email scraping is preferred. Check the CSV File for examples

I need a freelancer write me a script to scrape text datas from HTML documents. This data will be stored in a CSV format in a database. There are upto 5 similar structures/format. Instruction Document, Sample of HMT...This data will be stored in a CSV format in a database. There are upto 5 similar structures/format. Instruction Document, Sample of HMTL Documents & Sample of CSV files in drive below for your review. Let me know Ideal skills and experience: - Proficiency in data scraping techniques and tools - Experience with HTML document parsing - Knowledge of CSV formatting and database storage - Attention to detail for accurate data extraction Please use JavaScript with Node.js for the data scraping tasks.

I'm seeking a skilled data scraping expert to extract information about exhibitors from the MCShow website. Please collect data from all exhibitors in the database and from each of the links to the exhibitors' own entries. The information should be presented in a spreadsheet with the following columns: - Exhibitor Name - Full Exhibitor Intro Text - Product Category - Exhibitor Website - Exhibitor Facebook - Exhibitor Instagram - Exhibitor Twitter The ideal freelancer for this project should have: - Proficiency in web scraping tools and techniques - Experience with data organization and spreadsheet management - Attention to detail to ensure all data is accurately captured Please note that for the "Exhibitor Intro Text", I re...

I'm looking for a freelancer who can help me with scraping social media posts from three shopping centres for their latest posts on Facebook, Instagram and TikTok. Key Details: - Each day, you will need to gather the x9 most recent posts from each platform for the three shopping centres. - The information to be captured includes the post content, images, and engagement metrics (likes, comments, shares). - You'll need to compile this information into a Google Docs document in a table format, which will then be saved on a shared Google Drive. - Experience in data scraping and familiarity with social media platforms is essential for this project. Please note that the ideal candidate should have a keen eye for detail and the ability to wor...

Ideal Skills and Experience: - Proficiency in Python, particularly with the Selenium library - Experience with Facebook automation - Familiarity with Google Chrome and its driver - Strong debugging skills and able to resolve issues promptly - Knowledge of web scraping techniques I need a freelancer who can diagnose and fix the issue with the bot, ensuring it operates smoothly again.

...retail sector. The project will involve using multiple regression and machine learning models, with a focus on linear regression, to predict demand. The ideal candidate would have: - Experience in demand forecasting, preferably in the retail sector - Proficiency in multiple regression and machine learning models, particularly linear regression - Ability to analyze and interpret historical sales data, market trends data, and customer demographics data The project will primarily involve: - Utilizing historical sales data, market trends data, and customer demographics data for demand forecasting - Employing multiple regression and machine learning models, focusing on linear regression, to predict demand I'm looking for someone who ca...

I'm seeking a professional web scraper to collect text and price data from a specific website. The purpose of this data collection is for analytics. This will be a one-time project with no ongoing requirements. Ideal skills for this job include: - Proficiency in web scraping tools and software - Strong analytical skills - Attention to detail

I'm looking for a skilled data scraper who can find and collect email addresses of undergraduate students in the US. Key Tasks: - Identify and scrape email addresses from a variety of sources such as university directories, student forums, and social media. - Compile the collected data into an Excel spreadsheet, including the student names and their respective university names. Ideal Skills and Experience: - Proven experience in web scraping and data collection. - Familiarity with US college and university systems is a plus. - Proficiency in Excel and data organization. Please be ready to discuss your approach and any previous similar projects you've completed. The target is to collect 150,000 emai...

I have a list of about 350 companies Linkedin Page URL and i need the Linkedin profile page URL of employees in each company. No manual work. It's a straighforward tool based work. No other information needed except Linkedin profile page link. Budget $15