Web scraping using selenium and beautifulsoup일자리
I'm in need of a skilled data scraper who can extract email addresses from public directory pages. The data should be compiled and delivered to me in an Excel file. Key Requirements: - Proven experience with data scraping, specifically from public directory pages - Proficiency in Excel for data compilation - Respect for privacy and legal boundaries in data collection Ideal Skills: - Data mining - Web scraping - Excel expertise
I'm looking for a skilled data scraper to gather information on various businesses in the aesthetics industry, specifically clinics and aesthetics training academies. The data should include names, business names, email addresses, and phone numbers. Key Sources: - Websites - Google - Social Media (Facebook, Instagram, LinkedIn) - Business Directories The ideal candidate should have: - Proven experience in web scraping - Familiarity with the aesthetics industry - Ability to deliver accurate and up-to-date data
I have several franchise websites containing multiple office locations. I need someone skilled in web data extraction to gather specific information, including location, contact name/owner, email, and phone numbers. Key Requirements: - Data Collection: The data needs to be meticulously gathered from 1-5 websites. - Data Presentation: The collected data should be compiled and presented in a clear, organized manner in a CSV file. Ideal Skills: - Proficiency in data scraping techniques and tools. - Attention to detail to ensure all data is accurately collected. - Ability to present data in a clean and understandable format.
I need a WordPress plugin, specifically the Ultimate Web Novel and Manga Scraper, modified to work with a manga and comics themed website. The plugin needs to retain its current functions of scraping manga content and category management, while also being able to work with over 10 different websites, most of which use the same structure. Key Requirements: - Modify the existing plugin to scrape content from multiple sites. - Retain current capabilities: scraping manga content and category management. - Possible future need for multi-language support. - Experience with web scraping and WordPress plugin modification. - Familiarity with manga and comics websites is a plus. Budget: $50-80.
I'm seeking an expert in web scraping to extract crucial data from an E-Commerce website. The data to be scraped includes product details, customer reviews, and pricing information. Specific Product Details to be Scraped: - Product names and descriptions - Product images Deliverables: The scraped data should be delivered in a neat and structured JSON file. Ideal Candidate: The ideal freelancer for this project should have a strong background in data scraping, particularly from e-commerce platforms. Proficiency in handling and delivering data in JSON format is a must. Experience with web scraping tools and software is highly desirable.
I need someone to generate around 500 articles for me using ChatGPT or any Artificial Intelligence My budget is CAD$200 for the 500 articles Each article must be around 500 words Start: asap Deadline: not fixed, but the sooner the better
I'm seeking a professional proficient in Stata for thorough data analysis of NIS data. Key Tasks: - Conduct descriptive statistics and regression analyses on the NIS data. Ideal Skills: - Proficient in Stata - Strong background in data analysis - Experience with NIS data preferred - Excellent understanding of descriptive statistics and regression analysis
...solution for capturing and storing highresolution slide images for offline access and analysis. Project Requirements The script should perform the following tasks: Analyze Site Structure: Understand how the website renders zoomable slides and identify the location of image tiles at different zoom levels. Download Slide Tiles: Programmatically access and download the required tiles, accommodating various zoom levels as needed. Stitch Tiles into a Complete Image: Merge downloaded tiles into a single highresolution image using libraries like OpenCV, PIL, or other suitable Python tools. Save and Organize: Store the final stitched images in a structured and organized format. Ideal Candidate We seek a freelancer with expertise in w...
Build Test Management Web app using React
I am looking for a web scraper that can efficiently scrape data and export it in CSV format. Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Experience in exporting data to CSV - Can work independently with minimal guidance - Detail-oriented to ensure data accuracy
More details: Is this project for business or personal use? For an existing business What information should successful freelancers include in their application? Detailed project proposals How soon do you need your project completed? ASAP Please refer to attached file for more details. Please contact us should you have any queries. Also accepting proposals for VLAN solution.
I am seeking a biostatistician with expertise in inferential statistical analysis, specifically using ANOVA. The primary focus of this project is the analysis of survey data. Ideal Skills and Experience: - Proficiency in inferential statistical methods - Experience in analyzing survey data - Expertise in conducting and interpreting ANOVA tests - Strong background in biostatistics - Excellent data visualization skills
I'm in need of an experienced tool designer who can create a welding jig using Onshape or Solidworks. This jig will be primarily used in a fabrication shop and needs to be designed to handle steel. Key Requirements: - Proficiency in Onshape or Solidworks - Prior experience in designing welding Jigs - Understanding of welding jigs and their application in a fabrication shop Skills in CAD software and a solid background in tool design will be extremely beneficial. Looking forward to your expertise in bringing this project to life. We will provide you with STEP files When you quote, please include images of some jigs you have already designed
I need a cinematic trailer using AI Images and videos created for 2 screenplays. The Christmas Tree and Perfect Matchmaker. Need these trailers completed by mid-November. I agree to pay $1,500 per video for a total of $3,000 USD.
I'm looking for a solution that monitors a specific website and sends me an email notification every time there is a change in the text content of that site. Key Requirements: - Real-time monitoring of a designated website for text changes. - Immediate email alerts upon detection of text alterations. Ideal Skills: - Proficient in web scraping and monitoring tools. - Experienced in setting up automated email alerts. - Understanding of text change detection algorithms.
I'm in need of a Python-based script that will monitor StubHub and automatically purchase a specified number of tickets for me when they are listed at the right price and section. Key Features: - The script should allow me to specify event details through an interface. - It should be able to monitor for specific criteria: price and section. Example Use Case: - I want to automatically buy a pair of floor tickets for Phish on October 25 if they are priced at $150. Ideal Skills: - Proficiency in Python - Experience with web scraping and automation - Ability to develop user-friendly web interfaces Please note, the script won't need to monitor seat locations, just the price and the section.
I'm seeking an expert in TensorFlow and object detection for developing a high-accuracy image recognition system. The main aim of this project is product identification in retail settings. Key Requirements: - Develop an image recognition system capable of identifying various retail goods. - Achieve a product identification accuracy exceeding 95%. Ideal Skills: - Proficient in TensorFlow and object detection. - Previous experience in developing image recognition systems for retail. - Strong understanding of machine learning and computer vision concepts.
Hello! I want to build any recommendation model fo...one, so when I enter a prompt I got a response. For that I want to use two different ways. One is finetuning a large language model like LLAMA 3 or FLAN T5 with the dataset. The second is using RAG and FAISS function to retrieve the answer from the database with the use of victor database for bothe the prompt and the response. Finally, I will compare the responses that comes from a RAG code and the finetuning code. I found online some codes like this one in this tuturial ( ), but it didn’t work when I try it with other dataset. It’s a project for a class, and I want to be done with it as soon as possible because I already wasted almost a month trying but unfortunately I couldn’t...
I need a web scraper to extract product details (name, price, description) from a Shopify store. The scraped data should be delivered in a CSV file. This project also requires scraping images, so the ideal candidate should have experience with image scraping and can handle data-heavy tasks. Key Requirements: - Expertise in web scraping, particularly from Shopify stores - Proficient in Python or similar programming language - Familiarity with handling and delivering data in CSV format - Previous experience with image scraping Please provide examples of similar projects you've successfully completed.
I'm looking for a skilled data analyst to help with my longitudinal health data analysis. Ideal skills and experience include: - Proficiency in using Stata for data analysis - Extensive experience with health data - detecting differences at specific timepoints beside general trends
I am looking for an experienced freelancer to help extract data from Microsoft AppSource Partner Directory. The goal is to gather detailed information on Microsoft partner companies listed on the site. The extracted data will be used for analysis and reporting purposes. This project requires someone who has expertise in web scraping, preferably with experience using Python libraries like BeautifulSoup, Selenium, or other scraping tools. It should be strictly within budget The extracted data must be accurate, organized, and well-structured. Data to be Extracted: The freelancer will be responsible for extracting the following information for each partner company: Company Name: The name of the partner company. City: The city where the ...
...location, and contact details - All courses offered by each university including details such as course name, duration, admission requirement, tution fee, etc., - Available scholarships by each university including details such as scholarship name, eligibility, scholarship amount, etc.,) The scraped data must be delivered in a provided Excel template, alongside the Python code used for the scraping. The code should be compatible with Google Colab or Github. Responsibilities: - Use official website of universities and develop web scraping scripts to collect information about universities and all the courses and scholarships they offer and other relevant data as per the information required in the provided excel template. - Extra...
I'm seeking a Python developer with expertise in machine learning, particularly with convolutional neural networks (CNN), to create a code that can compare two high-resolution images of car parts. Key Requirements: - Develop a Python code that can compare two uploaded images and determine if the car parts are identical, with an accuracy rate exceeding 90%. - Experience with CNNs is crucial. Please note, I have not yet provided pre-labeled datasets for training the model. The freelancer may need to assist with this task.
I'm in urgent need of an expert freelancer who can scrape product data from a specified website and upload it to our Shopify store. Handling this task with precision and efficiency is paramount. Key Requirements: - Extensive experience with web scraping tools and techniques - Strong knowledge of Shopify's platform - High attention to detail - Ability to work promptly and per exact instructions Please note that the specifics of the product data to be scraped, the website in question, and any potential data modification requirements will be provided upon selection. Given the nature of this task, a proven track record in similar projects will be highly regarded. I look forward to your proposals.
...solution that can scrape odds from various Australian bookmakers including Sportsbet, Ladbrokes, Unibet, Tabtouch, Pointsbet, and TAB. The software should also scrape or utilize the Betfair API to get corresponding odds. It should perform specific calculations and display the results in an appealing and easy-to-understand format. Key requirements: - Web scraping from multiple Australian bookmakers. - Fetching odds from Betfair via scraping or API. - Performing calculations based on the scraped data. - Presenting the data in a user-friendly manner. Ideal skills for this project include: - Proficiency in web scraping and API integration. - Experience with data analysis and manipulation. - Ability to create visually a...
I am looking for an experienced web scraper to extract daily product details (name, price, description) from Amazon's search result pages, as well as corresponding seller information. The data needs to be delivered in Excel format. Ideal Skills: - Proficient in web scraping tools and languages (Python, Beautiful Soup, Scrapy, etc.) - Familiar with Amazon's website structure - Excel data manipulation skills Please provide examples of previous similar projects you have completed.
I am looking to hire somebody to obtain historical football data from websites. This is not a simple web scraping job as it requires understanding how widgets embedded on websites query a central database. Requirements: - Knowledge of javascript and interacting with APIs is likely be helpful. - Knowledge of website backends, in particular widgets.
I'm in need of someone to gather text data from two specific websites for research purposes. The collected data will need to be formatted into a CSV file. Ideal Skills: - Proficient in web scraping techniques - Familiar with data collection and processing - Excellent attention to detail - Prior experience in research data collection Please, provide your previous work samples related to data collection.
I'm looking for a developer to create a script for me. This script will scrape posts from a specific Telegram channel and repost them to my channel, replacing the links with my affiliate link. Key Requirements: - The content primarily consists of images, text and link. - Link in the post should get replaced with my link - The script should check for new posts every hour Ideal Skills: - Proficiency in Python or a similar programming language - Experience with Telegram's API - Familiarity with web scraping techniques - Understanding of affiliate marketing and link management Please note, the main content of the channel is images. Therefore, experience handling image-based content would be an advantage.
I'm looking for a freelancer who can create a Google Apps Script that will help me track down LinkedIn Company URLs based on a company's domain, and subsequently, find LinkedIn Profile URLs of decision-makers from these companies. Key Features: - The script should operate within Google Sheets. - It should automatically fetch the LinkedIn Company URL by using the company's domain. - It should pinpoint the LinkedIn Profile URL of a decision-maker based on the found LinkedIn Company URL. - The script needs to run automatically. Ideal Skills: - Proficiency in Google Apps Script is a must. - Prior experience with LinkedIn data scraping is a plus. - Strong understanding of how to build scripts on Google Sheets. I haven't specified particular decision-m...
I need a skilled Python developer to help me modify an existing Web Scraping script. Key tasks include: - Removing specific functionality from the script. - Adding automation to ensure the script only runs on weekdays, between 7 am to 5:30 pm. Script is simple and uses BeautifulSoup.
I'm in need of a talented software developer and web scraper to create a price comparison tool that will work as a Google Chrome extension. This tool should scrape data from multiple ecommerce websites and compare prices. Key Features: - Price Drop Alerts: The extension should notify users when prices drop on products they’ve viewed. - One-Click Price Check: Users should be able to compare prices with a single click on any product page. - Ratings: The tool should display trust scores and user reviews of retailers for reliability. The ideal candidate will have: - experience in web scraping and data extraction. - track record in Chrome extension development. - Ability to design a user-friendly interface. - Keen eye for detail a...
I am in need of a skilled Data Engineer or Data Analyst who can assist with the gathering and organizing of raw data from the web. The data will be used primarily for training machine learning models. Key Responsibilities: - Conduct web scraping to collect both text and image data - Clean and categorize the collected data Ideal Skills and Experience: - Proficient in data collection and web scraping techniques - Experienced in data cleaning and categorization - Familiar with preparing data for machine learning models - Knowledgeable in handling both text and image data
I need a skilled freelancer to help me extract all email addresses from all the URLs on a corporate website. The emails do not need to be categorized or labeled in any way. Ideal skills and experience for this job include: - Proficiency in data extraction and web scraping - Familiarity with corporate websites - Attention to detail to ensure all emails are captured - Ability to handle and process large amounts of data
I am looking for a dedicated developer to assist me with various tech-related tasks and projects. I offer a work-from-home role. It involves working with a range of technologies, so a strong background in Python, NodeJS, NextJS, and general Python/node libraries is essential. Ideal skills and experience for the job include: - 2 Years of Experience with NextJS - 3 Years of Experience with Python Django - Devops, API integrations, Github workflows, Docker, and Linux administration - Managing databases such as MongoDB, PineCone, Supabase and Postgres - Python scripting and automation tasks, Web Scraping technologies like requests, bs4, hidden json api's, cookie-based scraping, browser automation, concurrent futures, asyncio ...
I'm looking for a cost-effective, energy-efficient device (like a Raspberry Pi) for running a simple data scraping script via WiFi. I already have a Linux script that you'll need to modify to work with the chosen device. The data will be fetched from an API URL I will provide, and the script will send updates via Telegram. Key Requirements: - The script needs to run reliably every weekday between 7 AM and 5 PM. - I don't need a display, just the data being sent to Telegram. Ideal Skills: - Experience with data scraping. - Proficiency in Python or similar programming languages. - Prior experience with Raspberry Pi or Arduino. - Knowledge of setting up devices for automation tasks. Please also suggest an appropriate device if you have one in min...
I'm looking for a professional who can help me create a single brand e-commerce store and web scrape another e-commerce site that has volume price variants. The primary goal is to gather competitive pricing information and variations, which will be crucial for setting our store's pricing strategy. Ideal Skills and Experience: - E-commerce website development (preferably on platforms like Shopify, WooCommerce, or Magento) - Web scraping - Understanding of volume pricing strategies - Experience with Single Brand Stores - Knowledge of competitive analysis in the e-commerce space Please note that the primary focus is on data gathering through web scraping and the subsequent development of a competitive single brand stor...
...involves managing multiple sites built with an atomic design framework using **React**, **Vite**, **Vitest**, **Storybook**, and **ESM**. You will collaborate with a cross-functional team, including backend, frontend, and DevOps members, on an application designed for users and companies to create and manage their product portfolios, which can either be reviewed or sold in a marketplace format. ## Responsibilities - Collaborate closely with the frontend, backend, and DevOps teams to integrate and enhance the existing frontend framework. - Implement features that support multiple authentication methods, such as **Google**, **Instagram**, **Facebook**, and other providers. - Develop tools for users and companies to crea...
I'm looking for a Selenium / Python script that can pull relevant HTML markup for specific fields across a long list of websites. The data fields of interest include the HTML Markup needed to identify Interactables like Buttons to be clicked on, but NOT the underlying actual data. Just need to identify the Interactables from the HTML Markup, so Selenium can click upon them. You can identify their Html Markup using XPath or CSS Selector, etc. Need Knowledge of both Xpath and Selenium to do this. You may introduce a timer of 1-2 minutes as you complete each scrape. Key Requirements: - Ability to scrape data from a long list of websites without human intervention - HTML Markup to Identify the Interactables Like and Especially Buttons on the Page...
I need someone to generate around 500 articles for me using ChatGPT or any Artificial Intelligence My budget is CAD$200 for the 500 articles Each article must be around 500 words Start: asap Deadline: not fixed, but the sooner the better
I HAVE A PYTHON SCRITP THAT I M USING TO SCRAPE DATA FROM A WEBISTE. FOR SOME REASONS ONE OF THE FIELDS (INVENTORY) IT S NOT REALLY WORKING OUT. THE OUTUP OF THE SCRIPT IT S IN CSV IT S ABOUT SCRAPING DATA FROM A SHOPIFY WEBISTE (MY WEBSITE) I LL PROVIDE LOGIN AND PASSWORD THIS NEEDS TO BE DONE TODAY, IN FEW HOURS!!
I'm in need of a Selenium-based web chat bot. The primary purpose of this bot is to entertain users on my website through text-based conversations. Key Requirements: - The bot must be compatible with Website Chat. - It should handle only text-based conversations, so no need for media sharing or interactive games. Ideal Skills: - Proficient in Selenium and web development. - Strong background in creating engaging chat bots. - Excellent understanding of text-based interaction design. scraping a website's chatbox and integrating a chatbot that responds using the ChatGPT API,
Draw and provide us ONE .dwg drawing of a simple design (must be an original drawing and cannot be a copy of existing work). Drawing MUST be done using our CAD Software ONLY. We provide access to our CAD Software, available online, specifically for this task. Our CAD software is compatible with Autodesk AutoCAD and therefore Autodesk AutoCAD skills are required. Report us your usage experience while creating the drawing using our software.
I'm looking for an expert in data scraping for a project I call Crawlomatic. The primary focus of the project will be scraping product details and general web content from a variety of platforms. Key Responsibilities: - Scraping product details from various e-commerce sites. - Collecting web content from news websites and social media platforms. The ideal freelancer would have: - Extensive experience in data scraping, particularly from e-commerce sites and major social media platforms. - Ability to handle large volumes of data and ensure accuracy. - Knowledge of web content interpretation and extraction. If you have the necessary skills and experience, I look forward to discussing this proje...
I'm working on a Python project leveraging Selenium for browser automation. I need an experienced professional in Selenium to assist me with the project. Tasks include: - Automating the extraction/downloading of documents from a site. Ideal skills for this project: - Extensive experience with Python and Selenium. - Proficiency in browser automation techniques. - Ability to understand and execute complex automation tasks.
Need to fetch real time option chain data from NSE API using python, need real time data should be refresh in every 3 mints.
I need to migrate two small PL/SQL scripts from Oracle to Teradata using PowerCenter. Ideal candidates for this project should have: - Proficiency in PL/SQL and PowerCenter - Experience with Oracle and Teradata - Strong understanding of data migration and transformation Please note, I have not provided specific details about the scripts or their purpose. A successful candidate will be able to understand and adapt the scripts for the new environment.
...for a web scraping expert with proven experience in extracting contact details from social media platforms. The ideal freelancer should be proficient in Python and familiar with web scraping tools, particularly Requests. Key Responsibilities: - Extract various data points from social media profiles, including phone numbers, emails, profile URLs, descriptions, and LinkedIn URLs. - Deliver the extracted data in a structured format, either CSV or Excel, within the agreed timeframe. - Provide the code used for the scraping process. - Solve any blocking issues that may arise during the scraping process. Ideal Skills and Experience: - Extensive experience with web scraping, particularly from social media platforms....
Hello, could you please scrape data from a website and create an app to output data in Excel?
...Zonation of Flash Floods in Urban Areas Using SAR Data. Task: Develop risk maps for urban flash floods using Synthetic Aperture Radar (SAR) data. Region Focus: Urban areas of Mumbai prone to flash floods. Data Collection: Use SAR data to analyze impervious surfaces, drainage, and flood-prone zones in cities. -Objective: Assess urban vulnerability to flash floods through remote sensing data. -Methodology: - SAR data analysis for surface mapping. - Identify drainage inefficiencies and infrastructure weaknesses. - Topographical analysis to detect water flow and flood-prone areas. Deliverables: - Risk zonation maps highlighting high-risk flash flood zones. - A comprehensive report on urban flood vulnerability. - Recommendations for urban flood ...