Web scraping projects jobs

Scraping of data from 2-3 websites as specified

I am looking for top notch blender artist experience or freshers both welcome .. Well knowledge in blender modeling texturing rigging animations fx rendering lighting..etc Share your work reels or links with proposal....

Features 1. File Upload and Storage • Automatic saving of email attachments. • File upload functionality available on the website. • Uploaded files are stored on the server, categorized by customers. 2. File Analysis • Extract data from saved files using OCR and GPT. • Extracted data is stored and categorized in the database by customers. 3. Data Editing (Grid-based) • Data Grid: • Display data in a spreadsheet-like format. • Includes filtering and search functionality. • Editable Cells: • Customer data and analysis results can be edited in real-time. • Edit Logs: • Automatically save all modification history. • Logs include data before and after modification, along with timestamps. 4. Excel/CSV Export • Download grid-ba...

I am in need of a seasoned developer or technology expert with extensive experience in Telegram API integrations. The primary goal is to manage and filter high volumes of data from specific Telegram groups and implement scraping functionality for targeted user activity. Key requirements: - Advanced Telegram API expertise - Ability to filter and scrape data - Efficient in collecting real-time data - Able to scrape messages and posts - Reliable and communicates effectively Ideal candidates should have a proven track record working with Telegram API and can demonstrate their ability to handle large data volumes efficiently.

I'm seeking a Business Development Executive to spearhead lead generation for my software web and mobile app development projects. Your main responsibilities would be: - Focusing on lead generation primarily - Targeting industries such as Manufacturing, Distribution, Finance, Commerce, Life Sciences, and Healthcare An ideal candidate would be skilled in: - Conducting email campaigns - Cold calling - Social media outreach Monday to Friday - Full time as a contractor - 7.30 am to 5.00 pm EST

I'm in need of a skilled Python developer proficient in web scraping. The task involves logging into two specific websites, conducting searches, navigating through links (up to 5), and scraping content from those pages. Key requirements: - Develop a Python module for web scraping - Implement error handling that sends feedback in response to function calls - Save all scraped data into a TXT file Before we commence, I will provide a detailed document outlining the specific pages and tasks. Ideal candidates would have a strong background in Python, web scraping, and data handling. Good to have multi tasking support by the function.

Budget $25 I'm looking for a Python expert who can write a script for me. The script will open a list of URLs from an Excel spreadsheet and check for specific content. Requirements: - The script needs to check for text on ...write a script for me. The script will open a list of URLs from an Excel spreadsheet and check for specific content. Requirements: - The script needs to check for text on the URLs. - If the content exists, it should create a new column in the spreadsheet with the status of each URL. Skills required: - Proficiency in Python programming. - Experience with working on Excel files. - Knowledge in web scraping techniques. - Ability to understand and implement URL content checking. Please only apply if you can demonstrate your ability to complete th...

I need an AI agent that can extract contact data from social media platforms, primarily Instagram, and manage my email marketing tasks. Key Requirements: - Data Extraction: ...able to extract 'Name' and 'Email' from Instagram, FaceBook, Ticktok, X, Youtube and compile this data into a CSV file. - Email Management: It should check for duplicate entries and manage email campaigns, sorting emails based on their status (with a focus on 'Opened'). It should have the ability to send emails in batches. Ideal Skills: - Proficiency in AI development - Experience with data scraping - Understanding of email marketing systems - Ability to create and manage CSV files I'm looking for a professional who can deliver a system that can help me streamline my...

Python Developer: Screenshot Cropping & OCR to Excel Description: Seeking a Python developer to automate data extraction from screenshots with two key tasks: Screenshot Cropping: Crop images to isolate data below column headers. Handle minor variations across screenshots. OCR & Excel Conversion: Use OCR (e.g., Tesseract) to extract t...Tesseract) to extract text from cropped areas. Save data to Excel in structured columns. Requirements: Proficient in Python (Pillow, OpenCV, pytesseract). Experience with OCR and Excel handling (openpyxl, pandas). Strong problem-solving skills and attention to detail. Deliverables: Scripts for cropping and OCR-to-Excel conversion, reusable and future-proof. Notes: Focused on screenshots only—no web scraping (e.g., Selenium)....

I'm experiencing a bug in my Python script that's meant to scrape an API for financial data. What I need from you is to troubleshoot and fix the script so that it can run smoothly again. Ideal skills for this job include: - Proficiency in Python - Experience with web scraping - Familiarity with financial data and APIs experience dealing with yahoo finance financial data will be beneficial.

I'm seeking a skilled developer to create a mobile-based system/tool that automates sports betting on a Bet APP. This system should run entirely on a mobile device (both Android and iOS) without the need for additional hardware. The tool's primary function ...betting exclusively. - Utilize official betting websites as the primary source for gathering betting odds. - Enable a high level of customization with the automated betting, allowing for personalized user inputs. Ideal Skills and Experience: - Proficiency in mobile app development for both Android and iOS. - Experience in developing automated betting systems or similar tools. - Familiarity with web scraping techniques. - Ability to create a user-friendly interface for personalized inputs. I will provide detai...

I'm in need of a skilled React developer to create a Chrome extension for me. This extension will be used to scrape product information from Aliexpress. Key Features: - The primary fu...of a skilled React developer to create a Chrome extension for me. This extension will be used to scrape product information from Aliexpress. Key Features: - The primary functionality of the extension will be product scraping. - The information should be updated in real-time. Ideal Skills and Experience: - Proficiency in React and Chrome extension development is a must. - Previous experience in creating product scrapers is highly desirable. - Knowledge of ecommerce platforms and their product data structures will be an advantage. Please provide examples of similar projects you have ...

I'm seeking a developer to create a bot that can book Spain visa appointments from the website: The website has vulnerabilities that many developers have exploited to create bots. I ne...selfie fails. - Automatically close BLS accounts as needed with a single click. - Be able to control the refresh rate of requests sent before and after accessing the calendar. Ideal Skills: - Extensive experience in Python, Java, and other programming languages. - Previous experience in creating web-scraping bots. - Familiarity with appointment booking systems. - Ability to exploit the website's vulnerabilities for an advantage. If the initial project is successful, I will provide three additional projects and will require paid updates whenever the website is updated.

Hello, We have a file with about 4500 rows containing data of Italian associations, music, art and similar. The file contains the tax ID, name, address. We need to retrieve the email address and phone number if present. We will provide a list of 20 names to allow us to verify the results you can provide

I am seeking a skilled Python developer to enhance my web scraping code. The primary focus is to improve the accuracy of the data being collected. The code currently scrapes textual data from various websites. Key Requirements: - Expertise in Python, specifically in web scraping libraries such as BeautifulSoup, Scrapy, or Selenium. - Proven track record of improving code accuracy. - Experience with web data extraction. Please provide examples of your previous work in your proposal.

...for each SKU. 3. Monitor availability for each SKU. Store all this information in Postgres DB and push to Airtable or - Phase 1 - Budget 150 USD Enrich and push data to Shopify store(s) - Phase 2 - Budget 150 USD The attachment has details about each phase with CLEAR INSTRUCTIONS & REQUIREMENTS. Ideal candidate: Expert scraper w/ experience in getting around Cloudflare and anti-scraping mechanisms Strong scripting skills for cleaning html and unwanted JS Good command over Postgres DB for manipulating data Comfortable with Linux / WSL Extra bonus points if you have experience with Airtable and Shopify APIs Please don't use AI to respond to this post - It will be a cause for instant disqualification. The project is divided into 2 phases Phase 1 budget: 150 USD ...

I'm looking for a professional data analyst who can gather and provide me with the follower counts from the top 100 Twitter accounts. Please note: - The project specifically focuses on capturing the follower counts from these top accounts. - Other aspects such as tweet frequency and engagement rate are not part of this project. - Experience with data scraping and social media analysis is preferred. - Proficiency in data handling and analysis software is a plus.

...pain relief. We aim to understand what people are saying about our products and the pain relief industry. The ideal candidate will have expertise in web scraping, data mining, and summarization using AI tools like ChatGPT. Responsibilities: - Conduct web scraping and data mining across various platforms (social media, forums, review sites, etc.). - Use AI tools to summarize findings and extract key quotes. - Compile insights into a weekly report or Notion document. - Ensure the process is as automated as possible while maintaining data quality. Requirements: - Proven experience in web scraping and data mining. - Expertise with web scraping and data mining tools - Experience with AI summarization tools (e.g., ChatGPT). - Strong ...

As an expert in advertising with a successful track record, I'm excited to offer my services to amplify your projects. Understanding that visibility is key to success, my goal is to utilize my skills to enhance your project's reach and influence. Here's what I bring to the table: - Tailored Advertising Strategies: Developing custom advertising plans that align with your project's goals and target audience. - Multi-Platform Campaign Management: Executing campaigns across platforms like Google Ads, Facebook, Instagram, LinkedIn, and more, to maximize exposure. - Engaging Content Creation: Crafting compelling ad copy and visuals that resonate with your audience and reflect your project's message. - Data-Driven Optimization: Continuously analyzing campaign data...

I'm looking for a proficient web scraper who can extract company names and addresses from 5 specified business websites. The final data should be meticulously organized and delivered to me in an Excel spreadsheet. Ideal Skills: - Web scraping - Data entry - Proficient with Excel Please bid if you have relevant experience and can deliver quality work.

I require an expert in data extraction and analysis to gather reviews and location data from approximately 47,000 places on Google Maps, based on input data that I will provide (company name, geolocation, and address). The successful freelancer must be proficient in data scraping using Python and data manipulation. They should also be able to specify a reproducible method and tool for this task. The gathered data will be used for analysis and insights, primarily to conduct sentiment analysis on the reviews. The specific data I need includes: 1. Reviews: with details on date and content 2. Additional data from the location: including opening times and popular times The list of locations will be provided in a CSV/xlsx file. Please include in your proposal the method and tool you...

I need an expert data scrapper who can extract data from Google Maps, Canada. I will provide the keywords and the aim is to get 10,000 results, specifically targeting professional services. This data...it is crucial to receive accurate and comprehensive information. Requirements: - Extract data fields including: - Email addresses - Structure the data in a specific way: - Place all email addresses in a designated column - Organize the data in separate sheets for each keyword - Deliver the final product in an Excel sheet Ideal Skills and Experience: - Extensive experience in web scraping, particularly from Google Maps - Proficient in using Excel and organizing data - Attention to detail to ensure accuracy - Ability to meet deadlines and deliver 10,000 results in...

...seasoned web developer who can help me create a comprehensive online store for fashion. This site needs to sell clothing, accessories, and footwear. Key Requirements: - Develop a user-friendly, appealing online store. - Incorporate a system for user accounts and login features using email and password. - Implement a back-end capable of aggregating data from 500 other fashion websites on a 4-hour basis, ideally in real-time. Ideal Skills: - Proficiency in eCommerce platform development. - Experience in data aggregation and web scraping. - Understanding of fashion industry trends. - Ability to create secure, reliable user login systems. Your bid should reflect your experience in similar projects and your ability to deliver on time. Please provide examples o...

Downloading and sending images of all pages from a website

Bug fix on a web-based platform using AngularJS and Node.js that leverages Python for web scraping and data mining. PostgreSQL will serve as the backend database to store and manage aggregated data. The platform will scrape, analyze, and visualize data from multiple sources, offering users real-time insights and customizable dashboards for decision-making. Skills: AngularJS Node.js PostgreSQL Python Web Scraping Data Mining

PLEASE READ CAREFULLY!!! IF YOU DON'T HAVE EXPERIENCE WITH BET365 DO NOT MAKE ANY OFFER!!! IT'S A VERY HARD WEBSITE TO SCRAPE WITH AN HIGH LEVEL OF PROTECTION I'm seeking a skilled web scraper to gather live match data from Bet365, specifically focusing on Football, Basketball, and Tennis. Key Requirements: - A script for a Connection to the socket. - Capture live odds on match events. - Experience with web scraping, specifically with sports data, is highly preferred. JAVA or PYTHON. Java is preferred Please provide examples of similar projects you've completed in the past.

I'm seeking a professional in web scraping and web advertisement. Key Responsibilities: - Implement a system to display our product as a popup ad when users click a link on specific websites. The primary focus is targeting certain news websites and other selected platforms. - The type of advertisement will be a popup ad. Ideal Skills: - Proficient in web scraping techniques. - Prior experience with web advertisement implementation. - Knowledge of how to target specific websites and user demographics. - Strong understanding of user interface and user experience considerations. I look forward to your bids.

I'm looking for a seasoned web scraping expert with extensive experience in Puppeteer. My current script is in need of optimization to improve its performance, specifically in terms of speed and also need to fix the issues. Key requirements: - Improve the scraping speed of the existing Puppeteer script. - Sometimes the page is not scrolled and the data is not extracted. Ideal skills and experience: - Proven experience with Puppeteer and web scraping. - Strong skills in JavaScript or Node.js. - Excellent problem-solving skills and attention to detail. - Previous work optimizing Puppeteer scripts is a plus. People who have already worked in LinkedIn post scraping would be preferred.

I need a system that can scrape subtitles from YouTube videos of various influencers. The scraped data will be used as knowledge for our AI agents, with a unique knowledge base for each individual. Key Requirements: - Scraping subtitles from influencer's YouTube videos - Organizing the scraped data by influencer - Saving the subtitles in text files Ideal Skills: - Proficiency in web scraping tools and techniques - Experience with data organization and management - Ability to work with AI systems Please note that the primary source of data will be influencers on YouTube. I need the system to be efficient and capable of handling large volumes of data.

...seeking a seasoned Python developer who specializes in web scraping, particularly for extracting data on keyword positions from Google rankings. The primary task involves real-time scraping to feed insights into our proprietary tool, DMcockpit.com. Key requirements: - Extensive experience with web scraping, particularly tracking search engine rankings - Proficient in Python with a robust portfolio of similar projects - Familiarity with Google's latest updates and scraping challenges - Ability to implement efficient, reliable and compliant scraping techniques If you have innovative strategies to navigate around Google's latest scraping hurdles, I would be keen to hear your insights. Please share your portfolio or ...

We're in the final stages of submitting tenders for government maintenance projects. I need a professional to help me with the final review and submission of the tender documents. Ideal candidate should be skilled in: - Understanding of government tender processes - Proven experience with maintenance project tenders - Excellent attention to detail If you can help me ensure my submission is successful, I'd be happy to discuss this opportunity with you.

I'm looking for a talented web scraper who can efficiently extract data from a specific website. The project involves navigating through pagination and scraping data from approximately 5,004 records. Requirements: - The data to be scraped is primarily text, specifically contact information from each record. - The scraped data needs to be delivered in a CSV file. Ideal Skills: - Proficiency in web scraping tools and programming languages (like Python, BeautifulSoup, Scrapy etc.) - Excellent attention to detail to ensure accurate data collection. - Previous experience in scraping websites requiring pagination and search inputs.

I have a Python script that is meant to scrape data from a website, but currently it is not collecting any data. The structure of the website has not changed recently, so I suspect there may be an issue with the script itself. Ideal Skills and Experience: - Proficient in Python - Experienced with web scraping - Familiar with troubleshooting and debugging scripts I am looking for an expert who can quickly identify and fix the problem, so that my script can start collecting data again.

I need a comprehensive database created on Google Sheets containing the email addresses of all US brokers from Requirements: - The database should include the name of the broker as well. - Duplicates should be handled by keeping the most recent occurrence. Ideal Skills: - Proficiency in Google Sheets - Data mining and web scraping experience - Attention to detail and accuracy

I am looking for somebody to download the most recent 500 complaints (no exhibits) filed with the Delaware federal court. An example is: I also need a spreadsheet with the name of the primary defendant in each lawsuit entered. Then I need the name of the general counsel or litigation counsel that works for the defendants company located and their first and last name included in the spreadsheet. Finally, next to their name, I need their corporate email located and included. You may skip any entry where the email cannot be found, but I would like to then add an additional case to the list so that we have 500 total email addresses and corresponding complaints downloaded. I require this be done within 48 hours of accepting this project. Preference will be given to anyone who can complete ...

I'm looking for a logo design for my development (construction) company, "KanHa Projects". The design should be a minimalist and clean style, using a mixture of sage green, gold, and white. A unique feature of this logo is the need for the letter "a" to be an artistic or symbolic representation, while the letters "K" and "H" in "KanHa" should be prominent and capitalized. Key requirements: - The logo should convey a sense of innovation. - The use of unique fonts is encouraged. - Avoid any construction or building symbols; the focus should be primarily on typography and color scheme. Ideal skills for this project include: - Graphic design with a strong focus on typography - Experience in creating minimalist and clean designs ...

I am looking ...will: Automate Daily Data Scraping: Log in to a specific website daily. Scrape data from links provided in a Google Sheet. Google Sheet Integration: Fetch links from a Google Sheet as input. Append the scraped data for the last 1 week (100 data points daily) into a specified Google Sheet. Hosting Requirements: The script will be hosted on and configured to run automatically on a daily schedule. Key Features: Error handling for login issues, scraping errors, or Google Sheets API failures. Efficient handling of large data (100 data points daily). Deliverables: Fully functional Python script meeting the above requirements. Clear setup instructions for hosting on PythonAnywhere.com. Documentation for modifying the Google Sheet integration or scraping ...

I'm looking for a professional who can help me scrape my business Gmail for proof of payments. This will allow me to mark my invoices as "paid" on our data portal, and keep track of my outstanding balances efficiently. Ideal Skills and Experience: - Proficient in data scraping and relevant software - Familiar with Gmail and its functionalities - Able to sort and identify payment proofs in various formats (PDF attachments, email body text, image attachments) - Detail-oriented to ensure accurate tracking of paid invoices - Able to maintain confidentiality and respect for privacy of business emails

I'm looking to scrape 10000 restaurant websites in Australia to analyze their payment gateways. The primary purpose of this task is to conduct competitor analysis. I also need to gather the contact information from these sites. The ideal freelancer for this task should be skilled in web scraping, data analysis, and have a keen eye for detail. Requirements: - Extensive experience in web scraping - Proven track record in data analysis - Ability to gather and organize contact information - Skills in competitor analysis - Attention to detail The scraped data should be provided in Excel format. Please ensure that the payment gateway details are included as part of the contact information. Please organize the scraped data in an Excel file format that you deem ...

I'm seeking a seasoned developer with a deep understanding of Relevance.AI. My business ope...Be an expert in our company products, serious, and the industries we serve - Utilizing various data sources, including company websites and social media profiles, to identify potential prospects. - Scraping relevant news related to these companies to ascertain their business activities and potential needs. - Create a detailed report on the prospects and how they fit - Composing and orchestrating email outreach campaigns to these prospects. Ideal candidates should possess: - Extensive experience with Relevance.AI. - Proficiency in developing AI Agents for lead generation. - Skills in data scraping and email automation. - An understanding of the B2B services landscape. (See flow...

I'm looking for a proficient AI developer to create an AI agent that will scan, crawl, and scrape location-sp...properties for images, title, general info to present an AI predictive insight to users. Key Responsibilities: - Identify and curate content from various sources: News websites, Social Media Platforms, Forums and Discussion Boards, and Local News Sites. - Translate curated content into betting markets. Ideal Skills and Experience: - Proficiency in AI and machine learning. - Experience with web scraping and content curation. - Understanding of betting market dynamics. - Ability to work with diverse digital content sources. - Related experience in AI Agent development to automate routine tasks - Related experience integrating AI (ChatGPT) into search dynamics, ...

I'm looking for a professional who can either scrape mobile numbers from any websites or has access to a...a professional who can either scrape mobile numbers from any websites or has access to an existing database of crypto leads. The purpose of this project is to gather contacts for an upcoming marketing campaign. Ideal Skillset: - Expertise in web scraping techniques and tools - Access to a reliable database of crypto leads - Understanding of ethical data sourcing and privacy laws - Experience in generating leads for marketing campaigns - Proficiency in data organization and presentation Please note that I am open to any platform for the web scraping, be it social media, business directories, or personal blogs. Your ability to source leads from divers...

We are looking for a skilled Python developer to help us integrate and automate processes using the Manatal API. The project involves fetching, processing, and updating candidate data within Manatal and streamlining recruitment workflows. Key Deliverables: 1)Fetch candida...candidate data within Manatal and streamlining recruitment workflows. Key Deliverables: 1)Fetch candidate data from Manatal using the API. 2) Process resumes and job descriptions using OpenAI's API for evaluation (resume match, skillset match, etc.). 3) Update candidate profiles in Manatal with evaluation scores and custom fields. 4) Automate assessment progress monitoring and status updates via scraping. 5) Implement centralized logging and error handling. We have part of the code done that can be reus...

I'm in need of a skilled Scrapy developer who can collect product details from various e-commerce websites. The key deliverable for this project is the Scrapy code along with the scraped data. Ideal Skills: - Extensive experience with Scrapy - Proficiency in Python - Familiarity with data scraping from e-commerce websites - Ability to deliver well-structured and commented code

I need oil and gas production data pulled from government websites and collated into a web app. There will be follow up work available! Requirements: - Data collection from government websites on a weekly basis... TRRC, NMOCD... - Development of a web app to collate this data SWR-32 This data is published as PDF and html. I'm interested in the flare volume, duration, location, operator, h2s Historic data is also available in a disposition data query Ideal Skills: - Data scraping and web development - Experience with oil and gas industry data - Familiarity with government data sources

more projects

I'm in need of a Python expert who can develop a script for me to scrape specific stock information from finance.yahoo.com. Requirements: - The script should be able to scrape the current stock price and financial statements from a list of ...need of a Python expert who can develop a script for me to scrape specific stock information from finance.yahoo.com. Requirements: - The script should be able to scrape the current stock price and financial statements from a list of stock symbols I will provide. - The data needs to be delivered in a CSV format. Ideal Skills: - Deep knowledge in Python development. - Prior experience with web scraping. - Understanding of stock market data. - Ability to deliver data in specified format. Please only bid if you have the necessary ...

I'm in need of a dedicated Python developer to assist with multiple financial projects. The tasks primarily involve web scraping, developing Python indicators, and backtesting. Key Responsibilities: - Continuously collaborate with me on these projects. - Web scrape stock prices from Kite. - Utilize Python libraries such as BeautifulSoup, Scrapy, and Selenium. Ideal Skills: - Proficiency in Python with a strong understanding of its application in finance. - Extensive experience with web scraping. - Familiarity with the Kite platform. - Knowledge of Python libraries: BeautifulSoup, Scrapy, and Selenium. - Experience with developing Python indicators and backtesting. Your role will be instrumental in helping me analyze stock price tren...

I'm in need of a seasoned UX designer who can jump right in and complete various UX tasks within hours starting today. There's a high volume of work ahead, so I'm looking for someone who can keep up with the pace. Key Responsibilities: - Completing urgent UX tasks across various projects - Delivering high-quality work under time constraints - Potentially working on wireframes, prototypes, and user research - Must know FIGMA Ideal Candidate: - Highly experienced in UX design - Able to understand and follow design guidelines - Exceptional time management skills - Able to work under pressure and meet tight deadlines

I'm in need of a detail-oriented Tender Documentation Specialist to assist with private sector construction tenders. Your role will be crucial in managing and preparing tender documents. Key responsibilities include: - Preparing tender documents in line with industry standards and regulations - Ensuring all documents are submitted in a timely manner The ideal candidate will: - Have a strong background in procurement, project management, or contract administration - Possess excellent organizational and communication skills - Be adept at working under tight deadlines