Web scraping using jobs

...text files named after each video Process videos chronologically (oldest to newest) Handle 1000-2000 videos per channel Technical Specifications: Language: Python Implementation using Python requests or YouTube-specific libraries Error Handling Requirements: Handle video page loading failures with refresh capability Log videos without CC to Implement robust error handling for large-scale processing Design for resilience against YouTube UI updates Project Parameters: Budget: $50 Timeline: 1-2 days Deliverable: Fully functional Python application Required Skills: Python programming Experience with web scraping Knowledge of YouTube API or similar video platform integration Error handling and logging implementation Data extraction and file management Desired Programm...

I need a skilled Python developer to create a web scraper for me. The scraper should be able to extract structured data, like tables, from various e-commerce websites. The project requires a deep understanding of web scraping techniques and best practices in Python.

I'm looking for a Python-based email validation checker that can efficiently check millions of email addresses against the Kucoin sign-up page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the loa...page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the load of millions of checks with a budget of $200 worth of proxies. - Store results: The checker should store the results of the email validation in a file. The output format for the results file should be TXT. Ideal candidates for this project would be those with extensive experience in Python, web scraping, and proxy handling. A deep understanding of email validation and experience working with cryptocurrency exchange websites would ...

We are seeking a skilled map creator to develop a detailed 50 X 30 grid map for a fantasy world. The map should be based on an existing image and crafted using the Inkarnate map maker. Attention to detail, creativity, and an understanding of fantasy themes are essential. The final output should be visually appealing and aligned with the provided reference image. If you have experience in map making and a passion for fantasy worlds, we would love to see your portfolio. Please apply with your previous work examples and your approach to this project. Please answer this question other I will reject your proposal.... 1) Do you have experience with the Inkarnate map maker software?

Please Sign Up or Login to see details.

I need an “AI” that can generate realistic images. The data scrapper should be capable of scraping the entire internet to gather unique details and use random generation to create distinct images. I want the AI to output a variety of image types, including portraits, landscapes, and abstract art. Ideal skills for this job include: - Experience in machine learning - Proficiency in data scraping - Knowledge in image generation - Familiarity with different art styles - Skills in random generation algorithms

I'm looking for a service to add members from one Telegram group to another (scraping usernames from public groups and adding them to my group). 1) What is the price for 1k members? 2) What is the timeline to finish? - NO smm panel/bots... (I will provide you public groups to take members from and add to my group) - This will be an ongoing project, as I plan to place many additional orders later. - Only professionals with prior experience in this type of work !

...Description: We are seeking an experienced freelance developer to create a custom bot that monitors specified profiles on X (formerly Twitter) for posts related to memecoin launches and delivers real-time alerts via Telegram. The bot must be fast, efficient, and built using free or open-source tools, avoiding paid APIs or developer tools. Responsibilities: • Profile Monitoring on X: • Track a predefined list of X accounts, including influencers, crypto enthusiasts, and meme-focused profiles. • Focus on posts mentioning memecoin launches, using hashtags like #memecoin and phrases such as “launch,” “new coin,” or other relevant crypto-related terms. • Real-Time Detection: • Implement functionality to scan posts in real-t...

...highlighting the best deals. Availability Check: Show real-time availability of products by integrating with retailer APIs or scraping product data (where APIs are unavailable). Data Sources and Integrations: Integration with APIs of popular e-commerce platforms such as Amazon, eBay, Walmart, ASOS, etc. Efficient Data Presentation: Return results in a clear, JSON-based format for easy integration with the frontend. Include sorting by price and basic filters (e.g., size, brand). Include features like sorting (price, relevance) and filtering (brand, size, ratings). Required Skills: Strong experience in backend development and API integrations. Familiarity with scraping technologies and tools (if necessary). Knowledge of color recognition and matching algorithms. Profic...

extract data from web ejar SA, and put it into excel sheet

I need an app to continually monitor when a driving test becomes available and then sends an SMS and/or email with the details of the earliest available appointment, if there is one The app will need to be able to login to the DVSA website (I will give my credentials) which has a visual CAPTCHA security screening  This is the URL:  This link is to the rebooking site for an existing appointment where you can look for an appointment at a date earlier than the existing booking so it will need to know that data too (to be provided). The app doesn't need to make the rebooking, only to alert when one an earlier appointment is available. It needs to monitor for multiple users ar a time

Requirements of paper: A- 8 pages-single space excluding references + real data Simulations using any software for stats. B- abstract, intro., literature review, simulation results (NOT COPIED PASTED FROM OTHER PAPERS- Original) data analysis, of graphs tables discussion of results and conclusion as any normal paper C- Zero plagiarism or AI content (This will be verified). The integration of artificial intelligence (AI) into business models has become a transformative strategy, enabling organizations to enhance efficiency, optimize decision-making, and gain a competitive edge. This study explores the development and implementation of an AI-driven business model tailored to address dynamic market demands and operational challenges. The proposed model combines machine learning alg...

We are seeking a skilled map creator to develop a detailed 50 X 30 grid map for a fantasy world. The map should be based on an existing image and crafted using the Inkarnate map maker. Attention to detail, creativity, and an understanding of fantasy themes are essential. The final output should be visually appealing and aligned with the provided reference image. If you have experience in map making and a passion for fantasy worlds, we would love to see your portfolio. Please apply with your previous work examples and your approach to this project. Please answer this question other I will reject your proposal.... 1) Do you have experience with the Inkarnate map maker software?

I am in need of a professional bookkeeper with extensive experience in managing accounts for Canada. Key Requirements: - The candidate must be proficient in using Xero. - Prior experience in Canadian bookkeeping is a plus. - Ability to manage and organize financial data efficiently. - Excellent attention to detail to ensure accuracy in financial reporting. This role focuses primarily on bookkeeping tasks. The right candidate will be able to help me maintain my financial records in good order, ready for future tax filing and financial reporting.

I'm in need of an expert who can scrape live video data from video streaming services. The data should then be converted into an API, with the format being JSON. Ideal Skills: - Proficiency in web scraping - Experience in API development - Understanding of JSON format Your primary task will be to collect data from live videos on various streaming platforms and turn it into a usable API. Please note that the specific types of data to be collected have not been specified yet. Prior experience working with video data is a plus. Please bid if you have the necessary skills and experience. Looking forward to your proposals.

...link containing lists of other companies. For each company, gather the following information (where available): Company Name Key People (CEO, Founder, Marketing Head, Sales Head, or equivalent) Job Titles Contact Details (email addresses, phone numbers) LinkedIn Profile URLs (if available) Organize the data into a structured Google Sheet or Excel file. Requirements: - Experience in data scraping, web research, or lead generation. - Attention to detail and accuracy in collecting and entering data. - Ability to use professional tools like LinkedIn, email finders, or other research methods to locate information. - Familiarity with verifying email addresses to ensure they are active and bounce-free....

We are seeking a skilled professional to design and assemble a Smart Bay non-permanent practice bay. The design specifications include: - Utilization of medium-duty racks (10’w x 10’h x 12’d dimensions). - Shed-style roof constructed from reinforced vinyl with a 2:12 slope (10’ high transitioning to 8’). - Artificial grass turf securely affixed to plywood flooring. - Incorporation of four wire mesh gates (4’x8’). - Easy-to-dismantle, portable components built for convenience and practicality. What we envision as a "Smart Bay": A versatile, transportable practice bay primarily used by amateur golfers with mid to high handicaps, designed to offer an optimized safe and durable environment for improving their game without requiring permits o...

...solid foundation: The database is live in Supabase with role management, data inputs, and calculations fully set up. Key APIs like ScrapingBee (for data extraction) and FRED (for rate data) are ready and configured. The frontend uses React.js with TailwindCSS, DaisyUI, and ShadCN for layouts and visuals. We also have multiple Vercel deployments showcasing different features like login, scraping, and calculations. User flows are clearly defined and tested for functionality. Your Role: You’ll be the one pulling everything together into a cohesive, live MVP. Here’s what that looks like: Unify User Pages: Make sure Guest, Registered, and Admin pages function as intended. This includes fixing routing, refining role-specific content visibility, and pol...

Please Sign Up or Login to see details.

Tasks: - I need to have customers upload files in private storage folder using plupload - I would like to download the files from the edit page under workorders - Have a separate page for uploading after client has created order for

I'm seeking a professional with extensive experience in email automation to help me streamline my email processes. The primary g...this project is to save time by automating all types of emails, from welcome messages to follow-ups and newsletters. Key Responsibilities: - Implementing email automation systems to handle all potential email types - Primarily sourcing content from FigJam - Ensuring the system operates smoothly and efficiently Ideal Skills and Experience: - Proven experience in email automation - Proficient in using FigJam - Excellent problem-solving skills to troubleshoot any issues - Ability to work independently and efficiently. This project is a great opportunity for anyone who is passionate about efficiency and has the relevant skills. I look forward to wo...

I'm seeking an expert in Life Cycle Assessment (LCA) and Gabi software to evaluate the environmental impact of an Enhanced Oil Recover...an expert in Life Cycle Assessment (LCA) and Gabi software to evaluate the environmental impact of an Enhanced Oil Recovery (EOR) project. The process primarily involves gas injection, specifically Carbon Dioxide (CO2). Key Responsibilities: - Conduct a comprehensive LCA using Gabi software - Focus on the environmental implications of CO2 gas injection in EOR - Provide insightful reports and recommendations Ideal Skills and Experience: - Proven experience in LCA, preferably in the oil and gas industry - Proficient in using Gabi software - Strong understanding of EOR processes and gas injection techniques - Excellent report writing and...

...images, descriptions, and pricing -Automated data updates from external foreclosure listing sources - I.e. scraping or third party API -Backend Administration Panel: -Manage property listings (add/edit/delete) -Track subscriptions and payments -Analytics dashboard for user activity and revenue -User support/ticketing system integration Technology Preferences: - Based on WordPress CMS preferred (for ease of management and scalability) - Custom plugin development if required - Secure and scalable hosting setup recommendation - Mobile-responsive design (optimized for all devices) Security & Compliance: -Secure user data storage (GDPR/CCPA compliance) - SSL certification and best practices for web security - Payment gateway security (PCI compliance) Performance Optimiz...

I'm seeking a professional to scrape my WordPress website for 1100 entries related to our different offices. The data needs to be exported into an Excel file, without any specific filters or sorting. In addition to data scraping, I need a thorough code review of my WordPress site. This should encompass: - Documentation and review of custom code - Optimization where necessary - Plugin review for updates - Recommendations for optimization This project requires a deep understanding of PHP, as well as experience with WordPress and data scraping. The ideal freelancer will have a strong background in website code review and optimization.

...of PapAPP are to reduce stress between parents and sons, increase their communication, have harmony at home and improve time management at home by providing an efficient tool that enhances communication and promotes autonomy among students. The target audience includes parents and students in elementary and secondary education within private schools in Chile. The full project must be delivered using flutter flow. Freelancer must use his/hers own flutterflow account. Screens text must be written in Spanish (Chile) just like the wireframes provided. PapAPP (the name of the app) requires the development of functionalities that address the specific needs of students and parents, focusing on efficiency, clarity, and ease of use. The following descriptions match the design used on...

We want to create a fully custom-coded LMS website inspired by (only referencing its layout and user flow) using Cursor AI. This means no WordPress, Wix, or Figma—just custom HTML/CSS/JS with code generation and editing via Cursor AI. After deploying on Netlify, we’ll later revise images/text to avoid any direct duplication or trademark elements from the original. Reference Pages (for structure and design approach only): Main: Landing: Menu 1 (Company Intro): Menu 2 (Landing Page Intro): Menu 3 (Purchase Page):

We have 11,000 manufacturer SKU's that we would like to do price comparison across 10 different ecommerce websites. 100% accuracy is a must. 5 star freelancers only apply.

...number of stories, and the size of the lot for each property. Determine if the property is located on a wide street. Excel Integration: Ensure that all extracted data is neatly organized and formatted for easy access within Excel. Provide clear, user-friendly functionality to paste or upload listings and automatically trigger the data extraction process. Skills Required: Strong experience with web scraping or API integration to pull data from Zillow, Redfin, StreetEasy, and other platforms. Proficiency in Excel automation, preferably with VBA or Python (pandas, openpyxl) to integrate the data extraction functionality. Familiarity with Zola NYC and NYC Open Portal to access zoning and building-related data. Knowledge of real estate terminologies and zoning regulations in ...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...

I'm in need of a skilled web scraper and automation expert to assist with a unique project. The task involves scraping phone numbers from a specific directory site. The project requires: - Proficient skills in web scraping, specifically targeting directory sites. - Experience with automation, particularly sending messages via WhatsApp. - Ability to create a system that triggers a WhatsApp message whenever a new phone number is detected. The ideal candidate would have a keen eye for detail, understand the importance of data privacy, and be able to deliver a seamless, efficient system.

I'm looking for a proficient web scraping expert skilled in Javascript, Node.js, and Python. Your main tasks will include: - Scraping profile information from various social media platforms - Data mining from Shopify Ideal candidates should be well-versed in data extraction techniques, have a keen eye for detail and able to handle large datasets.

Project Title: ? Python Developer Needed for Script ...per task: Small fixes/modifications: $5-$10 Medium feature additions: $15-$30 More complex tasks: Higher rates possible ? First task will be a $5 paid test to check work quality. Requirements: ✔ Python scripting experience (loops, functions, API calls) ✔ Basic understanding of web scraping or automation ✔ Ability to follow instructions and deliver clean code ✔ Clear communication in English ? To apply, answer these questions: 1️⃣ How many years of Python experience do you have? 2️⃣ Have you worked with web scraping or automation before? (Yes/No, provide an example if yes) 3️⃣ What is your estimated turnaround time for small tasks (5-10 lines of code modifications)? ⏳ Ongoing work available for the right c...

...talented UI/UX designer to convert an existing mobile app design into a responsive web application design using Figma. The goal is to maintain the app's core functionality and visual identity while optimizing the user experience for larger screens, ensuring consistency across different devices. Scope of Work: Review Existing Mobile App Design : - Analyze the current design structure, features, and user flow. - Understand the design system, color palette, typography, and branding guidelines. Web Design Adaptation: - Translate the mobile app layout into a user-friendly and visually appealing web design. - Create wireframes and high-fidelity mockups for desktop, tablet, and other relevant screen sizes. - Ensure the web design remains responsive ...

The project was created to practice test automation skills using the Selenium (Java) framework, utilizing skills learned in a course on the Udemy platform. The website under test is a website specifically designed for automated testing. The project contains a total of 26 automated tests, created based on test cases defined by the site's developers. After running and executing the tests, using the proper command, a test report can be generated, which describes in detail the activities performed and the statuses of each test. ? Project Design: • Page Object Model • Fluent Interface • Data-Driven approach • Behavior-Driven approach Read the attached File for full information

I'm seeking a developer who can create different micro bots for me. The main purpose of these bots will be to automate various actions, primarily data scraping tasks. Key Responsibilities: - Develop around 5 bots each month, focusing on web scraping and APIs data extraction. - Ensure long-term, reliable performance of the bots. - Adapt to potential new tasks and requirements over time. Ideal Skills and Experience: - Proficiency in Python and AI technologies. - Strong experience in creating micro bots for data scraping. - Ability to understand and adapt to different data sources. Please note, the specific websites or APIs to scrape data from will be discussed and decided together. I'm looking for a long-term collaboration, so reliability and adaptabi...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...

I am looking to extract product information from a website into an Excel sheet. I just need the product name, description, and price from the product listings on the site. Please let me know if you're experienced with web scraping and can finish this task. I just need an Excel Sheet and not a tool. Thank you!

when one dropdown is clicked other dropdown are opened..

I'm looking for a professional who can help me extract a cutting pattern from a designed picture and visualize it in 3D. The picture is in JPEG/PNG format and the cutting pattern will be used for garment manufacturing. The final cutting pattern needs to be delivered in PDF format. Ideal skills and experience for the job: - Proficiency in pattern making & garment manufacturing - 3D modeling skills - Ability to work with JPEG/PNG files - Proficient in creating & delivering PDF files - Previous experience with creating cutting patterns is a plus Task: Design the Top and Bottom wear in this picture, show it in 3D, also, I want to fetch the cutting pattern

I'm looking for a web scraping expert who can extract data on clothing products from various ecommerce platforms. Ideal skills: - Proficiency in web scraping tools and software - Experience with ecommerce platforms - Understanding of data analysis The scope of the project includes: - Scraping clothing items' data - Providing insights and trends from the scraped data

I'm seeking a proficient Excel developer with strong skills in VBA and Macros. The job involves creating an automated workflow to transform data from a single Excel file into three separate files. Key Tasks: - Importing data from one Excel file - Creating three files using VBA and Macros - Data cleaning - Data merging - Data filtering The data filtering will involve: - Applying numerical ranges - Text matching - Date ranges Ideal candidates should have a robust understanding of data transformation processes and extensive experience with Excel VBA and Macros.

I'm looking for a freelancer to help me with extracting data from a website. The data is spread across different web pages, and I need it to be exported into separate Word documents for each page. Only bid if you can do the job. Data to Extract: - Text content - Images (to be saved in JPEG format) all in one document each Document Organization: - Each Word document should have separate sections for text and images. Ideal Skills and Experience: - Prior experience with web scraping. - Proficiency in creating and formatting Word documents. - Attention to detail for data accuracy and organization.

Description: We are seeking an experienced developer to build an arbitrage bot for the Solana blockchain. The bot must be capable of tracking price discrepancies across exchanges, calculating potential profits (factoring in all relevant fees), and automating trade execution when profitable opportunities are detected. The bot should be built using the MERN stack and leverage APIs such as the Jupiter Aggregator Swap API. Key Features & Requirements: 1. Data Tracking: • Monitor Asset Prices: • Fetch and track the asset ask price (buying price). • Fetch and track the asset bid price (selling price). • Price Matching Logic: • Identify arbitrage opportunities when the lowest ask price (buy) on one exchange is less than the highest bid price (sell) on a...

I need a scraping expert to debug my Python script that's supposed to be fetching financial data from APIs. Currently, the script is failing to retrieve some data. Ideal Skills and Experience: - Proficient in Python and data scraping - Experienced with financial data APIs - Strong debugging skills - Knowledge of data parsing and handling - familiar with yahoo finance data

I'm seeking a freelancer to compile a detailed, monthly updated database of USA credit cards for a public website or app. Key Requirements: - image of the card. - Information on Interest Rates and Fees: Understand and gather data concerning the cost of owning the card...or app. Key Requirements: - image of the card. - Information on Interest Rates and Fees: Understand and gather data concerning the cost of owning the card. - Rewards and Benefits: Identify the perks associated with each card including cash back, travel points, etc. - Eligibility Requirements: Document what is needed to qualify for each credit card. Ideal Skills: - web scraping, cleaning and storing data - Familiarity with web/app data requirements Please note: This project will require a com...

I need a skilled web scraper who can extract data from a members area of a website. The data should be compiled and delivered in an Excel file. Website Scraping of Members Area Ideal Skills: - Web scraping expertise - Proficiency in Excel - Attention to detail

...similar to an attachment I will provide (). Script 1: Download stock prices (for a year - Download Historical ) and dividend data (for a year) for a given stock Script 2: save data to a single-sheet Excel file Script 3: Create a chart in the Excel file The ideal freelancer for this project should have: - Extensive experience with Python, particularly with libraries for web scraping and data analysis. - Proficiency in creating and manipulating Excel files with Python. - Skills in data visualization, particularly in creating line graphs. Please provide examples of similar projects you have completed in your bid. Sample data: Historical quotes: Dividend data: https://www

I'm in need of a skilled programmer who can create an independent bot for me....independent bot for me. The bot's main task will be to retrieve certain information from a secure website. Key Requirements: - The bot should be able to log into the site with provided credentials. - It should collect specific user data, particularly user activity and user messages. Ideal Skills: - Proficiency in programming languages such as Python, Java, or similar. - Prior experience in web scraping and bot development. - Understanding of data security and ethical considerations in data retrieval. - Ability to deliver a reliable, efficient, and independent bot. Please note: The target website is secure and requires login credentials. The successful freelancer will be given the ne...

...according to date i.e. I would like to input a date range and sport (soccer) and get the match details for those matches. Further details will be discussed with bidder. I should also mention that date range for scrapping data could be quite long (i.e. months) so the output xls could be quite big. It is very important to me that scraping is done as quickly as possible (seconds) with as less clicks as possible and without hanging-up or crippling my PC while scraping. PROJECT DETAILS: Sport:----------------------Football Bookmaker:------------------Bet365, BWIN, Pame Stoixima, Stoiximan, Interwetten, Novibet, William Hill Seasons:--------------------FROM 2000 and be continue for lifetime (Be automatically updated with all the events that have ended and with all the events...

I'm looking for an expert in AI tools to scrape a website for me. The goal is to extract specific contact information and organise it neatly in an Excel sheet. Data to be Scraped: - Email addresses - Phone numbers - Names - Zip Codes The ideal candidate should have prior experience in web scraping and data management. Proficiency in using AI tools for this task is crucial. Data Formatting: - I need the data to be sorted into separate sheets for each type of information. Please provide examples of previous similar tasks you have completed successfully.