Web scraping jobs jobs
Job Title: Software Developer Intern (Automation & Web Scraping) Location: Remote About Us: We are a dynamic tech company dedicated to building innovative solutions for data processing and automation. We are looking for a motivated Software Developer Intern who is passionate about web automation and data scraping to join our team. This is an exciting opportunity to work on real-world projects and gain hands-on experience in the tech industry. Role Overview: As a Software Developer Intern, you will be responsible for developing automation tools that can scrape data from websites using available APIs. You will be working with modern technologies like Postman, Selenium, Python, and various automation techniques to build solutions that streamline our processe...
I’m looking for a skilled developer to help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation. Current Situation: I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached). The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable. What I Need: A robust and reliable solution for faster and more efficient scraping without interruptions. The ability to download HTML files in the required structure. Ideall...
Job Title: Develop a Workflow for Scraping Global Mosque & Muslim-Based NGO Data with Detailed Documentation ________________________________________ Job Description: I am looking for a skilled automation expert to build a workflow that scrapes Google for global contact details of mosques and Muslim-based NGOs. The workflow must allow for targeted searches by category (e.g., society, charity, non-profit) and be optimized for credit efficiency in Make.com. The final system should produce structured data outputs and include clear, beginner-friendly documentation. ________________________________________ Scope of Work: 1. Automation Workflow: 1) Build a workflow to scrape Google for the following details: a. Organization Information: i. Organization Name ii. Organization
Hello, I have experience in Python, web scraping, and data extraction using tools like Scrapy, Pandas, and Selenium. I can quickly debug your script and ensure it meets all your requirements. Here’s how I plan to help you: 1. Fix bugs in your script within 2-3 hours. 2. Add functionality to match conditions and extract data as per your requirements. 3. Provide an easy-to-use script for future use. I will deliver the output in the required Excel format. Looking forward to your response so we can start immediately! Budget: $8 (as per your project description). Timeframe: First phase within 2-3 hours. Thank you,
...Alerts: Implement server-side functions for renewal notifications. 2. Sub-Contractor Features 2.1 Payments to Sub-Contractors Payment Integration: Use Stripe or PayPal for secure payment processing. Flexible Payout Options: Offer various payout frequencies and display transaction history using tables with filters. Incentive & Bonus System: Calculate bonuses based on customer ratings and peak time jobs. 2.2 Tracking & Directions In-App Navigation: Utilize Google Maps SDK for optimized turn-by-turn navigation. ETA Adjustments: Use Google Directions API for real-time ETA updates. Multiple Stops: Support multi-stop route optimization and dynamic adjustments. 2.3 Quote Approval Process Quote Review: Allow subcontractors to approve or override quotes using a customizable interf...
We operate a job portal, , built on PHP and SQL. Our goal is to extend our reach by linking job posts with prominent job websites like Indeed and LinkedIn, and possibly others like , Monster Jobs, TimesJobs, etc. Key Requirements: - Real-time synchronization of job postings across platforms - Integration of an Application Tracking System (ATS) We already have accounts set up on both Indeed and LinkedIn. The ideal candidate for this project would be someone with substantial experience in job portal integration, preferably with knowledge of implementing an ATS. Please provide your most competitive quote.
I'm seeking a freelancer who can provide me with a daily supply of up to 30K email addresses of individuals aged between 50 and 60 in the USA. The primary purpose of this email database will be for marketing campaigns, so the emails should be valid and ideally have a history of engagement with similar campaigns. Skills and Experience Required: - Data mining and web scraping - Experience with email list building - Understanding of demographic targeting - Knowledge of email marketing standards Please note, the lists need to be delivered daily, and must be of high quality to ensure maximum deliverability and engagement.
I'm in need of an experienced virtual assistant with a background in home care agencies. The role primarily involves handling insurance claims, calling clients, posting jobs, and assisting with staffing. Familiarity with Electronic Health Records (EHR) systems and HHA EXCHANGE is crucial. If you've previously worked with a home care agency in the USA, I'd love to hear from you. Thank you.
...YouTube-specific libraries Error Handling Requirements: Handle video page loading failures with refresh capability Log videos without CC to Implement robust error handling for large-scale processing Design for resilience against YouTube UI updates Project Parameters: Budget: $50 Timeline: 1-2 days Deliverable: Fully functional Python application Required Skills: Python programming Experience with web scraping Knowledge of YouTube API or similar video platform integration Error handling and logging implementation Data extraction and file management Desired Programming Language: Python C# (preferred) Or whatever is best for this type of work * Do not bid if you have under 3 reviews, you will be ignored * Need Source Code when Job is Complete, After any Bug fixes, and Upd...
I need a skilled Python developer to create a web scraper for me. The scraper should be able to extract structured data, like tables, from various e-commerce websites. The project requires a deep understanding of web scraping techniques and best practices in Python.
I'm looking for a Python-based email validation checker that can efficiently check millions of email addresses against the Kucoin sign-up page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the loa...page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the load of millions of checks with a budget of $200 worth of proxies. - Store results: The checker should store the results of the email validation in a file. The output format for the results file should be TXT. Ideal candidates for this project would be those with extensive experience in Python, web scraping, and proxy handling. A deep understanding of email validation and experience working with cryptocurrency exchange websites would ...
Please Sign Up or Login to see details.
I need an “AI” that can generate realistic images. The data scrapper should be capable of scraping the entire internet to gather unique details and use random generation to create distinct images. I want the AI to output a variety of image types, including portraits, landscapes, and abstract art. Ideal skills for this job include: - Experience in machine learning - Proficiency in data scraping - Knowledge in image generation - Familiarity with different art styles - Skills in random generation algorithms
I'm looking for a service to add members from one Telegram group to another (scraping usernames from public groups and adding them to my group). 1) What is the price for 1k members? 2) What is the timeline to finish? - NO smm panel/bots... (I will provide you public groups to take members from and add to my group) - This will be an ongoing project, as I plan to place many additional orders later. - Only professionals with prior experience in this type of work !
...Optimize the bot to process and deliver alerts without delay. • Avoid rate-limiting issues and ensure reliable performance. • Code Maintainability: • Write well-documented and modular code to facilitate future updates or extensions, such as adding new profiles or refining detection logic. Requirements: • Experience with X API or Web Scraping: • Proficiency in using X API or unofficial libraries like Tweepy to extract data from X. • Knowledge of web scraping methods as an alternative if required. • Telegram Bot Integration: • Hands-on experience with the Telegram Bot API to configure notifications. • Ability to design clear, concise, and user-friendly Telegram notifications. • Real-Time Data Processi...
...highlighting the best deals. Availability Check: Show real-time availability of products by integrating with retailer APIs or scraping product data (where APIs are unavailable). Data Sources and Integrations: Integration with APIs of popular e-commerce platforms such as Amazon, eBay, Walmart, ASOS, etc. Efficient Data Presentation: Return results in a clear, JSON-based format for easy integration with the frontend. Include sorting by price and basic filters (e.g., size, brand). Include features like sorting (price, relevance) and filtering (brand, size, ratings). Required Skills: Strong experience in backend development and API integrations. Familiarity with scraping technologies and tools (if necessary). Knowledge of color recognition and matching algorithms. Profic...
extract data from web ejar SA, and put it into excel sheet
I need an app to continually monitor when a driving test becomes available and then sends an SMS and/or email with the details of the earliest available appointment, if there is one The app will need to be able to login to the DVSA website (I will give my credentials) which has a visual CAPTCHA security screening This is the URL: This link is to the rebooking site for an existing appointment where you can look for an appointment at a date earlier than the existing booking so it will need to know that data too (to be provided). The app doesn't need to make the rebooking, only to alert when one an earlier appointment is available. It needs to monitor for multiple users ar a time
I'm in need of a recruitment agency that can assist in the mass hiring of mid-level professionals primarily in the Information Technology, Healthcare, and Sales sectors. Key Responsibilities: - Posting jobs in valid and verified indeed accounts for US. - Streamline the hiring process to improve efficiency -Candidate database creation Challenges: - The primary obstacle I'm facing is the difficulty in finding qualified candidates with valid Indeed Employer Accounts Ideal Skills: - Extensive network and resources in the Information Technology, Healthcare, and Sales industries - Proven track record in sourcing mid-level professionals - Ability to understand and meet specific role qualifications and organizational needs
I'm in need of an expert who can scrape live video data from video streaming services. The data should then be converted into an API, with the format being JSON. Ideal Skills: - Proficiency in web scraping - Experience in API development - Understanding of JSON format Your primary task will be to collect data from live videos on various streaming platforms and turn it into a usable API. Please note that the specific types of data to be collected have not been specified yet. Prior experience working with video data is a plus. Please bid if you have the necessary skills and experience. Looking forward to your proposals.
...link containing lists of other companies. For each company, gather the following information (where available): Company Name Key People (CEO, Founder, Marketing Head, Sales Head, or equivalent) Job Titles Contact Details (email addresses, phone numbers) LinkedIn Profile URLs (if available) Organize the data into a structured Google Sheet or Excel file. Requirements: - Experience in data scraping, web research, or lead generation. - Attention to detail and accuracy in collecting and entering data. - Ability to use professional tools like LinkedIn, email finders, or other research methods to locate information. - Familiarity with verifying email addresses to ensure they are active and bounce-free....
...solid foundation: The database is live in Supabase with role management, data inputs, and calculations fully set up. Key APIs like ScrapingBee (for data extraction) and FRED (for rate data) are ready and configured. The frontend uses React.js with TailwindCSS, DaisyUI, and ShadCN for layouts and visuals. We also have multiple Vercel deployments showcasing different features like login, scraping, and calculations. User flows are clearly defined and tested for functionality. Your Role: You’ll be the one pulling everything together into a cohesive, live MVP. Here’s what that looks like: Unify User Pages: Make sure Guest, Registered, and Admin pages function as intended. This includes fixing routing, refining role-specific content visibility, and pol...
...Categories Page Industry Options: • Healthcare • Trades (e.g., electricians, plumbers) • Engineering • Shop Workers • Landscaping • Construction • Cleaning Services • Finance • Technology • Hospitality Description: • Each category features a brief description of typical roles, sponsorship opportunities, and participating companies. Search Functionality: • Search bar to find specific jobs or sponsorship opportunities. 4. Immigration Attorney Services • Hire an Immigration Attorney • Banner: “Need legal help? Don’t navigate the immigration process alone.” • Button: “Get Connected to an Immigration Attorney.” • Directory: • List of vetted immigratio...
I'm seeking a web designer to modernize the design aesthetics of my existing website and update the logo. Key tasks include: - Revamping the layout to a clean, minimalist style with improved typography using sans-serif fonts. - Simplifying the menu for easier access to key sections such as "Jobs" and "Resources". - Creating a visual hierarchy with larger headings and clear subheadings. - Modernizing the color palette and incorporating high-quality images and icons to break up text. - Ensuring the site is fully responsive and optimized for mobile. - Ideally, a QR code will be generated for easy site access. The ideal freelancer for this job should have: - Extensive experience in web design with a focus on modern, minimalist aesthetics. - Stro...
...user selects jobs as the filter it should show map of certain area and then show heat maps of jobs that have been done in a certain area if the user selects job type as the filter it should show map of certain area and then show heat maps of job type that have been done in a certain area ie plumbing if the user selects Asset as the filter it should show map of certain area and then show heat maps of asset that have failed in a certain area ie plumbing This needs to be basic and needs to be of a certain area in the UK which i will tell the person that does the task. Its all just for concept and can use a flat table for data which i will need you to generate for the location based on the appliances, job type that i give. I need to be able to put the page you create on ...
...images, descriptions, and pricing -Automated data updates from external foreclosure listing sources - I.e. scraping or third party API -Backend Administration Panel: -Manage property listings (add/edit/delete) -Track subscriptions and payments -Analytics dashboard for user activity and revenue -User support/ticketing system integration Technology Preferences: - Based on WordPress CMS preferred (for ease of management and scalability) - Custom plugin development if required - Secure and scalable hosting setup recommendation - Mobile-responsive design (optimized for all devices) Security & Compliance: -Secure user data storage (GDPR/CCPA compliance) - SSL certification and best practices for web security - Payment gateway security (PCI compliance) Performance Optimiz...
I'm seeking a professional to scrape my WordPress website for 1100 entries related to our different offices. The data needs to be exported into an Excel file, without any specific filters or sorting. In addition to data scraping, I need a thorough code review of my WordPress site. This should encompass: - Documentation and review of custom code - Optimization where necessary - Plugin review for updates - Recommendations for optimization This project requires a deep understanding of PHP, as well as experience with WordPress and data scraping. The ideal freelancer will have a strong background in website code review and optimization.
We have a python app that uses GPT API running on a local machine using local GPUs. The front end is single screen PyQT5. We now need to scale this to a web service running on , converting the PyQT5 UI to Gradio for the UI/orchestration layer so we can run batches on multiple instances and easily scale GPU and CPU resources as needed. We've scoped this initial deployment at about 80 hours for a developer with these proven skills (modal and gradio), with future work to continue based on performance. Our app batch uses batch downloaded docs. via API, parses and uses LLM to generate a docx report and set of .csv files. Analyzed content is based in the biosciences area and in future phase we'll be adding functionality to analyze bio-sequences using Blast (supported on ). Expe...
We have 11,000 manufacturer SKU's that we would like to do price comparison across 10 different ecommerce websites. 100% accuracy is a must. 5 star freelancers only apply.
...number of stories, and the size of the lot for each property. Determine if the property is located on a wide street. Excel Integration: Ensure that all extracted data is neatly organized and formatted for easy access within Excel. Provide clear, user-friendly functionality to paste or upload listings and automatically trigger the data extraction process. Skills Required: Strong experience with web scraping or API integration to pull data from Zillow, Redfin, StreetEasy, and other platforms. Proficiency in Excel automation, preferably with VBA or Python (pandas, openpyxl) to integrate the data extraction functionality. Familiarity with Zola NYC and NYC Open Portal to access zoning and building-related data. Knowledge of real estate terminologies and zoning regulations in ...
I'm in need of a skilled web scraper and automation expert to assist with a unique project. The task involves scraping phone numbers from a specific directory site. The project requires: - Proficient skills in web scraping, specifically targeting directory sites. - Experience with automation, particularly sending messages via WhatsApp. - Ability to create a system that triggers a WhatsApp message whenever a new phone number is detected. The ideal candidate would have a keen eye for detail, understand the importance of data privacy, and be able to deliver a seamless, efficient system.
I'm looking for a proficient web scraping expert skilled in Javascript, Node.js, and Python. Your main tasks will include: - Scraping profile information from various social media platforms - Data mining from Shopify Ideal candidates should be well-versed in data extraction techniques, have a keen eye for detail and able to handle large datasets.
Request for Proposals: OpenSouq-Like Website Development Hello, I am seeking experienced developers or a professional team to create a fully functional website identical to OpenSouq in terms of features and design. Key Requirements: Core Website Features: User account registration (individuals and businesses). Classified ads system organized by categories (Real Estate, Cars, Jobs, etc.). Advanced internal search engine with various filters. User dashboards to manage ads and updates. Rating and review system for users and sellers. UI/UX Design: Responsive and attractive design compatible with all devices (Desktop and Mobile). Simplified and user-friendly navigation. Mobile Applications Development: Fully integrated mobile apps for iOS and Android. Features such as push notificat...
...several issues that need to be addressed urgently. These include: - Lack of Automated Deployment - Lack of Automated Unit Tests - Lack of Dedicated Environments/Servers - Lack of 3-Tier Architecture - Unprotected Server Access (SSH) - Obsolete Server Operating System - Lack of Log Rotation - Presence of Personal Data in Log Files - Non-Encryption of Personal/Sensitive Data in the Database - Cron Jobs Run from the Same Server - Lack of "GitIgnore" File - Lack of code documentation - No Git History of the Code - Presence of Hardcoded Variables in the Code - Presence of Secrets/Sensitive Information in the GitHub Repository - Showcase Website Integrated into the Platform - Presence of Variables in Multiple Locations in the Code - Security of User Accounts - User Account C...
I'm seeking a developer who can create different micro bots for me. The main purpose of these bots will be to automate various actions, primarily data scraping tasks. Key Responsibilities: - Develop around 5 bots each month, focusing on web scraping and APIs data extraction. - Ensure long-term, reliable performance of the bots. - Adapt to potential new tasks and requirements over time. Ideal Skills and Experience: - Proficiency in Python and AI technologies. - Strong experience in creating micro bots for data scraping. - Ability to understand and adapt to different data sources. Please note, the specific websites or APIs to scrape data from will be discussed and decided together. I'm looking for a long-term collaboration, so reliability and adaptabi...
I am looking to extract product information from a website into an Excel sheet. I just need the product name, description, and price from the product listings on the site. Please let me know if you're experienced with web scraping and can finish this task. I just need an Excel Sheet and not a tool. Thank you!
...Creation: Workers should be able to create detailed profiles showcasing their skills, experience, and availability. - Job Notifications: The app should send notifications about relevant job opportunities based on the worker's profile and location. - Skill Verification: There should be a feature for skill verification to ensure that workers' claimed skills are validated. Key features for clients: - Post Jobs: Clients should be able to easily post job listings. - View Worker Profiles: Clients should have the ability to browse and view workers' profiles. - Rate Workers: After a job is completed, clients should be able to rate workers based on their performance. Ideal skills for this project include Android app development, backend server management, UI/UX design, an...
I'm looking for a web scraping expert who can extract data on clothing products from various ecommerce platforms. Ideal skills: - Proficiency in web scraping tools and software - Experience with ecommerce platforms - Understanding of data analysis The scope of the project includes: - Scraping clothing items' data - Providing insights and trends from the scraped data
...looking for an experienced developer to enhance an existing desktop application. The primary focus will be on implementing printer load balancing and improving system communication. The application is partially developed, and additional features need to be integrated. Responsibilities: Implement printer load balancing: Assign specific printers for black-and-white or color jobs. Reroute print jobs to available printers based on defined conditions. Develop and enhance communication between the application and external systems. Refine and optimize existing workflows for better performance. Add additional features as needed during development. Ensure the software is efficient, scalable, and user-friendly. Requirements: Strong expertise in and Node.js. Proficiency in JavaS...
...Integration:** - Integrate with the **Dhan API** or other relevant financial APIs. - Develop and manage API calls to retrieve real-time stock, option chain, and index data. - **Data Handling:** - Write scripts or software to format and store the fetched data appropriately. - Ensure data is saved in preferred formats such as CSV, JSON, or directly into databases. - **Automation:** - Set up cron jobs or schedulers to automate the data fetching process. - Ensure regular updates and timely retrieval of data. - **Data Storage:** - Store fetched data in local storage or cloud storage solutions (e.g., AWS S3, Google Cloud Storage). - Utilize databases (e.g., MySQL, MongoDB) for efficient data management and easy access. - **Logging and Monitoring:** - Implement log...
I'm looking for a freelancer to help me with extracting data from a website. The data is spread across different web pages, and I need it to be exported into separate Word documents for each page. Only bid if you can do the job. Data to Extract: - Text content - Images (to be saved in JPEG format) all in one document each Document Organization: - Each Word document should have separate sections for text and images. Ideal Skills and Experience: - Prior experience with web scraping. - Proficiency in creating and formatting Word documents. - Attention to detail for data accuracy and organization.
I need a scraping expert to debug my Python script that's supposed to be fetching financial data from APIs. Currently, the script is failing to retrieve some data. Ideal Skills and Experience: - Proficient in Python and data scraping - Experienced with financial data APIs - Strong debugging skills - Knowledge of data parsing and handling - familiar with yahoo finance data
I'm seeking a freelancer to compile a detailed, monthly updated database of USA credit cards for a public website or app. Key Requirements: - image of the card. - Information on Interest Rates and Fees: Understand and gather data concerning the cost of owning the card...or app. Key Requirements: - image of the card. - Information on Interest Rates and Fees: Understand and gather data concerning the cost of owning the card. - Rewards and Benefits: Identify the perks associated with each card including cash back, travel points, etc. - Eligibility Requirements: Document what is needed to qualify for each credit card. Ideal Skills: - web scraping, cleaning and storing data - Familiarity with web/app data requirements Please note: This project will require a com...
I need a skilled web scraper who can extract data from a members area of a website. The data should be compiled and delivered in an Excel file. Website Scraping of Members Area Ideal Skills: - Web scraping expertise - Proficiency in Excel - Attention to detail
...similar to an attachment I will provide (). Script 1: Download stock prices (for a year - Download Historical ) and dividend data (for a year) for a given stock Script 2: save data to a single-sheet Excel file Script 3: Create a chart in the Excel file The ideal freelancer for this project should have: - Extensive experience with Python, particularly with libraries for web scraping and data analysis. - Proficiency in creating and manipulating Excel files with Python. - Skills in data visualization, particularly in creating line graphs. Please provide examples of similar projects you have completed in your bid. Sample data: Historical quotes: Dividend data: https://www
I'm in need of a skilled programmer who can create an independent bot for me....independent bot for me. The bot's main task will be to retrieve certain information from a secure website. Key Requirements: - The bot should be able to log into the site with provided credentials. - It should collect specific user data, particularly user activity and user messages. Ideal Skills: - Proficiency in programming languages such as Python, Java, or similar. - Prior experience in web scraping and bot development. - Understanding of data security and ethical considerations in data retrieval. - Ability to deliver a reliable, efficient, and independent bot. Please note: The target website is secure and requires login credentials. The successful freelancer will be given the ne...
...according to date i.e. I would like to input a date range and sport (soccer) and get the match details for those matches. Further details will be discussed with bidder. I should also mention that date range for scrapping data could be quite long (i.e. months) so the output xls could be quite big. It is very important to me that scraping is done as quickly as possible (seconds) with as less clicks as possible and without hanging-up or crippling my PC while scraping. PROJECT DETAILS: Sport:----------------------Football Bookmaker:------------------Bet365, BWIN, Pame Stoixima, Stoiximan, Interwetten, Novibet, William Hill Seasons:--------------------FROM 2000 and be continue for lifetime (Be automatically updated with all the events that have ended and with all the events...
I'm looking for an expert in AI tools to scrape a website for me. The goal is to extract specific contact information and organise it neatly in an Excel sheet. Data to be Scraped: - Email addresses - Phone numbers - Names - Zip Codes The ideal candidate should have prior experience in web scraping and data management. Proficiency in using AI tools for this task is crucial. Data Formatting: - I need the data to be sorted into separate sheets for each type of information. Please provide examples of previous similar tasks you have completed successfully.
I'm seeking a proactive recruiter to assist me in finding and applying for mid-level automated testing QA jobs. Key Responsibilities: - Search for mid-level automated testing QA jobs - Tailor my skills to match each job requirement - Submit applications on my behalf - Handle recruiter calls and arrange interviews The ideal candidate will have: - A strong understanding of automated testing - Experience in recruiting for QA positions - Excellent communication skills
