Web scraping job python jobs

I'm looking for a data entry specialist to collect email addresses from a specific website. The site has 480 pages, and there are 10 companies per page. What You Need ...addresses from a specific website. The site has 480 pages, and there are 10 companies per page. What You Need to Do: - Navigate through the 480 pages and 10 companies per page. - Collect email addresses and input them into an Excel file. - Format: One email per cell. Ideal Skills and Experience: - Proficient in Excel. - Good attention to detail. - Previous experience in data collection or web scraping is a bonus. Please note, I only require the email addresses, not any additional information.

We are seeking a skilled developer to create an AI form filler capable of navigating a list of URLs, identifying contact forms, and autonomously filling them out and submitting the data. The solution should be efficient, reliable, and easy to integrate with existing systems. Familiarity with web scraping and AI technologies is essential. If you have a proven track record in developing similar applications, we would love to hear from you.

...Options**: - Ability to change the website's language (optional, depending on the target market). --- #### 4. Proposed Technologies 1. **Frontend**: - HTML5, CSS3, and JavaScript. - Frameworks like React or Vue.js to enhance the user experience. 2. **Backend**: - Node.js with Express or Django (Python). - RESTful API for frontend and backend interconnection. 3. **Database**: - MySQL, PostgreSQL, or MongoDB (depending on needs). 4. **Hosting**: - Amazon Web Services (AWS), Google Cloud, or services like Vercel for frontend. 5. **Payment Platforms**: - Integration with Stripe, PayPal, or similar platforms. --- #### 5. Interface Customization 1. **Visual Design**: - Use of corporate colors and company logo. - Smooth animations for ...

...developer or team to create a custom search engine from scratch. The goal is to build a fully functional search engine that operates independently, without relying on any third-party APIs (e.g., Google, DuckDuckGo, or Bing). In addition, the system will include a robust Web Crawler and Indexing System, along with an Admin Panel to manage the entire process. This project will involve developing a crawler, setting up an indexing system, and building an admin panel to control, monitor, and optimize the search engine. Key Requirements: 1. Web Crawler Development: • Purpose: Develop a custom crawler to scrape and collect data from websites. • Details: The crawler should follow rules and efficiently crawl multiple websites, handling large-scale data. • Features: ...

Job Title: Software Developer Intern (Automation & Web Scraping) Location: Remote About Us: We are a dynamic tech company dedicated to building innovative solutions for data processing and automation. We are looking for a motivated Software Developer Intern who is passionate about web automation and data scraping to join our team. This is an exciting opportunity to work on real-world projects and gain hands-on experience in the tech industry. Role Overview: As a Software Developer Intern, you will be responsible for developing automation tools that can scrape data from websites using available APIs. You will be working with modern technologies like Postman, Selenium, Python, and various automation techniques to build solutions that streamlin...

...NLP and transformers to build an intelligent Interview Reminder Scheduling System that streamlines communication between recruiters and candidates. By utilizing state-of-the-art transformer models, the system will automate the process of scheduling, sending reminders, and handling candidate responses effectively. NLLP Framework: Hugging Face Transformers (e.g., BERT, T5, or GPT models). Backend: Python (FastAPI/Flask/Django). Frontend: React.js or Angular for user-friendly interaction. Database: PostgreSQL, MongoDB, or DynamoDB for candidate data. APIs: Twilio (SMS/WhatsApp), SendGrid (Email), or Google Calendar for integration. Deliverables: A fully functional system capable of intelligent interview reminder management. NLP-powered automated workflows for extracting and process...

...help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation. Current Situation: I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached). The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable. What I Need: A robust and reliable solution for faster and more efficient scraping without interruptions. The ability to download HTML files in the required structure. Ideally, transitioning to a Python-based ...

I'm looking for someone to post a job listing for a full-time entry-level position in the technology industry on LinkedIn. Skills and Experience Required: - Understanding of LinkedIn's job posting interface - Familiarity with the technology industry - Ability to write clear and engaging job descriptions - Understanding of entry-level job requirements and qualifications - Experience with LinkedIn and social media job postings

I'm seeking a LinkedIn expert to assist in creating job posts for high-level positions. These job posts will target Chief Level, SVP Level, Director Level, and Head Level roles across a variety of industries including Technology, Finance, and Healthcare. Key Responsibilities: - Crafting engaging and appealing job posts on LinkedIn that attract high-level executives - Understanding the nuances of different industries to tailor posts accordingly - Knowledge of LinkedIn's best practices for job postings Ideal Skills: - Proven experience with LinkedIn job postings - Excellent copywriting skills - Familiarity with various industries - Understanding of high-level executive roles

I'm seeking a professional to automate my day trading strategy using the Interactive Brokers (IB) Trader Workstation (TWS) API. Key Requirements: - Expertise in Python programming language - In-depth knowledge of day trading strategies - Experience with IB TWS API - Ability to develop an automated system that can: - Execute trades based on predefined signals - Monitor and manage open positions - Generate trade alerts and reports Please provide examples of similar projects you've completed in the past.

I need an AI model built in Python using machine learning model such as randonforestcalssifier adversarial variation , designed to analyze daily variances of a user activity metric score from a time series data set. The model should alert me whenever today's variance surpasses a specified threshold such as an AUC score.. This threshold will be determined during the model's training phase. The project also requires a forecasting component. Key Requirements: - Extensive experience in Python and AI model development. - Proficiency in time series analysis. - Ability to create a forecasting component within the model. - Experience working with user activity data is a plus. - Skills in setting up alert systems based on model outputs. Please, bid only if you are confide...

More details: What type of logo design do you need? Combination of both What style do you prefer for the logo? Classic What kind of NFTs are you interested in creating? Animated and effective.

...looking for an experienced freelancer who can help me train a deep learning model on my Jetson Orin AGX with Jetpack 6.2 and Deepstream 7.1. The goal is to detect garbage in my garden using a USB camera. Your tasks will include: - Creating and configuring C++ and Python examples for the detection of garbage - Utilizing CUDA for optimized processing - Providing guidance on machine configuration for optimal performance Ideal skills for this project include: - Extensive experience with NVIDIA Jetson platforms - Proficiency in C++ and Python, particularly in the context of Deepstream and Jetson - Familiarity with garbage detection models - Experience in configuring and optimizing machine performance This project requires a keen understanding of AI and deep learning, speci...

I'm in search of a professional who specializes in connecting international job seekers with companies that offer visa sponsorship. This professional should be well-versed in labor market trends, particularly in countries experiencing labor shortages, and can guide me through the entire process. Key Requirements: - Expertise in the Healthcare industry - Knowledge of job markets in the United States, Canada, Australia, United Kingdom, New Zealand, and Europe - Skills in job matching with companies - Guidance on necessary documents - Assistance with the visa sponsorship process

Are you data entry organized, detail-oriented, and looking for a flexible work arrangement? We are seeking virtual assistants from around the world to support various tasks for businesses and entrepreneurs. This part-time position allows you to work from anywhere while providing essential administrative assistances now

We are seeking an experienced programmer to automat...Entry Conditions: - A red candle is detected; execute Sell trade at market price after candle close. - Check difference: Close Price minus High Price <= 3 points. - Stop Loss: Set at 3 points. - Trailing Stop Loss: Based on the highest price of the previous candle. Additional Conditions: - If a Buy position is active, do not execute Sell trades, and vice versa. Ideal Candidate: - Expertise in Python programming and strategy automation using Tradetrone or similar platforms. - Proven history of successful deployment for short-term trading strategies in cryptocurrency markets, especially BTC. We look forward to reviewing bidders with relevant portfolios and demonstrable experience. Please indicate your availability and estima...

I'm looking for an expert with a strong background in algo trading to help me build a trend-foll...strong background in algo trading to help me build a trend-following trading strategy for BTC in Delta exchenge. This strategy should be tailored for short-term trades. Key Tasks: - Develop a trend-following trading strategy using Tradetrone or paythan. - The strategy will be applied to BTC on delta exchange. - The focus will be on short-term trading. Ideal Skills: - Extensive experience in Python programming. - Proven track record in developing algo trading strategies. - Deep understanding of index options and trend-following strategies. - Ability to create strategies for short-term trading. Please only bid if you can demonstrate relevant experience and have a portfolio of si...

Job Title: Develop a Workflow for Scraping Global Mosque & Muslim-Based NGO Data with Detailed Documentation ________________________________________ Job Description: I am looking for a skilled automation expert to build a workflow that scrapes Google for global contact details of mosques and Muslim-based NGOs. The workflow must allow for targeted searches by category (e.g., society, charity, non-profit) and be optimized for credit efficiency in Make.com. The final system should produce structured data outputs and include clear, beginner-friendly documentation. ________________________________________ Scope of Work: 1. Automation Workflow: 1) Build a workflow to scrape Google for the following details: a. Organization Information: i. Organization Name ii. Organi...

...developer or team to create a custom search engine from scratch. The goal is to build a fully functional search engine that operates independently, without relying on any third-party APIs (e.g., Google, DuckDuckGo, or Bing). In addition, the system will include a robust Web Crawler and Indexing System, along with an Admin Panel to manage the entire process. This project will involve developing a crawler, setting up an indexing system, and building an admin panel to control, monitor, and optimize the search engine. Key Requirements: 1. Web Crawler Development: • Purpose: Develop a custom crawler to scrape and collect data from websites. • Details: The crawler should follow rules and efficiently crawl multiple websites, handling large-scale data. • Features: ...

Hello, I have experience in Python, web scraping, and data extraction using tools like Scrapy, Pandas, and Selenium. I can quickly debug your script and ensure it meets all your requirements. Here’s how I plan to help you: 1. Fix bugs in your script within 2-3 hours. 2. Add functionality to match conditions and extract data as per your requirements. 3. Provide an easy-to-use script for future use. I will deliver the output in the required Excel format. Looking forward to your response so we can start immediately! Budget: $8 (as per your project description). Timeframe: First phase within 2-3 hours. Thank you,

I'm looking for a comprehensive database of 10,000 active job seekers with a focus on entry-level & mid-level Software Development skills. Requirements: - Job seekers should be looking for job in IT field. - Database should include first name, last name, email, and phone number. Please note, the job seekers must be currently seeking IT roles.

I'm looking for a Python script, or a similar tool, that can, FOR EXAMPLE, take a photo from a source like Airbnb and transform it into a unique piece of content. The goal is to ensure that the altered photo cannot be found using Google Image or any other image search engine. IMPORTANT: The photo must remain the same, visualy. Maybe with a few small changes Key Features: - The script should incorporate multiple methods of alteration, including changing pixels, adding noise, and modifying the canvas size. - The new canvas size should either be the same as the original or larger. - The tool should have the capability to perform a variety of pixel changes, such as color adjustments, blurring, and random pixel shifts. Ideal Skills: - Proficiency in Python or equivalent p...

# Job Title: Submit Job Applications on Job portals using my Resume # Job Description: I am looking for a reliable freelancer to submit job applications on my behalf using my resume on various platforms, like Linkedin, Workday and Indeed. Your task will involve searching for relevant job postings that match my qualifications, and submitting my resume for each opportunity. # Responsibilities: - Search for job postings on Linkedin, Glassdoor, Workday and Indeed that match my experience and skills. - Submit my resume to the job listings - Ensure each application is relevant to my background and experience. - Track and report the total number of applications submitted using MS Excel or Google Sheets # Requirements: - Strong attention t...

I'm looking for a skilled web scraper with API development experience. The task involves extracting product information from three specific websites. Key Requirements: - Extract product descriptions from specified websites - Develop an API to facilitate this - Present data in a user-friendly JSON format Ideal Skills: - Strong background in web scraping techniques - Proven experience with API development - Attention to detail - Ability to work independently If you've successfully completed similar projects in the past, I would love to hear from you!

I'm seeking a professional to help me fill out online job applications on LinkedIn. The ideal freelancer would be able to assist with completing my profile information and optimizing keywords to increase my visibility and chances of getting noticed by potential employers. Skills and Experience: - Expertise in LinkedIn platform - Experience in job application processes - Excellent knowledge in SEO and keyword optimization - Strong understanding of professional profile requirements - Resume and cover letter writing skills are a plus

I'm seeking a fresh Python backend developer with a focus on API development, specifically RESTful APIs. The primary task will be implementing user authentication within these APIs. Ideal Skills: - Proficiency in Python - Basic understanding of RESTful APIs - Experience with implementing user authentication This is a perfect opportunity for a recent graduate or someone looking to gain practical experience in the field. I am open to mentoring and guiding the right candidate.

...build a Removalist App to Minimum Viable Product (MVP) standards. The project entails creating an app with essential features for both customers and removalist staff. Key Features: - A comprehensive booking system that allows customers to schedule their removal services via a step-by-step form - Think Uber for Removalists - Real-time tracking functionality for monitoring removalists during the job. - A secure and efficient payment processing system. Ideal Skills & Experience: - Proven track record in mobile app development, preferably with experience in creating service-based applications. - Strong understanding of user interface design, ensuring the app is easy to navigate for both customers and staff. - Expertise in implementing secure payment systems and real-time track...

...seeking a talented eLearning trainer to help build high-quality tech-related courses for my YouTube channel. You will be provided with a company logo and instructions, and your task will be to create engaging videos for each topic in selected technologies. Technologies to cover: - React JS - Javascript Object Oriented - Data Science and Machine Learning - Next JS - Design - Photoshop - .Net Core - Python - DevOps Requirements: - Create high-quality videos with excellent sound - Use a clear, globally understandable accent - No face showing required Payment: Maximum of 1000 INR per video Ideal Skills and Experience: - Previous experience in eLearning course creation - Proficiency in the mentioned technologies - High-quality video production skills - Clear and understandable acc...

I'm seeking an expert to optimize my LinkedIn profile. The main objective is to attract recruiters. The ideal candidate should have a strong understanding of LinkedIn's algorithm and best practices for profile optimization. Prior experience in career consultancy or recruiting is a plus.

We operate a job portal, , built on PHP and SQL. Our goal is to extend our reach by linking job posts with prominent job websites like Indeed and LinkedIn, and possibly others like , Monster Jobs, TimesJobs, etc. Key Requirements: - Real-time synchronization of job postings across platforms - Integration of an Application Tracking System (ATS) We already have accounts set up on both Indeed and LinkedIn. The ideal candidate for this project would be someone with substantial experience in job portal integration, preferably with knowledge of implementing an ATS. Please provide your most competitive quote.

I'm seeking a freelancer who can provide me with a daily supply of up to 30K email addresses of individuals aged between 50 and 60 in the USA. The primary purpose of this email database will be for marketing campaigns, so the emails should be valid and ideally have a history of engagement with similar campaigns. Skills and Experience Required: - Data mining and web scraping - Experience with email list building - Understanding of demographic targeting - Knowledge of email marketing standards Please note, the lists need to be delivered daily, and must be of high quality to ensure maximum deliverability and engagement.

I'm seeking a backend engineer skilled in Python, and data preparation activity for ML. Key Responsibilities: - Collaborate in the design and development of a robust, efficient, and secure RESTful API. - Implement best practices in API development for scalability and maintainability. Ideal Skills: - Proficient in Pytho - Proven track record in RESTful API development. - Strong understanding of backend engineering principles. - Excellent problem-solving and communication skills.

...Fully functional software that integrates all specified features. 2. Detailed installation and setup guide, including dependencies and configuration instructions. 3. Basic user manual for operation and troubleshooting. 4. Source code with comments for future modifications. Preferred Skills and Experience: • Experience with Raspberry Pi development (especially Raspberry Pi 5). • Proficiency in Python, OpenCV, and AI/ML frameworks (e.g., TensorFlow, PyTorch). • Familiarity with video editing libraries like FFmpeg or OpenCProject Brief for Software Engineer • Expertise in real-time image and video processing. • Knowledge of integrating sensors (motion detection, pressure mats) with Raspberry Pi GPIO. Timeline: • Initial prototype: 2 weeks &bul...

I'm in need of a Python developer to improve my Whisper script. The project involves: - Upgrading the current script to include better UI elements using PyQt - Implementing some new file processing functions The UI should be compatible with a desktop application. Ideal skills for this project include: - Proficiency in Python, with a focus on desktop application development - Extensive experience with PyQt - Strong skills in file processing programming - Previous experience enhancing scripts for improved functionality and user interface Please provide examples of similar projects you've completed in your bid.

I am seeking an experienced DevOps and QA professional who can implement a robust CI/CD pipeline and comprehensive QA testing for my GitHub repository. This repository contains code written in JavaScript, Python, and Java. Key Responsibilities: - Set up a seamless CI/CD pipeline utilizing GitHub Actions or similar tools. - Develop and implement unit tests, integration tests, and end-to-end tests. - Ensure the code is thoroughly tested and ready for deployment. Ideal Skills: - Proficient in JavaScript, Python, and Java. - Extensive experience with GitHub and CI/CD tools. - Strong understanding of different testing methodologies. - Previous experience with setting up CI/CD and QA for multi-language repositories will be highly regarded.

Host My already API based Python website you have to rehost on vps server like hostinger

I'm looking for a skilled Python developer to create a simple web automation script for me.

I'm in need of a Python backend developer, preferably a fresher, with a focus on API development and database management. The project will primarily involve working with SQL databases and leveraging the Django framework. Key Responsibilities: - API Development: Building, testing, and maintaining APIs to support various applications and services. - Database Management: Overseeing the interaction with our SQL databases, ensuring data integrity and optimizing performance. Ideal Skills: - Proficiency in Python, particularly in a backend context. - Familiarity with SQL databases, including basic query writing and database design. - Prior experience or knowledge of the Django framework. - Understanding of API structures and principles. This is a great opportunity for a fres...

I need an expert in Python and server management to rehost my existing API-based Python website on a VPS server. Key Responsibilities: - Rehost the website on a Linux-based VPS server - Ensure all APIs are functioning correctly post-migration - Optimize server settings for best performance Ideal Skills: - Strong Python programming skills - Extensive experience with VPS server management - Familiarity with API-based applications - Problem-solving skills to troubleshoot any issues that arise during rehosting Please note, the details about the VPS server and the code repository have not been finalized yet. Flexibility and readiness to assist with these aspects would be advantageous.

...so/view/6ab47d62-e916-4605-a0f6-58d9d17a481a?utm_medium=share Job Posting: YouTube Caption Extraction Bot Developer Position Overview: Looking for a Python developer to create a YouTube channel caption extraction bot with specific requirements for handling large-scale video processing. Project Requirements: Create a bot that processes YouTube channel video pages (e.g., @TheCookingFoodie/videos) Core Functionalities: Process all videos from a channel's video page Extract and save: Video titles Video URLs Closed captions (CC) Save data in text files named after each video Process videos chronologically (oldest to newest) Handle 1000-2000 videos per channel Technical Specifications: Language: Python Implementation using Python requests or YouTube-specific...

I need a skilled Python developer to create a web scraper for me. The scraper should be able to extract structured data, like tables, from various e-commerce websites. The project requires a deep understanding of web scraping techniques and best practices in Python.

I'm looking for a Python-based email validation checker that can efficiently check millions of email addresses against the Kucoin sign-up page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the load of millions of checks with a budget of $200 worth of proxies. - Store results: The checker should store the results of the email validation in a file. The output format for the results file should be TXT. Ideal candidates for this project would be those with extensive experience in Python, web scraping, and proxy handling. A deep understanding of email validation and experience working with cryptocurrency exchange websites would be a significant plus.

Please Sign Up or Login to see details.

...developer with a strong background in Solana and Raydium development to assist with a specific project. I have Python code that interacts with Uniswap (Ethereum) for minting and managing LP positions, swaps, and more. I’m looking to replicate this functionality for Raydium on Solana. Key Requirements: - Proven experience integrating systems with Solana using Python. - In-depth knowledge of Raydium, including crypto token minting and liquidity provision processes. - Strong understanding of transaction speed optimization and security best practices within the Solana ecosystem. Project Scope: - Develop a Python function to mint an LP position on Raydium. I will provide existing Python code for Uniswap as a reference. - Document the key distinctions betwe...

...scripting and real-time control adjustments. Required Expertise: 1. ROV Control Systems: • Proficiency in developing control algorithms for stabilization (pitch, yaw, roll). • Experience with PID tuning for underwater robotics. 2. ArduSub Firmware Development: • Strong understanding of ArduSub, MAVLink, and Blue Robotics hardware. 3. Programming and Algorithm Design: • Proficiency in Python and C++ for control systems and dynamic parameter adjustments. 4. Simulation and Testing: • Experience with underwater robotics simulators (e.g., Gazebo or SITL) for testing and validation. 5. Hardware Integration: • Familiarity with joystick controllers and peripheral integration using Raspberry Pi. What We Provide: • Detailed R...

I'm looking for an expert in Natural Language Processing to help me build and train a T5 language model on a dataset of text documents. Key Requirements: - Expertise in building and training T5 models. - Proficiency in handling and processing text documents for model training. - Strong understanding of Natural Language Processing techniques and methodologies. Skills: - Python - Tensorflow/PyTorch - NLP techniques - Data preprocessing Ideal for those with experience in similar projects. No immediate deadline, but I would appreciate timely updates and progress reports.

...e-learning integration with existing LMS platforms. 4. Customizable dashboards with advanced analytics for all user roles. 5. Integration with biometric systems for attendance tracking. 6. Multi-school administration with consolidated reporting. ________________________________________ Technology Stack: Frontend: 1. React.js Backend: 1. NestJS (Node.js Framework) 2. Python (for AI/ML modules) Database: 1. PostgreSQL Hosting: 1. AWS (Amazon Web Services) Payment Gateways: 1. Paypal SMS Gateway: 1. Twilio ________________________________________ Development Roadmap: Phase 1: MVP Development: 1. Define system architecture and database normalization. 2. Develop core features: user management, role-based access, and student/staff management. 3. Implement multi-school administra...

...automate this process using Python scripts. The goal is to centralize the data for better analysis and set up a structure in BigQuery that is organized and scalable for future use. I will provide access to BigQuery so the freelancer can set up datasets and organize the data directly within the platform. Scope of Work: Data Extraction and Transformation: - Extract data from SQL tables (e.g., inventory, item details, sales history) based on specific fields and filters - Ensure data is cleaned and formatted for smooth loading into BigQuery. BigQuery Setup and Organization: - Access BigQuery to set up and structure datasets (e.g., inventory_data, sales_data, item_details). -Ensure the datasets are organized and optimized for analytics. Python Automation: Develop Python...

I need an “AI” that can generate realistic images. The data scrapper should be capable of scraping the entire internet to gather unique details and use random generation to create distinct images. I want the AI to output a variety of image types, including portraits, landscapes, and abstract art. Ideal skills for this job include: - Experience in machine learning - Proficiency in data scraping - Knowledge in image generation - Familiarity with different art styles - Skills in random generation algorithms

I need help computing the realized covariance matrix based on daily returns of exchange rates following the same methodology as in a paper (Pricing currency risks, Journal of Finance). I already have a code which does the computation but somehow I don't get the same values (but I get the same shape) [see details in the attached .ipynb file]. I provide all the data needed. Just need someone...already have a code which does the computation but somehow I don't get the same values (but I get the same shape) [see details in the attached .ipynb file]. I provide all the data needed. Just need someone to go over my code and try to get the correct Covariance Matrices. Ideal Skills: - Proficient in statistical analysis - Experienced with time series data - Familiar with finance and econo...