Web scraping job python jobs

Description: We are looking for an experienced Python & Selenium Developer to join our team full-time. The ideal candidate will have a strong background in web scraping and web development, with proficiency in various Python libraries and frameworks such as BeautifulSoup, Requests, Scrapy, and Selenium WebDriver. Responsibilities: -- Build and maintain automated web scraping solutions using Python and Selenium. -- Scrape data from websites and efficiently process it. -- Develop and integrate databases with frontend applications. -- Work closely with the frontend team to ensure seamless integration and functionality. -- Collaborate in building and maintaining the business’s web-based systems. -- Work on web dev...

I have two scripts on a Linux instance that should be generating an article and posting three times a week on my standard WordPress site. However, they are not posting articles as scheduled. The content should include text with images. Ideal skills for the job: - Experience with Python - Experience with WordPress and Linux - Proficient in troubleshooting and debugging scripts - Familiar with automating tasks in WordPress

I'm in need of a Python expert who can help scrape data from various E-commerce websites. The primary focus will be on gathering product details and pricing information on a weekly basis. Key responsibilities: - Scrape product details and pricing information from E-commerce websites - Perform this data extraction on a weekly schedule Ideal skills: - Proficiency in Python and web scraping tools - Experience with data extraction from E-commerce websites - Ability to work on a consistent schedule

I'm looking for a professional who can help me build a database by scraping sales data from a password protected website. I attached an example. I need the dashboard to self populate with the data that is held in the "Clearview" and "TimInsights" tabs. The data in both of these tabs need to be screen scraped from it's respective websites. Once the data is created, i want it to be able to create automated powerpoint presentation with respective data. Key Requirements: - Proficient in screen scraping techniques - Experience with building and managing databases - Ability to handle data from password protected sites I have the necessary login credentials for the website. The data needs to be scraped on a weekly basis. Please reach out if you have ...

I need a Python-based web scraper to collect comprehensive product information from various Australian websites including , , , , and davidjones.com.au. The specific data points I need include: - Product names and prices - Product descriptions and reviews - Product availability and stock levels - Images The scraped data should be delivered in a JSON format on a daily basis. Ideal skills and experience for this project: - Proficiency in Python, particularly in web scraping libraries such as BeautifulSoup and Scrapy - Experience in scraping e-commerce sites - Knowledge of JSON and data structuring - Ability to set up a daily automated scraping task Please provide examples of similar projects you've completed in your proposal.

I'm in need of a skilled web developer who can build a business websites for me. The primary focus of the site will be to promote and represent businesses online. Key Responsibilities: - Create a business-oriented site - Ensure the site is tailored for effective business promotion - Incorporate elements suitable for personal branding and information sharing Ideal Skills: - Proficient in web development languages (HTML, CSS, Python, JavaScript, etc.) - Understanding of SEO and online marketing strategies By the way I don't need you as a one time freelancer. I am looking for a web developer who can work for me full time. Salary will be negotiated

I am looking for an expert in Django, Python, and Google Sheets API to help automate some tasks. Key Requirements: - Task Automation: Primarily focusing on automating data processing tasks. - Data Transformation & Formatting: This will involve manipulating data into a suitable format for analysis. - Develop an automation script using Python   - Utilize the Google Sheets API to synchronize data for our Django website  Ideal Skills:  - Proficient in Python   - Extensive experience with the Google Sheets API  - Strong background in automation and scripting  - Understanding of data synchronization processes  - Skill in Django is bonus  Ideal Skills: - Proficiency in Django and Python: Essential for creatin...

To scrape Plumbers, Electricians, HVAC or Air-Conditioning, Roofers, Mechanics and Locksmiths contacts from yellow pages across below states Sydney Melbourne Brisbane Perth Adelaide Gold Coast Newcastle Canberra Wollongong Sunshine Coast Greater Hobart Townsville Geelong Cairns Toowoomba Darwin Launceston Albury-Wodonga

My Python script, primarily designed for automation, is not yielding the correct outputs. I need an experienced Python developer to help me troubleshoot and enhance the script. Key Issues: - The script currently outputs incorrect data. I need someone who can identify the root cause of this issue and fix it. Ideal Skills: - Proficient in Python with a strong background in automation scripts. - Experience in debugging and enhancing existing code. - Excellent problem-solving skills to identify and rectify data output issues.

I'm seeking an experienced developer to migrate my CodeIgniter-based PHP web application to Python. This project is critical and needs careful planning and execution to ensure a smooth transition without compromising on key aspects of the application. Key Considerations: - User Interface and Experience: The look and feel of the application should remain unchanged. The developer should have a keen eye for detail and be able to replicate the UI/UX in Python. - Security Features: The migration should not expose the application to any new vulnerabilities. A deep understanding of security principles in both PHP and Python is required. - Performance and Speed: The new Python application should match or exceed the performance of the existing PHP applicati...

I'm in need of a skilled developer to scrape phone numbers from www.yellowpages.com.au. The data should be categorized into Plumbers, Electricians, HVAC companies, Roofers, and other trades. Key Requirements: - Delivering the data in an Excel spreadsheet - Includ...scrape phone numbers from www.yellowpages.com.au. The data should be categorized into Plumbers, Electricians, HVAC companies, Roofers, and other trades. Key Requirements: - Delivering the data in an Excel spreadsheet - Including the Company name and Website URL along with the phone numbers - Formatting the phone numbers in International format for easy dialing Ideal Skills: - Proficient in web scraping and data collection - Experienced in using Excel for data organization - Knowledgeable in categorizing t...

...Payment Gateway: ◦ Need Modular and Multi Vendor Support for Payment Gateway ◦ Secure integration for deposits and withdrawals. ◦ Withdrawal processing time of 1-2 days. 4. Security: ◦ Grace period of 30 days for new funds (security buffer). ◦ Bank account linkage verified against government-issued PAN/AADHAR. Deliverables: 1. API code written using Python FastAPI 2. Frontend Development using React.js 3. Include Dockerfile and for simpler building and running the apps 4. DB Schema Design (Postgres) 5. UML Flow Charts 6. Unit Testing and Intergration Testing Included 7. KYC and dispute handling workflows for Admins and Super Admins. 8. Payment gateway integration for deposits and withdrawals. 9.

...analyst or an expert in voice recognition systems or AI to review the charts (plots) I generate with Python. The objective is to enhance the accuracy of our AI and/or API calls for better stock price predictions. If your contributions prove valuable, I would like to establish a long-term collaboration. Key Responsibilities: - Analyze and interpret stock prediction charts - Provide insights and suggestions for improving the AI and API efficiency Data Sources: - Historical stock prices - Sentiment analysis from news - Economic indicators Skills and Experience: - Proficient in data analysis, particularly in stock market predictions - Experience with AI and voice recognition systems - Expertise in Python and interpreting complex datasets - Ability to provide actionable insi...

I'm seeking a Python expert with extensive experience in working with both REST and GraphQL APIs. APIs include LunarCrush and DEX Screen and potentially Twitter and pump.fun. The project's primary focus is to ensure real-time synchronization and reporting into Google Sheets and MongoDB. The data will form a Crypto Analytics Dashboard that integrates data from these APIs. The goal is to track promising early-stage cryptocurrencies by analysing social signals and on-chain data. The dashboard will also send Telegram alerts when certain thresholds are met, these thresholds must be editable within Google Sheets so are easily adjusted. A simply task is to be completed before progressing to the dashboard build: 1. Client will supply 50-100 cryptocurrency. All historical data of...

We are looking for an experienced developer to build a conversation automation system that uses real account holders (not bots) to interact withi...interact within groups and direct messages. The system must: -Automate interactions using real accounts we control. -Support multiple accounts, with secure login/session management. -Allow accounts to join groups easily via links or predefined lists. -Optionally include a dashboard for configuration, monitoring, and reporting. Requirements: Experience with TG API. Strong programming skills in Python, JavaScript, or related languages. Knowledge of session management and human-like automation patterns. Security-conscious approach to account data storage and usage. If you’ve worked on similar projects, please share your portfoli...

Job Position: Internet Link Poster Employment Type: Full-Time Location: Remote (Work from Home) Salary: ₹1,00,000 per annum (1 LAC PA) Job Summary We are seeking a highly motivated and detail-oriented individual for the role of Internet Link Poster. The primary responsibility is to post specific links all across the internet on a variety of websites, forums, platforms, and communities. You must find suitable locations to post these links and ensure they are relevant, well-placed, and stay permanently online. Only links that remain live will count toward your daily target of 160 links. This full-time position will become easier with practice as you learn to identify the best posting opportunities efficiently. Key Responsibilities 1. Posting Links Across the Internet: You are...

Job Position: Internet Link Poster Employment Type: Full-Time Location: Remote (Work from Home) Salary: ₹1,00,000 per annum (1 LAC PA) Job Summary We are seeking a highly motivated and detail-oriented individual for the role of Internet Link Poster. The primary responsibility is to post specific links all across the internet on a variety of websites, forums, platforms, and communities. You must find suitable locations to post these links and ensure they are relevant, well-placed, and stay permanently online. Only links that remain live will count toward your daily target of 160 links. This full-time position will become easier with practice as you learn to identify the best posting opportunities efficiently. Key Responsibilities 1. Posting Links Across the Internet: You are...

Project Overview Create a Python module that calculates NBA player statistics using the balldontlie API. The module should fetch and process player game statistics across multiple seasons, providing both rolling averages and game-by-game totals in specific formats. Key Requirements Data Source Use the balldontlie API () API endpoints to be used: /players (for player search) /stats (for game statistics) Core Functionality Player Identification: - Accept player name as input - Convert player name to player_id using the API - Handle cases where player isn't found Game Data Collection - Fetch game statistics sorted by most recent first - Only include games where the player logged minutes played (min > 0) - Pull data across multiple seasons if needed -

...existing AWS database securely. 3. Stripe Integration: • Dynamically generate Stripe payment links and process confirmations. • Integrate with our payment intent scheduler to create donation schedules. 4. Testing & Deployment: • Test the bot for seamless user experience and deploy on a scalable server. Skills Required: • Experience with WhatsApp Business API or Twilio. • Proficiency in Node.js or Python. • Strong understanding of AWS services (e.g., DynamoDB, Lambda, or RDS). • Hands-on experience with Stripe API (payment links and scheduling). • Focus on secure data handling (e.g., GDPR compliance). Deliverables: 1. Fully functional WhatsApp bot integrated with AWS and Stripe. 2. Donation scheduling through our payment intent schedul...

...Testing and Quality Assurance: Conduct thorough testing to identify and resolve any issues, ensuring the platform operates smoothly and securely. • Maintenance and Support: Provide ongoing maintenance and support post-launch to address any technical issues and implement necessary updates. Qualifications: • Technical Skills: Proficiency in web development languages such as HTML, CSS, JavaScript, and experience with server-side programming languages like Python, PHP, or Ruby. Familiarity with e-commerce platforms and ERP systems is essential. • Email Marketing Expertise: Experience in creating and managing email marketing campaigns, including the design and distribution of promotional materials in PDF format. • Experience: Demonstrated experience in ...

I need a python script that uses onnxruntime, directml, and yolov8 for object detection. Then extract the results and draw them in a CV2 window. This includes boxes around the objects and their respective confidence.

This project involves building a Python based application for video streaming with the following features: Video Listing and Playback: List all videos available on the file server. Allow users to play any video of their choice using either Direct Streaming or WebRTC (configurable). Real-Time Notifications: Use websockets to notify users (groups) whenever a new video is uploaded. Automatically play the newly uploaded video immediately after receiving the notification, using the configured streaming method (Direct Streaming or WebRTC). Audio Recording: If a user wants to speak, they can click the "Speak Now" button to: Pause video streaming. Open the microphone and start recording audio. Once recording is stopped, the audio file is uploaded and stored on the file server....

I need someone to type printed forms for me. The output should be in a PDF file. Ideal skills and experience for the job: - Excellent typing speed and accuracy - Proficiency in creating PDF files - Attention to detail to ensure forms are typed correctly

I am in need of a skilled web scraper who can collect product information from 6 to 10 different websites on a daily basis. Key Requirements: - Daily web scraping of product data from multiple websites - Delivery of scraped data in a structured format - Ability to manage and handle data from multiple sources Ideal Skills: - Proficiency in web scraping tools and software - Strong data analysis skills - Experience in handling large data sets Please note, this is a daily task and requires consistency and reliability.

I'm in need of a seasoned professional with extensive experience in Java or Python to develop an efficient email checker. The primary purpose of this tool is to filter and group emails. Key Requirements: - Development of a fast-running, headless email checker using Openbullet - Incorporation of 2Captcha via manual captcha solving - Use of residential proxies for the operation Ideal Skills and Experience: - Proficient in Java or Python - Previous experience with Openbullet - Familiarity with 2Captcha - Expertise in using residential proxies - Ability to build a fast, efficient tool

Title: Development of a Personalized Property Rating System Description: We are looking for an experienced developer to help us create a system that can generate persona...ratings based on relevant metrics. • Integrate the system with an existing CRM platform. • Provide ongoing support and maintenance. • Work independently and ensure the system runs with minimal manual intervention. Technical Requirements: • Experience with API integrations and data processing. • Familiarity with CRM systems and integration. • Strong skills in data processing technologies (e.g., Python, SQL). • Ability to generate reports and analytics based on property data. If you are interested in this project, please send us your resume and relevant experience. We lo...

I'm seeking a Python developer with experience in trading tools. I need a program that scans stock market data from the NSE FNO. The scanner should filter stocks based on price movements and technical indicators. Key Requirements: - Proficiency in Python - Experience with trading software development - Ability to create a scanner that exports results in .csv format Ideally, the freelancer will have a good understanding of stock trading and technical indicators. Please include examples of relevant projects in your bid.

I'm looking for a seasoned Python Django Developer to create a sophisticated food e-commerce website. Key Features: - User Registration & Login: A seamless onboarding process for customers. - Product Listing & Categorization: An intuitive layout for easy navigation through various food products. - Online Payment Processing: Secure and efficient handling of transactions. - Messaging: A built-in communication channel for customer inquiries and support. Design: - The site should embody a 'Modern and Sleek' aesthetic. Your design skills will be crucial in achieving this. User Roles: - Customer: The primary user interacting with the site. - Admin: Overseeing the operations, managing products, users, and transactions. Ideal Skills & Experience: - Proficient...

I'm looking for a seasoned developer to create a video player that works seamlessly on both web and mobile platforms. This player should be able to handle multiple video formats such as MP4, WEBM, and AVI. A key aspect of this project is the implementation of a caption system where captions can be toggled on and off by the user. Key requirements include: - Extensive experience in video player development using Python - Proficiency in web and mobile development - Knowledge of various video formats - Ability to create a user-friendly toggle system for captions Please ensure that all source code is compatible with our development setup and is handed over

...translate, and save the output automatically. Requirements: The program must use external AI services (not create an AI from scratch). It should support integration with popular AI tools via APIs. Ensure accurate text extraction, even with stylized fonts. Ideal Skills and Experience: Experience with OCR (Optical Character Recognition) technologies. Proficiency in programming languages such as Python, Java, or C#. Strong understanding of API integrations with AI tools like Google Translate, DeepL, or OpenAI. Familiarity with handling comic and document file formats. Deliverables: Fully functional program with clear user instructions. Source code for future updates. Bonus Features (Optional): Batch processing for multiple comics at once. Option for users to select or customize ...

...users to paste or upload text files. 2. Summarization: Generate concise summaries using pre-trained AI models. 3. Output Options: Display the summary and allow users to copy or download it. 4. Simple UI: Clean and responsive design for desktop and mobile use. Technology Stack • Backend: Python (Flask) with Hugging Face Transformers for summarization. • Frontend: HTML, CSS, JavaScript. • Hosting: Free-tier hosting platforms like Render, Heroku, or Streamlit Cloud. Deliverables 1. A fully functional web-based Text Summarization Tool. 2. User guide for operation. 3. One-time deployment and setup support. Project Timeline The project will be completed in 1 week: 1. Day 1: Requirement Analysis • Finalize requirements and define summarization f...

I'm looking for a Python developer. Key Responsibilities: - Develop Python scripts for various tasks Ideal Skills: - Strong knowledge and experience in Python See attached text file for details and say "Halo" so i know you have read the file otherwise i will ignore your bid Needed to complete wikipedia script quickly within hours if you can budget is 12 usd per site i only need scripts

I have a pythi=on website I would like to add features and upgrades to in order to function better. Furthermore I am looking for an experienced coder and software developer as we have many projects that need to be worked on.

...skilled developer to create a Python-based Telegram bot for me. The primary functionality of this bot should be the ability to broadcast messages to all users across multiple bots, all running from a single codebase. I currently manage several bots and would like to streamline the process of broadcasting messages across them. Key Requirements: - Implement a message broadcasting system that can reach all users across multiple bots. - Build the broadcast functionality into a single piece of code that can operate all my bots. - The broadcast messages will include both text and images. Ideal Skills: - Proficient in Python, with experience in developing Telegram bots. - Familiar with the Telegram Bot API, particularly for message broadcasting. - Prior experience with Pyth...

...tailored for the technology industry and aimed at job seeking. Key Aspects of the Job: - Profile Creation and Setup: Build a compelling, professional LinkedIn profile that highlights my skills, experiences and aspirations in the tech industry. - Creating and Posting Updates: Regularly post relevant updates to keep my profile active, engaging and appealing to potential employers. - Networking and Connecting with Others: Strategically expand my network by connecting with industry professionals, recruiters and hiring managers. Ideal Skills and Experience: - Extensive knowledge and experience in the technology industry. - Proven track record of creating engaging LinkedIn profiles. - Excellent communication and networking skills. - Familiarity with job seeking strategi...

I'm seeking a proficient Python developer with substantial experience in web scraping, specifically in image extraction. - Data Type: The primary focus of this project is scraping images from various online sources. - Sources: The specific sites for scraping can be discussed and will be determined based on your expertise and suggestions. - Output Format: The images will need to be stored in a manner that can be discussed further, depending on the scale of the project. Ideal freelancer should have: - Proficiency in Python and web scraping libraries such as BeautifulSoup and Scrapy. - Previous experience in image scraping. - Ability to suggest optimal sources for image scraping. - Good communication skills for disc...

...looking for a Python developer who can create a script for me. The script should: - Take a Wayback Machine page url as input - For each feature listed on (), determine if the feature is implemented on the Wayback Machine page by analyzing the page's HTML, CSS, and inline JavaScript. Make sure to exclude code injected by the Internet Archive. - Support all versions of all major browsers. - Output the feature compatibility list as a CSV file with four columns: wayback machine page root url, browser name, browser version, feature implemented yes/no. The freelancer should also provide a short document (1-3 pages) detailing how the script works. The ideal freelancer for this project should have extensive experience in Python scripting

...skilled developer to create a Python-based Telegram bot for me. The primary functionality of this bot should be the ability to broadcast messages to all users across multiple bots, all running from a single codebase. I currently manage several bots and would like to streamline the process of broadcasting messages across them. Key Requirements: - Implement a message broadcasting system that can reach all users across multiple bots. - Build the broadcast functionality into a single piece of code that can operate all my bots. - The broadcast messages will include both text and images. Ideal Skills: - Proficient in Python, with experience in developing Telegram bots. - Familiar with the Telegram Bot API, particularly for message broadcasting. - Prior experience with Pyth...

I need a seasoned legal professional to draft a job offer letter for a role in our UK private equity firm. The letter should be comprehensive, legally compliant, and tailored to our firm's standards. Key aspects to include: - Understanding of and adherence to UK employment law - Incorporation of non-compete clauses, termination conditions, and confidentiality agreements - No reference to probationary period terms Ideal candidates will have: - Extensive experience in legal drafting, particularly with employment contracts - In-depth knowledge of the private equity sector in the UK - Exceptional attention to detail and ability to customize the letter based on our firm's standards

...skilled developer to create a Python-based Telegram bot for me. The primary functionality of this bot should be the ability to broadcast messages to all users across multiple bots, all running from a single codebase. I currently manage several bots and would like to streamline the process of broadcasting messages across them. Key Requirements: - Implement a message broadcasting system that can reach all users across multiple bots. - Build the broadcast functionality into a single piece of code that can operate all my bots. - The broadcast messages will include both text and images. Ideal Skills: - Proficient in Python, with experience in developing Telegram bots. - Familiar with the Telegram Bot API, particularly for message broadcasting. - Prior experience with Pyth...

Please Sign Up or Login to see details.

Full Time Job Website and E-commerce Specialist Please bid monthly salary you are looking for. Job Description: We are seeking a highly motivated and detail-oriented individual to join our team as a Website and E-commerce Specialist. In this role, you will be responsible for managing and optimizing our website, eBay, and Amazon platforms. Your primary focus will be to ensure that our online presence is up-to-date, user-friendly, and competitive in terms of pricing. This is a remote position, allowing you to work from the comfort of your own home. Responsibilities: Website Management: Regularly update and maintain our company website, ensuring accurate product listings, pricing information, and images. E-commerce Platforms: Manage our presence on eBay and Amazon, includin...

I want to watch the changes in holder numbers, bio, etc over time of one website, two different sections: and There is a list of agents on each of them. Once one clicks on one of them there is plenty of info. Collect and put in json on file (2 jsons, 1 for each of the sectors) Important: Deliverable is the python script. I want to be able to update the data daily.

Job Title: AI Assistant Developer – Lead Response Integration () Location: Remote Contract Type: Freelance/Contract Overview: is seeking a skilled AI developer to set up and integrate key features into our AI assistant. The goal is to enable the assistant to efficiently process incoming leads, initiate calls within 5 minutes, and engage with the lead in a personalized manner—calling them by name and collecting relevant information for follow-up. The successful candidate will work closely with our team to refine this process and ensure a seamless, high-quality user experience. Responsibilities: Lead Detection and Processing: Configure the AI assistant to detect incoming leads in real time and trigger an automatic call within 5 minutes of receiving the lead’s i...

...looking for a skilled Python or JS developer with expertise in web scraping, Selenium, and HTML parsing to enhance and complete a job scraping tool for the Adzuna job portal. Project Goals: code must fetch all job listings from Adzuna for a given search query URL (e.g., ). Handle cases where JSON-LD data is missing by falling back to HTML parsing to extract all relevant details. Current Issues: my code scrapes some job data (titles, descriptions, company names, etc.), but many fields remain blank. Not all job listings are fetched; the script currently stops at ~157 jobs out of ~410 listed. Fallback HTML parsing is insufficient, leaving many fields incomplete. Requirements: Comprehensive Data Extraction: Fetch all job...

I am seeking a seasoned Selenium and Python professional who can assist me with automating the scraping of data from various e-commerce sites. Ideal Skills and Experience: - Proficient in Python and Selenium - Strong experience in web scraping - Familiarity with e-commerce websites - Understanding of data extraction and processing - Knowledge of legality and ethics in web scraping Please note, while the primary focus is on scraping product information, the scope may extend to other types of data as needed.

I'm looking for an expert in PSS/E using Python who can model the Reactive Power Capability of Solar PV.

I'm seeking a web developer to create two distinct websites - a job board and a travel-focused site. Job Board Website: - Utilize a WordPress template for efficient and quality development. - Key functionalities include resume submission, job search and filtering, and an employer dashboard. Travel Website: - This site should facilitate payment for Evisa applications. - Integrate a secure and reliable system for Credit/Debit Card transactions. Please quote separately for each project. Use the word 'Banana' in your message to confirm you've read and understood the requirements.

I'm looking for a web template design, similar to , with a focus on a classic style. The primary aim of this template is to showcase products and services effectively on the Home Page. Key Requirements: - Design a Home Page template that can display a variety of products and services in an appealing manner. - The design should embody a classic style, characterized by timeless elegance and simplicity. - Experience with modern web design standards and practices is essential to ensure the template is functional and user-friendly. - Previous work with e-commerce or product showcase sites will be highly regarded. Please provide examples of your previous work that align with this project.

I'm in need of a Python expert who can assist me with a web scraping project. The primary focus of this project is to scrape user data from various websites. Skills & Experience Required: - Extensive knowledge and experience with Python, particularly in web scraping libraries such as BeautifulSoup, Scrapy, etc. - Familiarity with handling and parsing user data. - Prior experience with web scraping projects. - Understanding of ethical considerations and legal restrictions related to web scraping. - Ability to deliver clean, well-documented code. Please note that the exact websites from which data needs to be scraped will be determined later, so flexibility and adaptability are key.