Web crawling and scraping using python jobs

I fix system issues using custom Python tools with an id called the power of Python to identify, troubleshoot, and resolve system issues efficiently. developing custom scripts and tools, I streamline the process of diagnosing problems in operating systems, applications, and networks, ensuring minimal downtime and optimal I Offer: Automated Diagnostics: Build Python scripts to analyze system logs, monitor performance metrics, and detect anomalies. Identify root causes of errors or crashes using data parsing and analysis tools like Pandas. Custom Troubleshooting Tools: Create interactive Python applications to test and debug specific system components (e.g., hardware checks, API response testers). ...

I need a Java automation script that has been designed for data extraction. The script is not functioning properly at the moment and requires a skilled programmer to perfect its logic flow. Key Responsibilities: - Analyze the existing Java code - Improve and perfect the logic flow - Ensure the script runs properly and correctly Ideal Skills: - Proficient in Java programming - Experience with writing and debugging automation scripts - Knowledge of web scraping techniques - Strong problem-solving skills

...looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to ...

I'm looking for a skilled web developer to create a dynamic and user-friendly e-commerce platform. The platform should support multiple user roles - Admin, buyers, and sellers, providing a seamless shopping experience for the Home & Kitchen product category. Key Features: - Robust User Authentication: The platform should provide secure login, email verification, and efficient product management features like adding or removing items from the cart. - Intuitive Dashboard: Users should be able to manage their profiles, view order details, and track payment status through a visually appealing and easy-to-navigate dashboard. - Secure Transactions: The platform needs to be integrated with the Razorpay payment gateway for safe and reliab...

I need an expert in web scraping and MS Power Automate to help me set up a project. The site we will be working with requires scrolling and clicking to access data fields. - You will remotely connect to my Windows server via AnyDesk to do the work. - The site is not specified yet, but it requires interaction to retrieve data. - Your main tasks will involve setting up the scraping process and ensuring it runs smoothly. Ideal skills for this job include: - Proficiency in MS Power Automate - Extensive experience with web scraping - Familiarity with handling AJAX-loaded content - Ability to work remotely and troubleshoot in real-time. Please note, this project may involve working with various types of data fields, so flexibili...

I'm looking for a web application for a job portal, developed in Python's Django framework with a MySQL database. This will be for my college project, so it needs to be functional, clear, and well-structured. The portal should cater to job domains including tech, gigs, and freelancers, with job categories such as part-time, full-time, and on-field. Key Requirements: - Support for three user roles: Job Seekers, Employers, and Administrators. - Integration of social media login with Google specifically. - Use of Django and MySQL for a robust backend. Ideal Skills and Experience: - Proven experience in Python and Django framework. - Proficiency in MySQL database management. - Prior projects involving job portals would ...

I'm in need of a professional designer to create a minimalist logo for me. The design should be purely monochrome, without any colors. The logo should incorporate my initials/letters, and convey a sense of trust and reliability. Ideal Skills and Experience: - Proficiency in minimalist design - Experience in creating letter-based logos - Strong understanding of design principles - Ability to convey specific emotions/messages through design - Excellent communication skills to understand and incorporate client feedback

...developer to assist in debugging and improving a prototype of a speech and text recognition AI that I've been working on in Jupyter Notebook. Key Focus: - The primary concern is the error rate in recognition. I'm looking for someone who can help to reduce this significantly. Ideal Skills: - Proficiency in Python and Jupyter Notebook - Strong background in AI and machine learning, particularly in speech and text recognition - Experience in debugging complex systems - Excellent problem-solving skills - Familiarity with data processing and analysis The project is crucial for the future development of this AI, and I'm hoping to find a freelancer who can not only help with the immediate technical issues, but also provi...

I'm looking for a seasoned Maxqda and Python programmer to help me visualize my work tracking data with graphs and charts.

Connect to Rupeezy API for live data, buy/sell orders, and account details. Optional: Integrate ICICI Direct API for additional functionality. *1by4vdz*_gcl_au*MjEzNDUzOTMzMC4xNzI5Nzc0MjU4 Automate below Google Sheet. Development in Python, Node.js, or GoLang. Libraries: pandas, openpyxl, gspread, axios, etc. Timeline: Flexible but strict adherence to deadlines. Note: This is my second attempt after being scammed by a freelancer previously. If you are able to deliver this project, transparency and timely delivery are critical, with payments made based on milestones.

...intents/entities, generate AI-based responses, and support live agent handovers. I’m looking for experienced Python developers to help design and implement a scalable backend for this project. Key Responsibilities: 1. Asynchronous Message Handling: Build an efficient API to process incoming customer messages in real time. 2. Session Management: Design a system to track and manage multiple simultaneous user sessions. 3. Queue Management: Integrate messaging queues (e.g., RabbitMQ, Kafka, or AWS SQS) for message processing. 4. Database Integration: Use Redis or DynamoDB to store session and conversation data. 5. Cloud Deployment: Set up the backend on AWS (e.g., EC2, Lambda, or Elastic Beanstalk) for scalability. Preferred Skills: • S...

I'm in need of a skilled web scraper to update my contact directory. The task will involve scraping public directories for contact details. Key Requirements: - The websites to be scraped are primarily public directories. - The information that needs to be updated includes names and titles, phone numbers, and email addresses. This is a one-time update. Ideally, the freelancer should have experience in web scraping and data management. Proficiency in Python, BeautifulSoup, or similar web scraping tools is a plus.

...developer to create an AI receptionist service. This project requires a web app with a LAMP stack frontend, a PHP + MySQL backend, and the receptionist service powered by Twilio + Python, utilizing the OpenAI realtime API. Key features of the AI receptionist: - Basic inquiries handling using a knowledgebase provided by the customer - It should be able to book calendar appointments using the customer's Calendly (Calendly API may be required) - Support multiple languages (Realtime API should be able to do this automatically) Key features of the web app: - It should allow the user to purchase a phone number from Twilio, log information in MySQL database - It should allow the user to choose a service plan / price and pay with ...

I'm seeking an experienced data analyst with a strong background in market research interpretation. Your task will involve analyzing market research data to uncover key market trends. Ideal Skills and Experience: - Proficiency in data analysis tools (e.g. Python, R, Excel) - Prior experience with market research data - Ability to visualize data and present findings clearly - Strong analytical and problem-solving skills The end goal is to provide me with a comprehensive understanding of current and emerging market trends based on the data provided.

I need a script that scrapes the site for PDF files, downloads them and saves them to my S3 bucket. The script only needs to run once, and there are no filtering criteria for the PDFs to be downloaded. Ideal skills and experience: - Proficient in Python or similar programming languages - Familiar with web scraping frameworks like Scrapy or BeautifulSoup - Knowledgeable in AWS S3 for file storage - Experience in working with PDF files

Job Opportunity: Web Developer for a Directory-Style Website Targeted at Female Entrepreneurs We’re seeking a talented and creative web developer to help us create a directory website dedicated to supporting female entrepreneurs and their businesses. This project is a unique opportunity to work on a meaningful initiative while adding to your web development skills and portfolio. About the Project Our goal is to build a user-friendly and visually appealing website that acts as a directory for female-owned businesses in Northern Virginia (locations to 4expand overtime). The platform will allow users to: -Browse Listings: Find businesses by category, location, or keywords. -Search and Filter: Use an intuitive search...

Hello, I have a part-time beginner friendly job opportunity available. The work typically involves completing specific tasks, such as implementing algorithms in python, which might require around 5 hours of coding. The job is quite flexible. For instance, we could agree on a schedule where you work part-time for about 3 hours a day. If I assign you a 5-hour project, I would expect it to be completed within 2 working days. However, there won’t always be tasks available, so some days may be entirely free of work.

...platform. This project will focus on integrating AI workflows and Large Language Model (LLM) capabilities. The key aspects of this project will be its modularity, scalability, and the ability for user customization. Key Requirements: - Strong expertise in Python or other relevant programming languages. - Proven experience with AI/ML model integration, particularly with platforms like OpenAI and Hugging Face. - Excellent knowledge in workflow automation and API integration. - Proficiency in crafting intuitive user interfaces, preferably a drag-and-drop style. - Familiarity with a range of cloud platforms, including AWS and Azure, as well as containerization technologies like Docker and Kubernetes. - A strong focus on securi...

...individuals and MPN patients, including gene expression data, sex, and age. I am seeking your expertise to assist with the following tasks: 1. Organizing and Harmonizing the Data: - Ensure all gene identifiers under the ID_ref column, such as (1007_s_at) and (TC04002953.hg.1), are consistent and harmonized across the dataset, and document each gene’s actual meaning before harmonizing them, I need to know what each new gene identifier reference to. - Properly label and organize the dataset to distinguish healthy samples from MPN patients using "healthy" for healthy individuals and the specific MPN subtype for diagnosed patients. 2. Feature Engineering to Identify Key Genes: - Identify the most impo...

...________________ Minimum Skills and Experience: -AI and machine learning expertise: At least 2 years of demonstrated continuous, non-overlapping experience in AI and machine learning including some experience with retrieval-augmented generation workflows. - LangChain Proficiency: Demonstrated experience in at least 10 projects using LangChain for retrieval-augmented generation or similar applications. - Data extraction and database development: A minimum of 5 years of experience in structured data extraction and database creation. -CV Analysis: Proven familiarity with CV parsing and insights generation. Adaptive Learning Systems: Strong ability to design and implement systems that learn and improve over time. -Technical To...

I'm seeking an experienced Python developer with expertise in MITM (Man-In-The-Middle) implementation specifically for intercepting HTTPS traffic on a Windows operating system. Key Responsibilities: - Utilize Python to develop scripts for intercepting HTTPS traffic. - Primarily focusing on testing security vulnerabilities through the intercepted data. Ideal Skills and Experience: - Proficient in Python and network security. - Previous experience with MITM implementation. - Understanding of HTTPS protocols and data interception. - Ability to create custom scripts for traffic analysis.

I have a 285 line Python code that's intended to execute trades on the Ethereum blockchain. However, the transactions are failing. I need help modifying the code to ensure successful transactions. I have already verified the account balance before making the transactions, so that is not the issue. The inputs for the code are sourced from an ENV file and a spreadsheet. The code is correctly set up to interact with the blockchain, but modifications are needed to rectify the transaction failures. Ideal skills and experience for this job would include: - Proficiency in Python and familiarity with Ethereum blockchain - Experience with debugging transaction errors in blockchain - Ability to modify existing code for successful execution - Understanding of...

...developer to create an interactive and engaging chatbot for X. The primary purpose of this chatbot is to attract and gain users. Key Responsibilities: - Design and implement an AI chatbot on Twitter - Ensure the bot is engaging and user-friendly to promote user acquisition - Gather and provide a technical analysis summary of random of 3 AI bots in X (I will give you a list of bots). Elaboration: There are many AI bots in X which provide technical analysis on crypto coins. For our bot, if a user asks about a coin, we will in turn gather info from any 3 bots in the lists (there will be more and more) and provide the user with a summarized version. We will also give credit to the bots who provided the insights Ideal Skills and Expe...

I'm looking for a Python Developer who can help me create a minimal web-based AI Backlink Tool. This tool should be able to: - Conduct automated backlink analysis - suggest backlinks - Monitor competitor backlinks - suggest sites with their respective price. The tool should have a minimal user interface (UI) – nothing overly complicated, but enough to allow for easy navigation and usage. Ideal candidates should be well-versed in Python and have experience in web development, specifically creating minimal UIs. Familiarity with AI and SEO tools will be a significant advantage. Your ability to understand and implement these functionalities will be key to the success of this project.

I'm looking for a Python expert to scrape restaurant data from the first page of the Lieferando website. The data fields I need include: - Restaurant Name - Cuisine Type - Number - Address The scraped data should be saved in a CSV format. Please note, I only need the code file, not the data itself. Ideal Skills: - Proficient in Python - Experience with web scraping - Knowledge of data handling in Python - Familiar with saving data in CSV format Please ensure that the code is efficient and well-commented for future understanding.

I'm looking for a Windows-based Telegram automation program, developed in Python with AI capabilities. The software should be able to perform the following tasks: - Add Telegram accounts - Duplicate my actions across all accounts - Allow for a customizable number of accounts (e.g. 200) The program's logic is straightforward. I would launch the software, select the number of accounts, and then log into my Telegram account. Simultaneously, all other accounts would log in as well. All actions taken would be mirrored across all accounts. This includes tasks like liking a post or completing an assignment in an app. There should be no limitations on the number of accounts that can be added. The program should ensure that all actions, from completing tasks to withdrawin...

I'm in need of a highly skilled Python developer with a strong background in app reverse engineering. The goal of the project is to create tools for generating X-Argus, X-Ladon, and X-Gorgon signatures for the TikTok API. These tools should be capable of replicating TikTok’s device registration and login requests, while also bypassing root detection, proxy restrictions, and other security measures. Requirements: • Expertise in Python and app reverse engineering. • Experience with TikTok APIs and cryptographic algorithms. • Ability to implement scripts manually for dynamic signature generation. • Proven ability to bypass root and proxy detection. Deliverables: • Functional tools or scripts for...

...Automation and Excel Integration in Python or Visual Interface Description: Hi, I am looking for a ChatGPT expert to help me with automation and the integration of Excel data into a system where I can ask natural language questions and get precise answers based on the data. Scope of Work: Task Overview: I have data in an Excel sheet where certain ranges define decision-making authority. Example: Up to Rs. 15,000: X has the power. Rs. 15,001 to Rs. 25,000: Y has the power. When I ask a question like "Who has the power for Rs. 22,000?" the program should correctly respond, "Y has the power." Requirements: Prompt Engineering: Write effective ChatGPT prompts that can accurately interpret my queries. Python Programming: Create a P...

I'm seeking a Python expert with a GPU-based system to help me debug and run my PyTorch machine learning model. I have a minor error that's preventing the code from executing. What I need: - Someone who can quickly identify and fix the issue - Experience with PyTorch and machine learning models - Access to a GPU-based system to run the code I appreciate your understanding and look forward to your bid.

...Backend Technologies: MYSQL,PYTHON List of Hardware / Sensor / Processor (if Project on Embedded System) : VR MASK Concept with Techniques 1. Main Lobby: * Design a 3D lobby environment using Unity, incorporating navigation elements like buttons or portals to access different therapy rooms. * Implement Unity's UI system to display user interface elements such as menus, progress bars, and tooltips. * Use Unity's scene management to load and unload different scenes seamlessly as users navigate through the lobby. 2. Nature Retreats (Nature Rooms): * Create immersive nature environments using Unity's terrain system, asset store, or procedural generation techniques. * Utilize lighting effects and p...

...am in need of a custom-built, global HR and Payroll system, starting with Philippines and Australia. The system should be designed to accommodate future expansions worldwide. Key System Features: - Comprehensive employee management functionalities - Efficient payroll processing capabilities - Accurate time and attendance tracking Ideal Skills and Experience: - Proficiency in any technology stack (Java and Spring Boot, Python and Django, Microsoft .NET) - Prior experience in developing HR and Payroll systems - Knowledge of global HR and Payroll compliance standards - Strong software development and programming skills - Excellent system integration capabilities This is a unique opportunity to create a pivotal system...

I'm looking for an experienced web app developer with expertise in LARAVEL, PHP, MYSQL, NODEJS, PYTHON, and HTML. The primary purpose of the app is for managing customer information. Key Features: - User authentication and profiles: The app should allow for secure user logins, profile creation, and management. - Data Management: The app should be able to handle customer information efficiently. The ideal freelancer for this project should have a strong background in data management web applications, with a proven track record of creating secure, user-friendly platforms. Experience in e-commerce or social networking apps will be an added advantage, but the focus is on data management. The ability to integrate data analytics and report...

...trademark applications filed and updated that in our software. Now, we want you to develop scrapper: i. that can update data and documents of existing 6.75 million trademark stored on aws server, and ii. that can scrap all data and document of newly filed trademark application, which are not in our database. Watch for understanding. --------------------------------------------------------------------------------------------------------------------------- For your knowledge: 1. Our SaaS is hosted on EC2 server of AWS 2. Data is hosted on RDS server of AWS, 3. Documents are stored on S3 server of AWS, thus, you will need to update data to RDS server and documents to S3 server. 4. Our SaaS is built using Laravel PHP 5. The primary

...trademark applications filed and updated that in our software. Now, we want you to develop scrapper: i. that can update data and documents of existing 6.75 million trademark stored on aws server, and ii. that can scrap all data and document of newly filed trademark application, which are not in our database. Watch for understanding. --------------------------------------------------------------------------------------------------------------------------- For your knowledge: 1. Our SaaS is hosted on EC2 server of AWS 2. Data is hosted on RDS server of AWS, 3. Documents are stored on S3 server of AWS, thus, you will need to update data to RDS server and documents to S3 server. 4. Our SaaS is built using Laravel PHP 5. The primary

I am in need of a seasoned developer or technology expert with extensive experience in Telegram API integrations. The primary goal is to manage and filter high volumes of data from specific Telegram groups and implement scraping functionality for targeted user activity. Key requirements: - Advanced Telegram API expertise - Ability to filter and scrape data - Efficient in collecting real-time data - Able to scrape messages and posts - Reliable and communicates effectively Ideal candidates should have a proven track record working with Telegram API and can demonstrate their ability to handle large data volumes efficiently.

...Odoo Developer to create a robust, user-friendly application that meets my business requirements and provides a seamless experience across both mobile and desktop platforms. Key Responsibilities: Customize and develop modules in Odoo to meet specific business needs. Ensure compatibility and responsiveness across mobile (iOS and Android) and desktop platforms. Build APIs and integrations with third-party systems as needed. Optimize the user interface and workflows for a smooth user experience. Implement security protocols and ensure data integrity. Test the application to identify and fix bugs or performance issues. Requirements: Proven experience with Odoo development. Strong knowledge of Python and Odo...

...adept web scraper capable of accurately and efficiently extracting URLs and images related to Google AdSense from a specific blog. Key Responsibilities: - Extracting URLs from the designated blog. - Gathering images associated with Google AdSense. - Ensuring all data is retrieved from all pages of the site. Challenges: - Currently facing difficulties in retrieving details specifically from Google AdSense. Skills Needed: - Proficient in web scraping technologies (e.g., Python, BeautifulSoup, Scrapy). - Understanding of Google AdSense protocols and restrictions. - Experience with data extraction and handling. - Familiarity with both static and dynamic web content. Data Format: - All extracted URLs and images ...

I'm looking for a professional data miner to scrape product information from several specific South African e-commerce sites. ...data from include: - - - - - Ideal candidates for this project should have: - Proven experience in web scraping, particularly from e-commerce sites. - Proficiency with data mining tools and software. - Ability to handle large datasets and deliver clean, structured data. - Understanding of product data fields (like price, description, availability, etc.) I need the product data to be gathered in a timely manner, and delivered in an accessible format. Please include examples of similar projects you've completed in your proposal.

I need a web scraping expert who can extract soccer odds statistics from various websites for my personal analysis. Key Requirements: - Scraping specific soccer odds and stats from the web - Implementing 'auto scraping' on specific buttons and menus for data comparison - Saving all scraped data in an Excel spreadsheet Ideal Skills: - Proficiency in web scraping tools and techniques - Experience with Excel and data analysis - Knowledge of soccer odds and statistics is a plus

...developer to build a web application called Gobo OS for placing orders for gobo glass and maintaining an admin panel. The tech stack can be JavaScript, PHP, Python, or FlutterFlow (no-code/low-code)—we are open to recommendations based on the freelancer's expertise. Key Features Required: User Authentication: OTP-based login using email and phone number. Product Catalog & Customization: Dynamic product listings. Customizable design uploads. Dynamic pricing calculations based on dimensions and specifications. Order Management: Track order status with progress updates. Approvals, feedback, and corrections with file uploads. Payment Gateway Integration: Support for Stripe, Razorpay, or other secure payment methods. Admin Dash...

I'm looking for a Data Scraper specialist who can extract specific information from an app for me. The data to be scraped includes: - Images - Product Information - Compatibility Details - Product Descriptions The final deliverable should be all this data neatly organized in a CSV file. Ideal skills and experience: - Proficiency in web scraping tools and techniques - Experience in data extraction from mobile apps - Ability to organize data into a specified format - Attention to detail for accurate data collection

...skilled web developer who can integrate an employee scheduling and time tracking system on the employee side of my website. This will help me monitor the hours worked by my remote staff members, all of whom will be working from home. Key Requirements: - Implement a scheduling and time tracking system on my website. - Ensure the system is user-friendly and accessible for all remote staff. - Develop a secure login system using email and password for each employee. Ideal Skills and Experience: - Proficiency in web development and backend technologies. - Prior experience with integrating scheduling and time tracking systems. - Ability to create secure and efficient login systems. Backend Technology: I don'...

...the unique preferences, tone, and voice of each client. The vision is to create a system where users can select a client from a list. Upon selection, the tool will adapt its content generation approach based on client-specific parameters, stored in a database. Additionally, the tool should learn and adapt its writing style over time by analyzing previously submitted content, improving its ability to match each client’s unique voice. Since this is my first venture into AI-based content generation, I would greatly appreciate the guidance of an experienced developer on how best to build this tool and structure the project. Scope of Work: Client-Specific Model Customization: Develop a system that allows users to select a client (e.g., Client A, Client B, etc.),...

I'm looking for a Python expert who can conduct research on harmonic patterns, particularly the Gartley pattern, using historical daily stock prices from the last 5 years of 10 companies listed on the Malaysian stock market. The research should be conducted on Google Colab and should provide clear entry levels, stop-loss and take-profit levels. Ideal Skills and Experience: - Proficiency in Python and Google Colab - Experience with stock market analysis - Understanding of harmonic patterns, particularly the Gartley pattern - Ability to present data in a clear, concise manner Please note, the analysis should solely use historical stock prices.

I'm looking for a Python script that leverages RoBERTa to automate the identification of potential candidates from both LinkedIn and their resumes. The script should analyze candidates based on their skills, experiences, personal statements, educational backgrounds, etc. Key Requirements: - Data Processing: The script should be able to process both LinkedIn profiles and uploaded resumes. - Data Preprocessing: The script needs to carry out critical preprocessing steps such as synonym replacement, sentiment label mapping, and implementing data augmentation and class balancing. - Analysis and Evaluation: The script should perform correlation analysis and generate a heat map. The model's effectiveness should be evaluated using ...

... We are seeking an experienced web developer to fully redevelop our website with the following specifications: Core Requirements: Listings Features: Sales Properties: Display Sales Price, Net Operating Income (NOI), and CAP Rate (calculated as NOI ÷ Sales Price). Lease Properties: Include NNN, NN, or N status, monthly lease payment, and lease term (in years). Option to hide sensitive details if requested by the seller/landlord, displaying "Inquire" instead. Excluded Pages: Omit Business listings, the News, Books for Sale, and Directory pages from the new website. Keyword Matching Algorithms: Develop algorithms for matching users with properties based on specific keywords like location, property type, and investment criteria. Desi...

Please Sign Up or Login to see details.

I'm seeking a Python developer to create a fully automated, Windows-compatible script for auto-login to the VFS Global website. Key Requirements: - The script must run on Windows. - It should be written in Python. - The auto-login process needs to be completely automated, requiring no user interaction. Ideal Skills and Experience: - Expertise in Python and Windows platform. - Prior experience in creating automation scripts. - Understanding of web interaction and login protocols. Please provide examples of similar projects you've completed in your proposal.

I'm in need of a fully automated crypto bot that can identify and execute sandwich attacks on the Solana blockchain. Key requirements: - The bot needs to be fully automated, able to operate independently without manual intervention. - It should be able to pinpoint and execute MEV sandwich attacks efficiently. - Experience with the Solana blockchain is crucial, as the bot will be operating exclusively within this network. Ideal Skills: - Proficiency in programming languages suitable for bot development (Python, JavaScript, etc.) - Deep understanding of blockchain technology and MEV (Maximal Extractable Value) strategies. - Previous experience in developing crypto trading bots, specifically for executing sandwich attacks. - Familiarity with the Solana ecos...

I need a python programmer that can create a script that changes the public ip address of my computer after some specifc time. Kindly share your ideas in proposal that how will you solve this problem.