Web crawling and scraping using python jobs
I'm in need of a Python Selenium expert for a project. While the specific details are still being finalized, the ideal candidate would be someone with: - Proficiency in Python and Selenium - Experience in web scraping, automated testing, and browser automation - Flexibility to adapt to different types of web applications - Capability to support automation across multiple browsers Please reach out if you have the necessary skills and experience.
I am in need of a Python developer with substantial experience in Django for web development. The primary focus of this project is to develop a web application with a robust REST API. Key Requirements: - Extensive experience with Python and Django - Strong understanding of web development principles - Proven track record of developing REST APIs Ideal Skills: - Python - Django - Web Development - REST API Development
I'm in need of a skilled freelancer with extensive experience in Zoho CRM and database management to synchronize our Zoho CRM with our database. Key Responsibilities: 1. Data Update & Cleanup: - Align our CRM with the database by adding missing fields, such as 'Subscription', 'Rating'. - Identify and clean duplicate and dead records, i.e. blocked email addresses. 2. Database Synchronization: - Develop a Python script for fetching data from our database and updating or adding records in Zoho CRM. - Ensure the script is capable of handling incremental updates and can operate on a set schedule. 3. Documentation & Automation: - Create clear and concise documentation detailing the cleanup an...
...Language Model to summarize and condense lengthy educational materials, such as full-length lectures and PDFs, into concise and easily digestible formats like video snippets, infographics, and text summaries. The goal is to enhance learning efficiency by transforming complex information into byte-sized content. Key requirements: - The system should be able to process a variety of sources for content generation, including full-length lectures, PDFs, and web articles. - It should also be capable of incorporating interactive elements into the summarized content, such as quizzes, clickable links, and interactive diagrams. Ideal skills and experience for the job: - Proficiency in developing systems powered by Large Language Models. - ...
...extraction tasks. The project includes integration with LangChain TypeScript (TS) and the implementation of feedback loops to ensure a robust validation process, including ZOD validation. Key Objectives: 1. Pipeline Development: • Build a pipeline that fine-tunes open-source models for extracting specific data from text inputs. • Ensure the pipeline supports continuous improvement with fine-tuning iterations. 2. LangChain Integration: • Integrate LangChain TS for improved processing, chaining, and orchestration of model inputs and outputs. 3. Feedback Loops and Validation: • Implement feedback loops to improve model outputs over time. • Apply ZOD validation for robust schema validation of the JSON outputs. 4. Data and...
... and Science Exchange. The platform will connect vendors offering scientific services/products with buyers from academic institutions, biotech companies, and pharmaceutical firms. Project Requirements The project will include the development of the following core components: 1. Admin Panel Comprehensive dashboard to manage users, transactions, approvals, and overall platform settings. 2. Vendor Panel A dedicated space for service providers to list their offerings, manage orders, update availability, and communicate with buyers. 3. Buyer Panel A user-friendly interface for researchers and companies to browse services, request quotes, place orders, and track project progress. 4. Marketplace Frontend A public-facing platform where buyers can searc...
I am looking for a skilled software developer with expertise in Python to create a fully functional Windows application. This application should support the RTSP media streaming protocol and utilize the FFmpeg media processing library. Key Skills Required: - Proficiency in Python - Experience with RTSP media streaming protocol - Extensive knowledge of FFmpeg - Familiarity with Windows application development frameworks (like WinForms or WPF) - Competence in network programming and socket development Deliverables: 1. A fully functional Windows application that meets the outlined requirements. 2. Well-documented source code with proper comments. 3. An installation package for easy deployment. 4. A user manual tailored for non-technical users. The ideal candidat...
The seismic reports and project of a steel-structured house . The analysis of this house needs to be performed in the SAP2000 program in accordance with TBDY 2018 and Turkish geotechnical survey report is provided in house project and geotechnical report will be provided to you.
I'm looking for a Python expert who can help analyze our customer data. - The primary goal of this project is to derive insights from our customer data to drive business decisions. - The data is stored in databases, so experience with SQL and database management is a plus. - A strong background in data analysis and Python is essential for this project. Please include your relevant experience and examples of similar projects you've completed in your proposal.
Backend API Development Using TypeScript & Node.js - Sign-in, Signup, Reset Password, Forgot Password & Verify OTP - Dashboard Stats - Workspace and Project APIs - Packages and Payment APIs - Profile Update and Change Password - Contact Us - Admin APIs
...random URLs visit duration: random urls top to bottom scroll speed (file path option and website API option) (file path option and website API option) option Select click based on "selector/xpath" (Example if click option is selected then it should click on selected banner/ads and do activity like slow scroll, wait time and visit internal link. ) 10. Click ctr control option. ------------------------------- Youtube: url 2. traffic source: Google search, Bing search,Facebook,Quora,Direct, custom url (EX:if google is selected then need option to enter keyword) (file path option and website API option) (file path option and website API option) 4. No .of visits 5. Visit duration Min Sec/Max sec More points will be add...
I'm looking for a skilled graphic designer to help me create some designs using Illustrator, which I can install on my computer. If you have experience with Illustrator and can work with a variety of design needs, please reach out.
I’m looking for an experienced web developer to create a Minimum Viable Product (MVP) version of a basketball stats website. The website will feature sortable and filterable dashboards for players and teams in the 2025 NBA season. This is a small-scale project aimed at validating the concept before expanding to additional features. Project Scope: Player Dashboard: Display data for 400 players with ~50 data points each (e.g., points, assists, advanced stats). Include filtering, sorting, and color-coded rows (green-to-red scales based on performance metrics). Team Dashboard: Display data for 30 teams with ~50 data points each. Include filtering, sorting, and comparison functionality for multiple teams. User Interface: A clean, responsive design for b...
I'm seeking a skilled Python developer to create a program for analyzing text data from databases. Key Responsibilities: - Develop a Python program primarily for data analysis. - Extract and analyze text data from various databases. Ideal Skills and Experience: - Proficient in Python with a strong focus on data analysis. - Extensive experience with text data processing. - Familiarity with database handling and extraction. - Ability to create efficient and effective data analysis tools.
...including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The t...
I need a desktop-based software for an ESP32 development module educational kit. This software should...software for an ESP32 development module educational kit. This software should allow users to write code, compile and upload it to the module. It should support different sensors and provide a user-friendly Graphical User Interface (GUI). Key Requirements: - Code writing in Scratch, C and Python - Compilation and uploading to the ESP32 module - Interaction with various sensors - Intuitive GUI - Compatibility with Windows and MacOS Ideal Skills: - Proficient in software development for educational purposes - Experience with ESP32 and various sensors - Skilled in creating GUI software - Knowledgeable in Scratch, C and Python...
Instructions for Data Scraping Task Your task is to extract specific information from job posting links. Below are the detailed requirements: Data Points to Scrape: 1. Company Information: - Company Name - Company Details: Brief about the industry or type of work they do. - Company Website - LinkedIn Page: URL to the company’s official LinkedIn page. 2. Email IDs (3 Required): - Find 3 individuals' email IDs from the following departments: - Admin - Human Resources - Head of Sales/Top Leadership (CXO level in Sales) - Marketing Head/Top Leadership (CXO level in Marketing) - Founders/CEOs/Co-founders/Owners 3. Email Requirement: - The email IDs must be professional (e.g., `name at `). - Avoid generic emails like `info@`,...
...Data Entry and Autofill Systems We are looking for an experienced Automation Engineer to help develop tools for automating data entry and form autofill processes. This project requires expertise in building efficient, user-friendly automation systems tailored to diverse online workflows. Responsibilities Automation Development: Design and implement solutions for automating form completion using structured data. Develop Chrome extensions or similar tools for efficient autofill functionality. Ensure compatibility with various platforms and workflows. System Integration: Work with APIs and databases to retrieve user data for dynamic input into forms. Ensure seamless integration of automation tools with our platform. Optimization and Testi...
I'm seeking an expert in Python and Machine Learning to develop a clustering model using my provided CSV/Excel files and complete a python scripts and create power point presentation from the template. Key Tasks: - Develop a clustering model using Python - Analyze the data and implement the model - Present the findings in a PowerPoint presentation geared towards business solutions Ideal Skills: - Proficiency in Python and machine learning - Experience with clustering algorithms - Strong data analysis skills - Excellent PowerPoint presentation skills Please note, the primary goal of this project is the development of a machine learning model, specifically a clustering model. All data will be sourced from C...
I'm seeking an expert to create technical drawings for social media (instagram, facebook) as well as a comprehensive product roadmap that incorporates machine learning and AI elements. Key Requirements: - Creation of detailed technical drawings. - Development of a product roadmap leveraging machine learning, AI, and python. - Producing quality output is must Your bid should demonstrate your skills and experience in these areas.
...developer to build a solution that identifies arbitrage opportunities using the sqrtPriceX96 value of token pairs across multiple decentralized exchanges (DEXs). The goal is to automate the process of finding and executing arbitrage opportunities by monitoring token pair prices on DEXs like Uniswap v3, Sushiswap, and others. The solution should follow a step-by-step process: 1. Query the liquidity pools of various DEXs for the sqrtPriceX96 values of token pairs. 2. Convert the sqrtPriceX96 values to actual token prices. 3. Identify price differences between DEXs to spot potential arbitrage opportunities. 4. Account for transaction fees (gas and conversion) when calculating potential profits. 5. Continuously monitor and automatically execute arbit...
Hi leotung1104, I noticed your profile and would like to know if you know how to web scrape with python
...content creator with a strong background in Python programming and social media marketing to generate intermediate-level Python programming tutorials for Instagram. Key Requirements: - Create engaging, easy-to-follow, and educational Instagram posts covering Python programming tutorials aimed at an intermediate audience. - Understand and implement Instagram's best practices for post creation to maximize viewer engagement and information retention. - Expertise in Python programming, with the ability to break down complex concepts into digestible content. - Previous experience with creating technical content for social media platforms is a plus. This project will require a combination of technical programming knowledge, cont...
...skilled Software Developer with expertise in Python and Node.js to join our team on a project basis. The ideal candidate will be responsible for troubleshooting and resolving issues in our existing applications hosted on a Digital Ocean server. **Responsibilities:** - Analyze and troubleshoot existing Python code and Node.js applications to identify issues and improve performance. - Implement fixes and enhancements to ensure optimal operation and security of applications. - Collaborate with the development team to discuss issues, propose solutions, and deploy fixes. - Manage deployments and updates on a Digital Ocean server environment. - Document all work performed, including code changes and troublesh...
I need a freelancer who can help me change the public...key is already available in the OVH dashboard. Your task is to change the SSH key via the OVH website, using Anydesk for remote access. Requirements: • You will not be provided with the private SSH key for the new SSH key. • You must change the SSH key through the OVH website interface only. • Anydesk will be used for secure remote access to the system. • Ensure no interruptions or issues with the instance’s access after making the change. Skills Required: • Experience with OVH cloud platform and managing instances. • Proficiency in working with SSH keys. • Anydesk usage for remote troubleshooting or configuration. Please apply only if you are confident in performing th...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I expect this to be completed within three days...
I'm looking for a skilled data analyst and Python programmer to create a code in Jupyter Notebook for analyzing data from Excel files. The project involves: - Primarily focusing on data analysis - Utilizing Pandas and NumPy libraries Ideal candidates should have: - Extensive experience with data analysis and Python programming - Proficiency in using Pandas and NumPy - Ability to work with Excel files - Familiarity with Jupyter Notebook Please include in your bid examples of similar projects you've completed. You are required to write the necessary program and create an effective presentation describing: The military spending of at least the top 10 nations (in military spending) Compare the data to that country’s...
...am looking to create a Virtual Developer Assistant, an AI-powered system that acts like a full-time developer. This assistant should be capable of: Building complete systems and applications based on user inputs (e.g., backend, frontend, databases). Modifying existing systems to adapt them to new requirements. Developing complete applications for web and mobile platforms. Deploying systems automatically to platforms like Heroku, Vercel, or custom servers. The AI assistant must function like a professional employee, capable of handling coding tasks autonomously. The user should only provide high-level instructions, and the assistant should deliver complete, functional systems. Key Requirements: AI Features: Use of OpenAI models (e.g., Codex, GPT) for code g...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I'm looking for a skilled Python developer with experience in building web-based content management systems (CMS). This project involves creating a CMS with specific features and functionalities tailored to our needs. Key Project Requirements: - Develop a robust, user-friendly web application with Python. - Implement a comprehensive content management system. - Incorporate essential features such as user roles and permissions to manage access and control content. Ideal Skills and Experience: - Proficient in Python with a strong portfolio of web applications. - Prior experience in developing content management systems is a plus. - Understanding and expertise in implementing user roles and permissions.
I'm seeking a Python expert to develop a script that automates sending documents from Google Docs to an email. The script should utilize the 'requests' library and employ 'OAuth2' for secure access. The ideal candidate should have experience with: - Python scripting - Google Docs API - Requests library - OAuth2 implementation The project will involve: - Automating the process of sending documents from Google Docs to an email - Ensuring the use of secure OAuth2 consent screen for authentication Please note, the specifics regarding the email service have not yet been determined. Your flexibility and expertise in navigating this will be crucial.
...preferences and tone of each client. The goal is to create a system where, before generating content, users can select a client, and the tool will adjust its writing approach based on predefined client-specific parameters stored in a database. In addition, the tool should be able to learn and adapt its writing style over time by analyzing submitted content, allowing it to better understand and mimic each client’s voice. Since this is my first time using AI technologies for content generation, I would appreciate guidance and suggestions from an experienced developer on how best to build this tool. Scope of Work: Client-Specific Model Customization: Develop a system where users can select a client (e.g., Client A, Client B, etc.), and...
...skilled developer to create a dynamic reverse proxy solution using and http-proxy-middleware. The proxy must function similarly to , offering seamless web proxy functionality with integration of a Service Worker on the frontend for advanced request handling. Requirements: Backend (Proxy Server): Build a reverse proxy using and http-proxy-middleware. Support dynamic target selection, routing requests to different backends based on specific rules (e.g., request paths, query parameters, or custom headers). Forward headers, cookies, and other request/response metadata correctly to emulate CroxyProxy's behavior. Implement custom middleware to modify or log requests and responses as required. Fro...
... and update my Shopify store. The existing products in my store must be updated with the following parameters: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Inventory by Variant - Variants (color, size, etc.) - SKU If the products on the supplier's site are not in my store, they should be created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Lib...
I need an expert in Python and natural language processing (NLP) with NLTK to help me analyze text from company blogs for negative message framing. Key Focus Areas: - Language Sentiment: I'm interested in how the language used in these blogs frames positive and negative messages. - Persuasive Techniques: I want to understand the persuasive techniques employed in these positive and negative framings. Ideal Skills: - Proficiency in Python and NLTK - Strong background in NLP - Experience with sentiment analysis and understanding of persuasive techniques in language - Ability to interpret and present findings in an insightful manner. Please note, the analysis will focus specifically on detecting and interpreting negative...
I have to do the coding for attiny 85 to control the led and buzzer based on the buzz wire.
...in this field required. Using DEX’s, uniswap, kyber, 0x, bancor, balancer, sushiswap etc. Preferably Python but not mandatory. Preferably VS Code. Some of #1 have been done in Python and but requires serious testing. Stage 1 (Proof of concept): Obtain batch pricing of DEX coins from , thegraph or etc. Create a GUI frontend for identifying, highlighting opportunities. Textbox for minimum % profit, excluding all others. Implement profitably of trade with total cost of trade, including gas fees. Possibly implement triangular trade analysis for obscure trading opportunities. Stage 2 (Implementation of trades): Wallet code for trading. Implement buying and selling of identified pairs within/across exchanges and bloc...
I'm in need of a comprehensive hospital management system developed in Python. The system should primarily encompass patient management and medical records features. Key Components: - **Patient Management**: This module should facilitate seamless patient registration etc - **Medical Records**: Although I haven't specified particular features for this module, it's crucial that the system can handle electronic health records, lab results, and prescription management. Ideal candidates for this project should have proven experience in Python development, particularly in creating healthcare management systems. They should be adept in managing databases and ensuring the security and confidentiality of sensitive medical information. Prior...
I'm in need of a Python script that can extract numerical data from an Excel/CSV file. The ideal freelancer for this project should: - Have extensive experience with Python, particularly in data extraction. - Be proficient with handling Excel and CSV files. - Be able to write clean, efficient code. Please note, the data will be purely numerical. The script will need to be able to handle large datasets with ease.
Project Description: Turnkey Web Application Development Using Django MAXIMUM BUDGET: USD 2,250. 1. Project Conditions Exclusive internal use: The application is intended only for the employees of the importing company. No external users will have access or be able to make purchases through the application. Deadline: 3 weeks from the project award. Current status: The project is already 20% complete. Partial deliveries: At least 2 partial revisions are required before the final delivery for feedback. 2. Objective Develop a turnkey web application for an importing company that facilitates: - Management of customer orders. - Consolidation of purchases made from factories. - Administration of an inventory. - Registration and customization of client informatio...
...a thorough security check on the backend of my website and my applications. The scope of the security evaluation includes: - **Data Protection and Encryption**: Ensuring that my data is secure and properly encrypted, safeguarding it from potential breaches. - **Authentication and Authorization**: Verifying that access controls are robust, preventing unauthorized access. - **Vulnerability Scanning and Patching**: Identifying potential vulnerabilities and ensuring they are patched appropriately. You will have full access to conduct this assessment, including admin access to the backend, source code access, and limited access through the API. Ideal skills for this project include: - Proficiency in backend technologies (Node.js, Python...
I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.
I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.
...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data&...
I'm in need of a modern e-commerce website designed to sell mobile devices, laptops, tablets, and consoles. The site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site :
I need an expert in machine learning, specifically with experience in fine-tuning the Wav2Vec2 model on custom data. The primary aim is to improve the model's sp...Requirements: - Fine-tune the Wav2Vec2 model on our speech recordings with transcriptions. - The recordings primarily consist of conversations, so the model should be capable of understanding and processing dialogue. - Ultimately, the goal is to enhance the performance of speech recognition on our custom data. - Create future pipeline for 2nd layer of finetuning with Industry specific data Ideal Skills: - Proficiency in Python and Pytorch. - Extensive experience with Wav2Vec2. - Ability to work with labeled speech data and fine-tune models for improved accuracy. - Strong understanding of machine...
...building and teaching a ai or GBT model to manage various marketing tasks. This project will focus on developing an AI that can handle content writing, visual ideas, articles, setting up campaigns, predictive metrics, email campaigns, and SEO optimization. Key Responsibilities: - Design and implement a GBT model for marketing tasks. - Teach the model to effectively handle these tasks. - Provide training on how to utilize the model. Ideal Skills: - Expertise in machine learning, particularly in developing GBT models. - Strong programming skills, particularly in Python. - Previous experience in AI application in marketing is a plus. Please note, while experience in marketing analytics and natural language processing (NLP) can be beneficial, it is not ...
