Web crawling and scraping using python jobs
...Integration () Location: Remote Contract Type: Freelance/Contract Overview: is seeking a skilled AI developer to set up and integrate key features into our AI assistant. The goal is to enable the assistant to efficiently process incoming leads, initiate calls within 5 minutes, and engage with the lead in a personalized manner—calling them by name and collecting relevant information for follow-up. The successful candidate will work closely with our team to refine this process and ensure a seamless, high-quality user experience. Responsibilities: Lead Detection and Processing: Configure the AI assistant to detect incoming leads in real time and trigger an automatic call within 5 minutes of receiving the lead’s information. Person...
I am looking for a skilled Python or JS developer with expertise in web scraping, Selenium, and HTML parsing to enhance and complete a job scraping tool for the Adzuna job portal. Project Goals: code must fetch all job listings from Adzuna for a given search query URL (e.g., ). Handle cases where JSON-LD data is missing by falling back to HTML parsing to extract all relevant details. Current Issues: my code scrapes some job data (titles, descriptions, company names, etc.), but many fields remain blank. Not all job listings are fetched; the script currently stops at ~157 jobs out of ~410 listed. Fallback HTML parsing is insufficient, leaving many fields incomplete. Requirements: Comprehensive Data Extraction: Fetch all job listings from
I am seeking a seasoned Selenium and Python professional who can assist me with automating the scraping of data from various e-commerce sites. Ideal Skills and Experience: - Proficient in Python and Selenium - Strong experience in web scraping - Familiarity with e-commerce websites - Understanding of data extraction and processing - Knowledge of legality and ethics in web scraping Please note, while the primary focus is on scraping product information, the scope may extend to other types of data as needed.
I...enable the script to buy and sell fungible tokens. Example token to buy "oraim8c9d1nkfuQk9EzGYEUGxqL3MHQYndRw1huVo5h" I have the RPC_ENDPOINT = "CHAINSTACK_NODE" <API Key> Key Requirements: - Modify the existing script for automated buying and selling of fungible tokens. - Implement transaction logging within the script for tracking purposes. Ideal Skills: - Extensive experience with Solana platform. - Proficient in scripting for fungible token trading. - Prior work with creating automated trading scripts. - Capable of implementing logging within scripts. Only wtih python Solana version 0.36.2
I'm looking for an expert in PSS/E using Python who can model the Reactive Power Capability of Solar PV.
I'm in need of a Python expert who can assist me with a web scraping project. The primary focus of this project is to scrape user data from various websites. Skills & Experience Required: - Extensive knowledge and experience with Python, particularly in web scraping libraries such as BeautifulSoup, Scrapy, etc. - Familiarity with handling and parsing user data. - Prior experience with web scraping projects. - Understanding of ethical considerations and legal restrictions related to web scraping. - Ability to deliver clean, well-documented code. Please note that the exact websites from which data needs to be scraped will be determined later, so flexibility and adaptability are key.
years of experience 8 years . Proven experience in Amazon Alexa . Hands-on experience in OpenSearch, Kefka, Splunk, Glue,pyspark,EMR, Lambda,dynamo DB . Coding: python,c++, Java, object-oriented language, or other modern programming language . Integrate Alexa skills with third-party APIs, databases, and other systems
years of experience 8 years . Proven experience in Amazon Alexa . Hands-on experience in OpenSearch, Kefka, Splunk, Glue,pyspark,EMR, Lambda,dynamo DB . Coding: python,c++, Java, object-oriented language, or other modern programming language . Integrate Alexa skills with third-party APIs, databases, and other systems
I have a Python file that works but needs finishing off with the addition of new API endpoints. It also requires quality assurance, integration to AWS Lambda, setting up API Gateway and an EC2 instance. Ideal Skills: - Proficient in Python - Telegram inline markup - Experience with AWS services (Lambda, EC2, API Gateway) - Strong in Quality Assurance The additional functionality required includes: - Implementing new API endpoints - Ensuring these endpoints facilitate data retrieval and data submission Please note, the existing Python file is functional, the work mainly revolves around adding new features and ensuring everything runs smoothly on AWS.
I'm seeking an SEO expert with a particular focus on technical aspects, specifically website crawling and indexing. Key Responsibilities: - Improve the website's crawling and indexing capabilities. - Conduct a thorough analysis to identify any potential barriers. - Implement necessary adjustments to enhance overall SEO performance. Ideal Skills: - Strong understanding of Technical SEO. - Proficiency in using SEO tools for monitoring and analysis. - Experience with improving website crawlability and indexation. Please note that the project doesn't currently involve fixing broken links or 404 errors, addressing duplicate content, or optimizing crawl budget. However, should these issues arise, I would appreciate your expertise...
I am looking for a skilled professional who can create Power BI and Python-based dashboards to provide actionable insights for a superstore focusing on the ready-to-eat or cooked food category, as well as for a restaurant business. The project involves working with sample data (you can either create data or use existing publicly available datasets) to generate comprehensive insights.
I'm looking for a skilled web scraper to help me extract data from HTML tables on a website and input it into a Google Sheet. Key details: - The data is updated every 30 minutes, so I need someone who can set up a server that handles this automated process - The tables contain mixed text and numbers. Attention to detail is crucial as the data will need to be accurately transcribed. Ideal skills for the job include: - Proficiency in web scraping tools and techniques preferably selenium - Experience with Google Sheets API. - Strong attention to detail and ability to handle mixed data types. I look forward to your bids.
I'm in need of a Python Selenium expert for a project. While the specific details are still being finalized, the ideal candidate would be someone with: - Proficiency in Python and Selenium - Experience in web scraping, automated testing, and browser automation - Flexibility to adapt to different types of web applications - Capability to support automation across multiple browsers Please reach out if you have the necessary skills and experience.
I am in need of a Python developer with substantial experience in Django for web development. The primary focus of this project is to develop a web application with a robust REST API. Key Requirements: - Extensive experience with Python and Django - Strong understanding of web development principles - Proven track record of developing REST APIs Ideal Skills: - Python - Django - Web Development - REST API Development
I'm in need of a skilled freelancer with extensive experience in Zoho CRM and database management to synchronize our Zoho CRM with our database. Key Responsibilities: 1. Data Update & Cleanup: - Align our CRM with the database by adding missing fields, such as 'Subscription', 'Rating'. - Identify and clean duplicate and dead records, i.e. blocked email addresses. 2. Database Synchronization: - Develop a Python script for fetching data from our database and updating or adding records in Zoho CRM. - Ensure the script is capable of handling incremental updates and can operate on a set schedule. 3. Documentation & Automation: - Create clear and concise documentation detailing the cleanup an...
...Language Model to summarize and condense lengthy educational materials, such as full-length lectures and PDFs, into concise and easily digestible formats like video snippets, infographics, and text summaries. The goal is to enhance learning efficiency by transforming complex information into byte-sized content. Key requirements: - The system should be able to process a variety of sources for content generation, including full-length lectures, PDFs, and web articles. - It should also be capable of incorporating interactive elements into the summarized content, such as quizzes, clickable links, and interactive diagrams. Ideal skills and experience for the job: - Proficiency in developing systems powered by Large Language Models. - ...
...extraction tasks. The project includes integration with LangChain TypeScript (TS) and the implementation of feedback loops to ensure a robust validation process, including ZOD validation. Key Objectives: 1. Pipeline Development: • Build a pipeline that fine-tunes open-source models for extracting specific data from text inputs. • Ensure the pipeline supports continuous improvement with fine-tuning iterations. 2. LangChain Integration: • Integrate LangChain TS for improved processing, chaining, and orchestration of model inputs and outputs. 3. Feedback Loops and Validation: • Implement feedback loops to improve model outputs over time. • Apply ZOD validation for robust schema validation of the JSON outputs. 4. Data and...
... and Science Exchange. The platform will connect vendors offering scientific services/products with buyers from academic institutions, biotech companies, and pharmaceutical firms. Project Requirements The project will include the development of the following core components: 1. Admin Panel Comprehensive dashboard to manage users, transactions, approvals, and overall platform settings. 2. Vendor Panel A dedicated space for service providers to list their offerings, manage orders, update availability, and communicate with buyers. 3. Buyer Panel A user-friendly interface for researchers and companies to browse services, request quotes, place orders, and track project progress. 4. Marketplace Frontend A public-facing platform where buyers can searc...
I am looking for a skilled software developer with expertise in Python to create a fully functional Windows application. This application should support the RTSP media streaming protocol and utilize the FFmpeg media processing library. Key Skills Required: - Proficiency in Python - Experience with RTSP media streaming protocol - Extensive knowledge of FFmpeg - Familiarity with Windows application development frameworks (like WinForms or WPF) - Competence in network programming and socket development Deliverables: 1. A fully functional Windows application that meets the outlined requirements. 2. Well-documented source code with proper comments. 3. An installation package for easy deployment. 4. A user manual tailored for non-technical users. The ideal candidat...
The seismic reports and project of a steel-structured house . The analysis of this house needs to be performed in the SAP2000 program in accordance with TBDY 2018 and Turkish geotechnical survey report is provided in house project and geotechnical report will be provided to you.
I'm looking for a Python expert who can help analyze our customer data. - The primary goal of this project is to derive insights from our customer data to drive business decisions. - The data is stored in databases, so experience with SQL and database management is a plus. - A strong background in data analysis and Python is essential for this project. Please include your relevant experience and examples of similar projects you've completed in your proposal.
Backend API Development Using TypeScript & Node.js - Sign-in, Signup, Reset Password, Forgot Password & Verify OTP - Dashboard Stats - Workspace and Project APIs - Packages and Payment APIs - Profile Update and Change Password - Contact Us - Admin APIs
...random URLs visit duration: random urls top to bottom scroll speed (file path option and website API option) (file path option and website API option) option Select click based on "selector/xpath" (Example if click option is selected then it should click on selected banner/ads and do activity like slow scroll, wait time and visit internal link. ) 10. Click ctr control option. ------------------------------- Youtube: url 2. traffic source: Google search, Bing search,Facebook,Quora,Direct, custom url (EX:if google is selected then need option to enter keyword) (file path option and website API option) (file path option and website API option) 4. No .of visits 5. Visit duration Min Sec/Max sec More points will be add...
I’m looking for an experienced web developer to create a Minimum Viable Product (MVP) version of a basketball stats website. The website will feature sortable and filterable dashboards for players and teams in the 2025 NBA season. This is a small-scale project aimed at validating the concept before expanding to additional features. Project Scope: Player Dashboard: Display data for 400 players with ~50 data points each (e.g., points, assists, advanced stats). Include filtering, sorting, and color-coded rows (green-to-red scales based on performance metrics). Team Dashboard: Display data for 30 teams with ~50 data points each. Include filtering, sorting, and comparison functionality for multiple teams. User Interface: A clean, responsive design for b...
I'm seeking a skilled Python developer to create a program for analyzing text data from databases. Key Responsibilities: - Develop a Python program primarily for data analysis. - Extract and analyze text data from various databases. Ideal Skills and Experience: - Proficient in Python with a strong focus on data analysis. - Extensive experience with text data processing. - Familiarity with database handling and extraction. - Ability to create efficient and effective data analysis tools.
...including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The t...
I need a desktop-based software for an ESP32 development module educational kit. This software should...software for an ESP32 development module educational kit. This software should allow users to write code, compile and upload it to the module. It should support different sensors and provide a user-friendly Graphical User Interface (GUI). Key Requirements: - Code writing in Scratch, C and Python - Compilation and uploading to the ESP32 module - Interaction with various sensors - Intuitive GUI - Compatibility with Windows and MacOS Ideal Skills: - Proficient in software development for educational purposes - Experience with ESP32 and various sensors - Skilled in creating GUI software - Knowledgeable in Scratch, C and Python...
Instructions for Data Scraping Task Your task is to extract specific information from job posting links. Below are the detailed requirements: Data Points to Scrape: 1. Company Information: - Company Name - Company Details: Brief about the industry or type of work they do. - Company Website - LinkedIn Page: URL to the company’s official LinkedIn page. 2. Email IDs (3 Required): - Find 3 individuals' email IDs from the following departments: - Admin - Human Resources - Head of Sales/Top Leadership (CXO level in Sales) - Marketing Head/Top Leadership (CXO level in Marketing) - Founders/CEOs/Co-founders/Owners 3. Email Requirement: - The email IDs must be professional (e.g., `name at `). - Avoid generic emails like `info@`,...
...Data Entry and Autofill Systems We are looking for an experienced Automation Engineer to help develop tools for automating data entry and form autofill processes. This project requires expertise in building efficient, user-friendly automation systems tailored to diverse online workflows. Responsibilities Automation Development: Design and implement solutions for automating form completion using structured data. Develop Chrome extensions or similar tools for efficient autofill functionality. Ensure compatibility with various platforms and workflows. System Integration: Work with APIs and databases to retrieve user data for dynamic input into forms. Ensure seamless integration of automation tools with our platform. Optimization and Testi...
I'm seeking an expert in Python and Machine Learning to develop a clustering model using my provided CSV/Excel files and complete a python scripts and create power point presentation from the template. Key Tasks: - Develop a clustering model using Python - Analyze the data and implement the model - Present the findings in a PowerPoint presentation geared towards business solutions Ideal Skills: - Proficiency in Python and machine learning - Experience with clustering algorithms - Strong data analysis skills - Excellent PowerPoint presentation skills Please note, the primary goal of this project is the development of a machine learning model, specifically a clustering model. All data will be sourced from C...
I'm seeking an expert to create technical drawings for social media (instagram, facebook) as well as a comprehensive product roadmap that incorporates machine learning and AI elements. Key Requirements: - Creation of detailed technical drawings. - Development of a product roadmap leveraging machine learning, AI, and python. - Producing quality output is must Your bid should demonstrate your skills and experience in these areas.
...developer to build a solution that identifies arbitrage opportunities using the sqrtPriceX96 value of token pairs across multiple decentralized exchanges (DEXs). The goal is to automate the process of finding and executing arbitrage opportunities by monitoring token pair prices on DEXs like Uniswap v3, Sushiswap, and others. The solution should follow a step-by-step process: 1. Query the liquidity pools of various DEXs for the sqrtPriceX96 values of token pairs. 2. Convert the sqrtPriceX96 values to actual token prices. 3. Identify price differences between DEXs to spot potential arbitrage opportunities. 4. Account for transaction fees (gas and conversion) when calculating potential profits. 5. Continuously monitor and automatically execute arbit...
Hi leotung1104, I noticed your profile and would like to know if you know how to web scrape with python
...content creator with a strong background in Python programming and social media marketing to generate intermediate-level Python programming tutorials for Instagram. Key Requirements: - Create engaging, easy-to-follow, and educational Instagram posts covering Python programming tutorials aimed at an intermediate audience. - Understand and implement Instagram's best practices for post creation to maximize viewer engagement and information retention. - Expertise in Python programming, with the ability to break down complex concepts into digestible content. - Previous experience with creating technical content for social media platforms is a plus. This project will require a combination of technical programming knowledge, cont...
...skilled Software Developer with expertise in Python and Node.js to join our team on a project basis. The ideal candidate will be responsible for troubleshooting and resolving issues in our existing applications hosted on a Digital Ocean server. **Responsibilities:** - Analyze and troubleshoot existing Python code and Node.js applications to identify issues and improve performance. - Implement fixes and enhancements to ensure optimal operation and security of applications. - Collaborate with the development team to discuss issues, propose solutions, and deploy fixes. - Manage deployments and updates on a Digital Ocean server environment. - Document all work performed, including code changes and troublesh...
I need a freelancer who can help me change the public...key is already available in the OVH dashboard. Your task is to change the SSH key via the OVH website, using Anydesk for remote access. Requirements: • You will not be provided with the private SSH key for the new SSH key. • You must change the SSH key through the OVH website interface only. • Anydesk will be used for secure remote access to the system. • Ensure no interruptions or issues with the instance’s access after making the change. Skills Required: • Experience with OVH cloud platform and managing instances. • Proficiency in working with SSH keys. • Anydesk usage for remote troubleshooting or configuration. Please apply only if you are confident in performing th...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I expect this to be completed within three days...
I'm looking for a skilled data analyst and Python programmer to create a code in Jupyter Notebook for analyzing data from Excel files. The project involves: - Primarily focusing on data analysis - Utilizing Pandas and NumPy libraries Ideal candidates should have: - Extensive experience with data analysis and Python programming - Proficiency in using Pandas and NumPy - Ability to work with Excel files - Familiarity with Jupyter Notebook Please include in your bid examples of similar projects you've completed. You are required to write the necessary program and create an effective presentation describing: The military spending of at least the top 10 nations (in military spending) Compare the data to that country’s...
...am looking to create a Virtual Developer Assistant, an AI-powered system that acts like a full-time developer. This assistant should be capable of: Building complete systems and applications based on user inputs (e.g., backend, frontend, databases). Modifying existing systems to adapt them to new requirements. Developing complete applications for web and mobile platforms. Deploying systems automatically to platforms like Heroku, Vercel, or custom servers. The AI assistant must function like a professional employee, capable of handling coding tasks autonomously. The user should only provide high-level instructions, and the assistant should deliver complete, functional systems. Key Requirements: AI Features: Use of OpenAI models (e.g., Codex, GPT) for code g...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I'm looking for a skilled Python developer with experience in building web-based content management systems (CMS). This project involves creating a CMS with specific features and functionalities tailored to our needs. Key Project Requirements: - Develop a robust, user-friendly web application with Python. - Implement a comprehensive content management system. - Incorporate essential features such as user roles and permissions to manage access and control content. Ideal Skills and Experience: - Proficient in Python with a strong portfolio of web applications. - Prior experience in developing content management systems is a plus. - Understanding and expertise in implementing user roles and permissions.
I'm seeking a Python expert to develop a script that automates sending documents from Google Docs to an email. The script should utilize the 'requests' library and employ 'OAuth2' for secure access. The ideal candidate should have experience with: - Python scripting - Google Docs API - Requests library - OAuth2 implementation The project will involve: - Automating the process of sending documents from Google Docs to an email - Ensuring the use of secure OAuth2 consent screen for authentication Please note, the specifics regarding the email service have not yet been determined. Your flexibility and expertise in navigating this will be crucial.
...preferences and tone of each client. The goal is to create a system where, before generating content, users can select a client, and the tool will adjust its writing approach based on predefined client-specific parameters stored in a database. In addition, the tool should be able to learn and adapt its writing style over time by analyzing submitted content, allowing it to better understand and mimic each client’s voice. Since this is my first time using AI technologies for content generation, I would appreciate guidance and suggestions from an experienced developer on how best to build this tool. Scope of Work: Client-Specific Model Customization: Develop a system where users can select a client (e.g., Client A, Client B, etc.), and...
...skilled developer to create a dynamic reverse proxy solution using and http-proxy-middleware. The proxy must function similarly to , offering seamless web proxy functionality with integration of a Service Worker on the frontend for advanced request handling. Requirements: Backend (Proxy Server): Build a reverse proxy using and http-proxy-middleware. Support dynamic target selection, routing requests to different backends based on specific rules (e.g., request paths, query parameters, or custom headers). Forward headers, cookies, and other request/response metadata correctly to emulate CroxyProxy's behavior. Implement custom middleware to modify or log requests and responses as required. Fro...
... and update my Shopify store. The existing products in my store must be updated with the following parameters: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Inventory by Variant - Variants (color, size, etc.) - SKU If the products on the supplier's site are not in my store, they should be created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Lib...
I need an expert in Python and natural language processing (NLP) with NLTK to help me analyze text from company blogs for negative message framing. Key Focus Areas: - Language Sentiment: I'm interested in how the language used in these blogs frames positive and negative messages. - Persuasive Techniques: I want to understand the persuasive techniques employed in these positive and negative framings. Ideal Skills: - Proficiency in Python and NLTK - Strong background in NLP - Experience with sentiment analysis and understanding of persuasive techniques in language - Ability to interpret and present findings in an insightful manner. Please note, the analysis will focus specifically on detecting and interpreting negative...
I have to do the coding for attiny 85 to control the led and buzzer based on the buzz wire.
...in this field required. Using DEX’s, uniswap, kyber, 0x, bancor, balancer, sushiswap etc. Preferably Python but not mandatory. Preferably VS Code. Some of #1 have been done in Python and but requires serious testing. Stage 1 (Proof of concept): Obtain batch pricing of DEX coins from , thegraph or etc. Create a GUI frontend for identifying, highlighting opportunities. Textbox for minimum % profit, excluding all others. Implement profitably of trade with total cost of trade, including gas fees. Possibly implement triangular trade analysis for obscure trading opportunities. Stage 2 (Implementation of trades): Wallet code for trading. Implement buying and selling of identified pairs within/across exchanges and bloc...
