Web scraping using python guiKazi
I am looking for a skilled Python or JS developer with expertise in web scraping, Selenium, and HTML parsing to enhance and complete a job scraping tool for the Adzuna job portal. Project Goals: code must fetch all job listings from Adzuna for a given search query URL (e.g., ). Handle cases where JSON-LD data is missing by falling back to HTML parsing to extract all relevant details. Current Issues: my code scrapes some job data (titles, descriptions, company names, etc.), but many fields remain blank. Not all job listings are fetched; the script currently stops at ~157 jobs out of ~410 listed. Fallback HTML parsing is insufficient, leaving many fields incomplete. Requirements: Comprehensive Data Extraction: Fetch all job listings from
I am seeking a seasoned Selenium and Python professional who can assist me with automating the scraping of data from various e-commerce sites. Ideal Skills and Experience: - Proficient in Python and Selenium - Strong experience in web scraping - Familiarity with e-commerce websites - Understanding of data extraction and processing - Knowledge of legality and ethics in web scraping Please note, while the primary focus is on scraping product information, the scope may extend to other types of data as needed.
I need an experienced developer to modify a script ... Example token to buy "oraim8c9d1nkfuQk9EzGYEUGxqL3MHQYndRw1huVo5h" I have the RPC_ENDPOINT = "CHAINSTACK_NODE" <API Key> Key Requirements: - Modify the existing script for automated buying and selling of fungible tokens. - Implement transaction logging within the script for tracking purposes. Ideal Skills: - Extensive experience with Solana platform. - Proficient in scripting for fungible token trading. - Prior work with creating automated trading scripts. - Capable of implementing logging within scripts. Only wtih python Solana version 0.36.2
I'm looking for an expert in PSS/E using Python who can model the Reactive Power Capability of Solar PV.
I'm in need of a Python expert who can assist me with a web scraping project. The primary focus of this project is to scrape user data from various websites. Skills & Experience Required: - Extensive knowledge and experience with Python, particularly in web scraping libraries such as BeautifulSoup, Scrapy, etc. - Familiarity with handling and parsing user data. - Prior experience with web scraping projects. - Understanding of ethical considerations and legal restrictions related to web scraping. - Ability to deliver clean, well-documented code. Please note that the exact websites from which data needs to be scraped will be determined later, so flexibility and adaptability are key.
years of experience 8 years . Proven experience in Amazon Alexa . Hands-on experience in OpenSearch, Kefka, Splunk, Glue,pyspark,EMR, Lambda,dynamo DB . Coding: python,c++, Java, object-oriented language, or other modern programming language . Integrate Alexa skills with third-party APIs, databases, and other systems
years of experience 8 years . Proven experience in Amazon Alexa . Hands-on experience in OpenSearch, Kefka, Splunk, Glue,pyspark,EMR, Lambda,dynamo DB . Coding: python,c++, Java, object-oriented language, or other modern programming language . Integrate Alexa skills with third-party APIs, databases, and other systems
I have a Python file that works but needs finishing off with the addition of new API endpoints. It also requires quality assurance, integration to AWS Lambda, setting up API Gateway and an EC2 instance. Ideal Skills: - Proficient in Python - Telegram inline markup - Experience with AWS services (Lambda, EC2, API Gateway) - Strong in Quality Assurance The additional functionality required includes: - Implementing new API endpoints - Ensuring these endpoints facilitate data retrieval and data submission Please note, the existing Python file is functional, the work mainly revolves around adding new features and ensuring everything runs smoothly on AWS.
I am looking for a skilled professional who can create Power BI and Python-based dashboards to provide actionable insights for a superstore focusing on the ready-to-eat or cooked food category, as well as for a restaurant business. The project involves working with sample data (you can either create data or use existing publicly available datasets) to generate comprehensive insights.
I'm looking for a skilled web scraper to help me extract data from HTML tables on a website and input it into a Google Sheet. Key details: - The data is updated every 30 minutes, so I need someone who can set up a server that handles this automated process - The tables contain mixed text and numbers. Attention to detail is crucial as the data will need to be accurately transcribed. Ideal skills for the job include: - Proficiency in web scraping tools and techniques preferably selenium - Experience with Google Sheets API. - Strong attention to detail and ability to handle mixed data types. I look forward to your bids.
I'm in need of a Python Selenium expert for a project. While the specific details are still being finalized, the ideal candidate would be someone with: - Proficiency in Python and Selenium - Experience in web scraping, automated testing, and browser automation - Flexibility to adapt to different types of web applications - Capability to support automation across multiple browsers Please reach out if you have the necessary skills and experience.
I am in need of a Python developer with substantial experience in Django for web development. The primary focus of this project is to develop a web application with a robust REST API. Key Requirements: - Extensive experience with Python and Django - Strong understanding of web development principles - Proven track record of developing REST APIs Ideal Skills: - Python - Django - Web Development - REST API Development
...'Subscription', 'Rating'. - Identify and clean duplicate and dead records, i.e. blocked email addresses. 2. Database Synchronization: - Develop a Python script for fetching data from our database and updating or adding records in Zoho CRM. - Ensure the script is capable of handling incremental updates and can operate on a set schedule. 3. Documentation & Automation: - Create clear and concise documentation detailing the cleanup and synchronization processes. - Automate the sync script for regular execution (e.g., hourly via crontab). Ideal Skills: - Extensive experience with Zoho CRM and its API. - High proficiency in SQL and Python. - Strong familiarity with data cleaning and automation tools. Please reach out if you're int...
...educational materials, such as full-length lectures and PDFs, into concise and easily digestible formats like video snippets, infographics, and text summaries. The goal is to enhance learning efficiency by transforming complex information into byte-sized content. Key requirements: - The system should be able to process a variety of sources for content generation, including full-length lectures, PDFs, and web articles. - It should also be capable of incorporating interactive elements into the summarized content, such as quizzes, clickable links, and interactive diagrams. Ideal skills and experience for the job: - Proficiency in developing systems powered by Large Language Models. - Experience with content summarization and transformation. - Ability to create interactive elements...
...training and evaluation. • Provide recommendations on the data split for training, validation, and testing. 6. Documentation: • Provide detailed documentation of the pipeline, processes, and integration for future reference and scalability. Requirements: • Expertise in NLP, fine-tuning open-source models, and data extraction. • Proficiency in LangChain TS and ZOD validation. • Strong skills in Python and/or TypeScript. • Ability to deliver both technical solutions and comprehensive documentation. Deliverables: 1. Fully functional pipeline for fine-tuning and data extraction. 2. Integration of LangChain and feedback loops for validation. 3. Finalized and validated JSON outputs adhering to the provided schema. 4. Comprehensive documentatio...
...Marketplace Frontend. Documentation for platform usage and maintenance. Technical Architecture Front-end: Technologies: React, Vue, or Angular for dynamic UIs. User Experience: Must be seamless for both buyers and sellers, featuring fast loading pages, easy navigation, and responsive design. Responsive Design: Ensure the site works smoothly on mobile, tablet, and desktop. Back-end: Framework: Django (Python), Express (Node.js), Ruby on Rails, or similar. Database: PostgreSQL, MySQL, or MongoDB. Microservices vs Monolithic: Start monolithic for simplicity and refactor into microservices as you scale. APIs: RESTful or GraphQL to facilitate communication between front-end and back-end. Hosting & Deployment: Cloud Providers: AWS, Azure, or Google Cloud Platform. CI/CD: Implement...
I am looking for a skilled software developer with expertise in Python to create a fully functional Windows application. This application should support the RTSP media streaming protocol and utilize the FFmpeg media processing library. Key Skills Required: - Proficiency in Python - Experience with RTSP media streaming protocol - Extensive knowledge of FFmpeg - Familiarity with Windows application development frameworks (like WinForms or WPF) - Competence in network programming and socket development Deliverables: 1. A fully functional Windows application that meets the outlined requirements. 2. Well-documented source code with proper comments. 3. An installation package for easy deployment. 4. A user manual tailored for non-technical users. The ideal candidate for this pro...
The seismic reports and project of a steel-structured house . The analysis of this house needs to be performed in the SAP2000 program in accordance with TBDY 2018 and Turkish geotechnical survey report is provided in house project and geotechnical report will be provided to you.
I'm looking for a Python expert who can help analyze our customer data. - The primary goal of this project is to derive insights from our customer data to drive business decisions. - The data is stored in databases, so experience with SQL and database management is a plus. - A strong background in data analysis and Python is essential for this project. Please include your relevant experience and examples of similar projects you've completed in your proposal.
Backend API Development Using TypeScript & Node.js - Sign-in, Signup, Reset Password, Forgot Password & Verify OTP - Dashboard Stats - Workspace and Project APIs - Packages and Payment APIs - Profile Update and Change Password - Contact Us - Admin APIs
...tuning and efficient vector database management. The goal is to build a robust system that integrates seamlessly with a Flask-based interface (developed by our team) to manage fine-tuning and document workflows. Key Deliverables: - Deploy LLAMA 3.1 with FAISS in Docker, ensuring GPU optimization. - Integrate the setup with a Flask-based GUI for document uploads and fine-tuning management. - Provide clear guidance and best practices for fine-tuning the model using PyTorch. - Offer strategies for organizing and optimizing the FAISS vector database. - Deliver comprehensive documentation for replicating the setup internally. We require someone with experience in deploying LLMs and vector databases who can ensure the system is portable (Docker-based) and capable of delivering...
Requirements: 1. Select Traffic Module: Youtube/Website No of threads Insert human behaviours like mouse movent, scroll etc. Website: 1. Website URL 2. traffic source: Google search, Bing search,Facebook,Quora,Direct, custom url (EX:if google is selected then need option to enter keyword) 3. Webpage top to bottom scroll speed: 4. Visit duration Min Sec/Max sec 5. Visit random URLs: Yes/No ( file path option) 6. random URLs visit duration: random urls top to bottom scroll speed (file path option and website API option) (file path option and website API option) option Select click based on "selector/xpath" (Example if click option is selected then it should click on selected banner/ads and do activity like slow scroll, wait time and visit internal link. ) 10. Click ctr...
I’m looking for an experienced web developer to create a Minimum Viable Product (MVP) version of a basketball stats website. The website will feature sortable and filterable dashboards for players and teams in the 2025 NBA season. This is a small-scale project aimed at validating the concept before expanding to additional features. Project Scope: Player Dashboard: Display data for 400 players with ~50 data points each (e.g., points, assists, advanced stats). Include filtering, sorting, and color-coded rows (green-to-red scales based on performance metrics). Team Dashboard: Display data for 30 teams with ~50 data points each. Include filtering, sorting, and comparison functionality for multiple teams. User Interface: A clean, responsive design for both desktop and mobile users...
I'm seeking a skilled Python developer to create a program for analyzing text data from databases. Key Responsibilities: - Develop a Python program primarily for data analysis. - Extract and analyze text data from various databases. Ideal Skills and Experience: - Proficient in Python with a strong focus on data analysis. - Extensive experience with text data processing. - Familiarity with database handling and extraction. - Ability to create efficient and effective data analysis tools.
...Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The tool must be capable of accurately identifying and extracting the names of companies and their decision-makers. Ideal Skills: - Proficiency in AI and machine learning. - Experience in web scraping and data extraction....
I need a desktop-based software for an ESP32 development module educational kit. This software should allow users to write ...development module educational kit. This software should allow users to write code, compile and upload it to the module. It should support different sensors and provide a user-friendly Graphical User Interface (GUI). Key Requirements: - Code writing in Scratch, C and Python - Compilation and uploading to the ESP32 module - Interaction with various sensors - Intuitive GUI - Compatibility with Windows and MacOS Ideal Skills: - Proficient in software development for educational purposes - Experience with ESP32 and various sensors - Skilled in creating GUI software - Knowledgeable in Scratch, C and Python - Able to ensure cross-plat...
Instructions for Data Scraping Task Your task is to extract specific information from job posting links. Below are the detailed requirements: Data Points to Scrape: 1. Company Information: - Company Name - Company Details: Brief about the industry or type of work they do. - Company Website - LinkedIn Page: URL to the company’s official LinkedIn page. 2. Email IDs (3 Required): - Find 3 individuals' email IDs from the following departments: - Admin - Human Resources - Head of Sales/Top Leadership (CXO level in Sales) - Marketing Head/Top Leadership (CXO level in Marketing) - Founders/CEOs/Co-founders/Owners 3. Email Requirement: - The email IDs must be professional (e.g., `name at `). - Avoid generic emails like `info@`,...
...solutions for automating form completion using structured data. Develop Chrome extensions or similar tools for efficient autofill functionality. Ensure compatibility with various platforms and workflows. System Integration: Work with APIs and databases to retrieve user data for dynamic input into forms. Ensure seamless integration of automation tools with our platform. Optimization and Testing: Optimize solutions for speed, accuracy, and adaptability. Test systems in multiple environments to ensure consistent performance. Reliability and Reporting: Implement error-handling mechanisms and maintain detailed logs for troubleshooting. Create systems that notify or retry when submissions fail. Requirements Technical Skills: Strong proficiency in Python. Expertise in Seleniu...
I'm seeking an expert in Python and Machine Learning to develop a clustering model using my provided CSV/Excel files and complete a python scripts and create power point presentation from the template. Key Tasks: - Develop a clustering model using Python - Analyze the data and implement the model - Present the findings in a PowerPoint presentation geared towards business solutions Ideal Skills: - Proficiency in Python and machine learning - Experience with clustering algorithms - Strong data analysis skills - Excellent PowerPoint presentation skills Please note, the primary goal of this project is the development of a machine learning model, specifically a clustering model. All data will be sourced from CSV/Excel files.
I'm seeking an expert to create technical drawings for social media (instagram, facebook) as well as a comprehensive product roadmap that incorporates machine learning and AI elements. Key Requirements: - Creation of detailed technical drawings. - Development of a product roadmap leveraging machine learning, AI, and python. - Producing quality output is must Your bid should demonstrate your skills and experience in these areas.
We are looking for a skilled developer to build a solution that identifies arbitrage opportunities using the sqrtPriceX96 value of token pairs across multiple decentralized exchanges (DEXs). The goal is to automate the process of finding and executing arbitrage opportunities by monitoring token pair prices on DEXs like Uniswap v3, Sushiswap, and others. The solution should follow a step-by-step process: 1. Query the liquidity pools of various DEXs for the sqrtPriceX96 values of token pairs. 2. Convert the sqrtPriceX96 values to actual token prices. 3. Identify price differences between DEXs to spot potential arbitrage opportunities. 4. Account for transaction fees (gas and conversion) when calculating potential profits. 5. Continuously monitor and automatically execute arbitra...
Hi leotung1104, I noticed your profile and would like to know if you know how to web scrape with python
I'm looking for a skilled content creator with a strong background in Python programming and social media marketing to generate intermediate-level Python programming tutorials for Instagram. Key Requirements: - Create engaging, easy-to-follow, and educational Instagram posts covering Python programming tutorials aimed at an intermediate audience. - Understand and implement Instagram's best practices for post creation to maximize viewer engagement and information retention. - Expertise in Python programming, with the ability to break down complex concepts into digestible content. - Previous experience with creating technical content for social media platforms is a plus. This project will require a combination of technical programming knowledge, cont...
We are seeking a skilled Software Developer with expertise in Python and Node.js to join our team on a project basis. The ideal candidate will be responsible for troubleshooting and resolving issues in our existing applications hosted on a Digital Ocean server. **Responsibilities:** - Analyze and troubleshoot existing Python code and Node.js applications to identify issues and improve performance. - Implement fixes and enhancements to ensure optimal operation and security of applications. - Collaborate with the development team to discuss issues, propose solutions, and deploy fixes. - Manage deployments and updates on a Digital Ocean server environment. - Document all work performed, including code changes and troubleshooting steps. - Provide regular updates on progress and ...
I need a freelancer who can help me change the public SSH key for my OVH instance. The new SSH key is already available in the OVH dashboard. Your task is to change the SSH key via the OVH website, using Anydesk for remote access. Requirements: • You will not be provided with the private SSH key for the new SSH key. • You must change the SSH key through the OVH website interface only. • Anydesk will be used for secure remote access to the system. • Ensure no interruptions or issues with the instance’s access after making the change. Skills Required: • Experience with OVH cloud platform and managing instances. • Proficiency in working with SSH keys. • Anydesk usage for remote troubleshooting or configuration. Please apply only if yo...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software s...can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I expect this to be completed within t...
I'm looking for a skilled data analyst and Python programmer to create a code in Jupyter Notebook for analyzing data from Excel files. The project involves: - Primarily focusing on data analysis - Utilizing Pandas and NumPy libraries Ideal candidates should have: - Extensive experience with data analysis and Python programming - Proficiency in using Pandas and NumPy - Ability to work with Excel files - Familiarity with Jupyter Notebook Please include in your bid examples of similar projects you've completed. You are required to write the necessary program and create an effective presentation describing: The military spending of at least the top 10 nations (in military spending) Compare the data to that country’s GDP, Compare the data to the overa...
...existing systems to adapt them to new requirements. Developing complete applications for web and mobile platforms. Deploying systems automatically to platforms like Heroku, Vercel, or custom servers. The AI assistant must function like a professional employee, capable of handling coding tasks autonomously. The user should only provide high-level instructions, and the assistant should deliver complete, functional systems. Key Requirements: AI Features: Use of OpenAI models (e.g., Codex, GPT) for code generation. Ability to understand user inputs in natural language. Continuous learning to improve over time based on user preferences. Development Scope: Backend: Frameworks like Node.js, PHP (Laravel), or Python. Frontend: Modern technologies like React.js, Vue.js, or other...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I'm looking for a skilled Python developer with experience in building web-based content management systems (CMS). This project involves creating a CMS with specific features and functionalities tailored to our needs. Key Project Requirements: - Develop a robust, user-friendly web application with Python. - Implement a comprehensive content management system. - Incorporate essential features such as user roles and permissions to manage access and control content. Ideal Skills and Experience: - Proficient in Python with a strong portfolio of web applications. - Prior experience in developing content management systems is a plus. - Understanding and expertise in implementing user roles and permissions.
I'm seeking a Python expert to develop a script that automates sending documents from Google Docs to an email. The script should utilize the 'requests' library and employ 'OAuth2' for secure access. The ideal candidate should have experience with: - Python scripting - Google Docs API - Requests library - OAuth2 implementation The project will involve: - Automating the process of sending documents from Google Docs to an email - Ensuring the use of secure OAuth2 consent screen for authentication Please note, the specifics regarding the email service have not yet been determined. Your flexibility and expertise in navigating this will be crucial.
...create a system where, before generating content, users can select a client, and the tool will adjust its writing approach based on predefined client-specific parameters stored in a database. In addition, the tool should be able to learn and adapt its writing style over time by analyzing submitted content, allowing it to better understand and mimic each client’s voice. Since this is my first time using AI technologies for content generation, I would appreciate guidance and suggestions from an experienced developer on how best to build this tool. Scope of Work: Client-Specific Model Customization: Develop a system where users can select a client (e.g., Client A, Client B, etc.), and the tool will adjust its writing style, tone, and vocabulary based on client-specific para...
I am looking for a skilled developer to create a dynamic reverse proxy solution using and http-proxy-middleware. The proxy must function similarly to , offering seamless web proxy functionality with integration of a Service Worker on the frontend for advanced request handling. Requirements: Backend (Proxy Server): Build a reverse proxy using and http-proxy-middleware. Support dynamic target selection, routing requests to different backends based on specific rules (e.g., request paths, query parameters, or custom headers). Forward headers, cookies, and other request/response metadata correctly to emulate CroxyProxy's behavior. Implement custom middleware to modify or log requests and responses as required. Frontend
...have to make your job easier. - (for easy fast data transfer already paid for) - (for photo editing already paid for) The ideal candidate must have: - Proven experience designing and customizing Shopify stores. The freelancer offered the job must be well experienced in Shopify site coding for advanced customization. - Experience installing and customizing Shopify apps, GUI template customization, etc. - Experienced in photo editing mandatory to ensure all imagery and content are unique to avoid copyright or trademark infringements. The work will involve manipulating an existing template and apps to align with our vision, and customizing the design and layout to showcase our unique collection of rings while maintaining a clean, modern, and professional look. Assistance
...created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Libre and similar platforms sometimes update their anti-scraping security measures. Therefore, I need a long-lasting, robust code that will remain functional over time. In case of failure, I require lifetime support as this functionality is the core of my operation. My website is: Please provide the implementation timeline and cost. I’ve already had a freelancer do it poorly, resulting in wasted time and a refund. I ...
I need an expert in Python and natural language processing (NLP) with NLTK to help me analyze text from company blogs for negative message framing. Key Focus Areas: - Language Sentiment: I'm interested in how the language used in these blogs frames positive and negative messages. - Persuasive Techniques: I want to understand the persuasive techniques employed in these positive and negative framings. Ideal Skills: - Proficiency in Python and NLTK - Strong background in NLP - Experience with sentiment analysis and understanding of persuasive techniques in language - Ability to interpret and present findings in an insightful manner. Please note, the analysis will focus specifically on detecting and interpreting negative framing.
Tafadhali Jisajili ama Ingia ili kuona maelezo.
Desarrollar un script de automatizacion con python que dada la ruta de una carpeta pueda cambiar la extesion de todos los archivos que estan dentro de la carpeta a una extensión dada.
I need a Windows-compatible tool that copies file names from JPEG to EPS files. The tool should be able to handle multiple files at once and should have a user-friendly Graphical User Interface (GUI). Key Requirements: - The tool should be able to handle multiple files at once, not just a single file. - It should be compatible with Windows OS. - A Graphical User Interface (GUI) is a must for this tool; I do not require a Command Line Interface (CLI). - The tool's primary function is to copy file names from JPEG files to their corresponding EPS files. Ideal Skills: - Experience in developing Windows applications. - Proficient in creating intuitive and user-friendly GUIs. - Strong understanding of file handling and manipulation in software development.