Web scraping using python code github jobs
I'm looking for a skilled web scraper to help me extract data from HTML tables on a website and input it into a Google Sheet. Key details: - The data is updated every 30 minutes, so I need someone who can set up a server that handles this automated process - The tables contain mixed text and numbers. Attention to detail is crucial as the data will need to be accurately transcribed. Ideal skills for the job include: - Proficiency in web scraping tools and techniques preferably selenium - Experience with Google Sheets API. - Strong attention to detail and ability to handle mixed data types. I look forward to your bids.
I'm in need of a Python Selenium expert for a project. While the specific details are still being finalized, the ideal candidate would be someone with: - Proficiency in Python and Selenium - Experience in web scraping, automated testing, and browser automation - Flexibility to adapt to different types of web applications - Capability to support automation across multiple browsers Please reach out if you have the necessary skills and experience.
I am in need of a Python developer with substantial experience in Django for web development. The primary focus of this project is to develop a web application with a robust REST API. Key Requirements: - Extensive experience with Python and Django - Strong understanding of web development principles - Proven track record of developing REST APIs Ideal Skills: - Python - Django - Web Development - REST API Development
...'Subscription', 'Rating'. - Identify and clean duplicate and dead records, i.e. blocked email addresses. 2. Database Synchronization: - Develop a Python script for fetching data from our database and updating or adding records in Zoho CRM. - Ensure the script is capable of handling incremental updates and can operate on a set schedule. 3. Documentation & Automation: - Create clear and concise documentation detailing the cleanup and synchronization processes. - Automate the sync script for regular execution (e.g., hourly via crontab). Ideal Skills: - Extensive experience with Zoho CRM and its API. - High proficiency in SQL and Python. - Strong familiarity with data cleaning and automation tools. Please reach out if you're int...
...educational materials, such as full-length lectures and PDFs, into concise and easily digestible formats like video snippets, infographics, and text summaries. The goal is to enhance learning efficiency by transforming complex information into byte-sized content. Key requirements: - The system should be able to process a variety of sources for content generation, including full-length lectures, PDFs, and web articles. - It should also be capable of incorporating interactive elements into the summarized content, such as quizzes, clickable links, and interactive diagrams. Ideal skills and experience for the job: - Proficiency in developing systems powered by Large Language Models. - Experience with content summarization and transformation. - Ability to create interactive elements...
I have an existing working TensorFlow code that requires modifications to enhance training performance and improve model test metric. I do not need a new code from scratch, but rather an expert who can make targeted changes to my existing code and run it on a gpu. I need a fully trained model within 2-3 days. My model has about half a million parameters and any changes to Network architecture must ensure the parameter count stays within one million. My test metric is miou and I want to achieve 80% while my current model gives me roughly 40%. Besides that, the final model should run on a CPU. Gpu is only required to make training faster. Key Requirements: - Access to a GPU and expertise in utilizing it for deep learning tasks - Proven experience with training deep lear...
...training and evaluation. • Provide recommendations on the data split for training, validation, and testing. 6. Documentation: • Provide detailed documentation of the pipeline, processes, and integration for future reference and scalability. Requirements: • Expertise in NLP, fine-tuning open-source models, and data extraction. • Proficiency in LangChain TS and ZOD validation. • Strong skills in Python and/or TypeScript. • Ability to deliver both technical solutions and comprehensive documentation. Deliverables: 1. Fully functional pipeline for fine-tuning and data extraction. 2. Integration of LangChain and feedback loops for validation. 3. Finalized and validated JSON outputs adhering to the provided schema. 4. Comprehensive documentatio...
...featuring fast loading pages, easy navigation, and responsive design. Responsive Design: Ensure the site works smoothly on mobile, tablet, and desktop. Back-end: Framework: Django (Python), Express (Node.js), Ruby on Rails, or similar. Database: PostgreSQL, MySQL, or MongoDB. Microservices vs Monolithic: Start monolithic for simplicity and refactor into microservices as you scale. APIs: RESTful or GraphQL to facilitate communication between front-end and back-end. Hosting & Deployment: Cloud Providers: AWS, Azure, or Google Cloud Platform. CI/CD: Implement continuous integration and deployment pipeline (Jenkins, GitHub Actions, GitLab CI). Scalability: Use load balancers and auto-scaling groups. Timeline: We are looking to complete this project within 4-6 weeks. Budg...
I am looking for a skilled software developer with expertise in Python to create a fully functional Windows application. This application should support the RTSP media streaming protocol and utilize the FFmpeg media processing library. Key Skills Required: - Proficiency in Python - Experience with RTSP media streaming protocol - Extensive knowledge of FFmpeg - Familiarity with Windows application development frameworks (like WinForms or WPF) - Competence in network programming and socket development Deliverables: 1. A fully functional Windows application that meets the outlined requirements. 2. Well-documented source code with proper comments. 3. An installation package for easy deployment. 4. A user manual tailored for non-technical users. The ideal candidate for t...
The seismic reports and project of a steel-structured house . The analysis of this house needs to be performed in the SAP2000 program in accordance with TBDY 2018 and Turkish geotechnical survey report is provided in house project and geotechnical report will be provided to you.
I'm looking for a Python expert who can help analyze our customer data. - The primary goal of this project is to derive insights from our customer data to drive business decisions. - The data is stored in databases, so experience with SQL and database management is a plus. - A strong background in data analysis and Python is essential for this project. Please include your relevant experience and examples of similar projects you've completed in your proposal.
Backend API Development Using TypeScript & Node.js - Sign-in, Signup, Reset Password, Forgot Password & Verify OTP - Dashboard Stats - Workspace and Project APIs - Packages and Payment APIs - Profile Update and Change Password - Contact Us - Admin APIs
Requirements: 1. Select Traffic Module: Youtube/Website No of threads Insert human behaviours like mouse movent, scroll etc. Website: 1. Website URL 2. traffic source: Google search, Bing search,Facebook,Quora,Direct, custom url (EX:if google is selected then need option to enter keyword) 3. Webpage top to bottom scroll speed: 4. Visit duration Min Sec/Max sec 5. Visit random URLs: Yes/No ( file path option) 6. random URLs visit duration: random urls top to bottom scroll speed (file path option and website API option) (file path option and website API option) option Select click based on "selector/xpath" (Example if click option is selected then it should click on selected banner/ads and do activity like slow scroll, wait time and visit internal link. ) 10. Click ctr...
I'm looking for a skilled graphic designer to help me create some designs using Illustrator, which I can install on my computer. If you have experience with Illustrator and can work with a variety of design needs, please reach out.
I’m looking for an experienced web developer to create a Minimum Viable Product (MVP) version of a basketball stats website. The website will feature sortable and filterable dashboards for players and teams in the 2025 NBA season. This is a small-scale project aimed at validating the concept before expanding to additional features. Project Scope: Player Dashboard: Display data for 400 players with ~50 data points each (e.g., points, assists, advanced stats). Include filtering, sorting, and color-coded rows (green-to-red scales based on performance metrics). Team Dashboard: Display data for 30 teams with ~50 data points each. Include filtering, sorting, and comparison functionality for multiple teams. User Interface: A clean, responsive design for both desktop and mobile users...
...relevant code snippets. This project is focused on: - Programming languages - Development tools - Javascript Your answers should not only provide assistance to the original poster, but also drive traffic to the Scribbler notebook, which is intended to showcase example usages of different code snippets. Ideal candidates for this project should have: - Strong understanding of programming languages and development tools, particularly Javascript. - Experience with Stack Overflow and understanding of its community norms. - Ability to write clear, helpful, and engaging responses. - Familiarity with Scribbler and ability to effectively link resources. - You can use one of the existing notebooks from or else create your own notebook and push it to github Please ensure
I'm seeking a skilled Python developer to create a program for analyzing text data from databases. Key Responsibilities: - Develop a Python program primarily for data analysis. - Extract and analyze text data from various databases. Ideal Skills and Experience: - Proficient in Python with a strong focus on data analysis. - Extensive experience with text data processing. - Familiarity with database handling and extraction. - Ability to create efficient and effective data analysis tools.
I need a freelancer to make minor adjustments to my current name card design. Specific Tasks: - Text: Update with new contact information - Logo: Modify the existing logo on the card - QR Code: Incorporate a QR code that links to my contact details - Additional: Small adjustments to the current design elements Ideal candidate should have a background in graphic design, and experience with creating and integrating QR codes into print materials.
...Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The tool must be capable of accurately identifying and extracting the names of companies and their decision-makers. Ideal Skills: - Proficiency in AI and machine learning. - Experience in web scraping and data extraction....
I'm in need of a Tally Prime code specifically designed to assist with managing product descriptions. Key features: - The code should facilitate the handling of product descriptions efficiently, allowing for easy navigation and updates as needed. Ideally, the freelancer should: - Have extensive experience with Tally Prime and coding for it. - Understand inventory management and product description systems. - Be able to provide a trial TCP for testing the code before final delivery. Please note that I will need to be able to check the functionality of the code using a trial TCP before final acceptance.
I need a desktop-based software for an ESP32 development module educational kit. This software should allow users to write code, compile and upload it to the module. It should support different sensors and provide a user-friendly Graphical User Interface (GUI). Key Requirements: - Code writing in Scratch, C and Python - Compilation and uploading to the ESP32 module - Interaction with various sensors - Intuitive GUI - Compatibility with Windows and MacOS Ideal Skills: - Proficient in software development for educational purposes - Experience with ESP32 and various sensors - Skilled in creating GUI software - Knowledgeable in Scratch, C and Python - Able to ensure cross-platform compatibility (Windows and MacOS)
Instructions for Data Scraping Task Your task is to extract specific information from job posting links. Below are the detailed requirements: Data Points to Scrape: 1. Company Information: - Company Name - Company Details: Brief about the industry or type of work they do. - Company Website - LinkedIn Page: URL to the company’s official LinkedIn page. 2. Email IDs (3 Required): - Find 3 individuals' email IDs from the following departments: - Admin - Human Resources - Head of Sales/Top Leadership (CXO level in Sales) - Marketing Head/Top Leadership (CXO level in Marketing) - Founders/CEOs/Co-founders/Owners 3. Email Requirement: - The email IDs must be professional (e.g., `name at `). - Avoid generic emails like `info@`,...
...solutions for automating form completion using structured data. Develop Chrome extensions or similar tools for efficient autofill functionality. Ensure compatibility with various platforms and workflows. System Integration: Work with APIs and databases to retrieve user data for dynamic input into forms. Ensure seamless integration of automation tools with our platform. Optimization and Testing: Optimize solutions for speed, accuracy, and adaptability. Test systems in multiple environments to ensure consistent performance. Reliability and Reporting: Implement error-handling mechanisms and maintain detailed logs for troubleshooting. Create systems that notify or retry when submissions fail. Requirements Technical Skills: Strong proficiency in Python. Expertise in Seleniu...
...Platform Location Preference: Jaipur (Remote candidates with strong portfolios will also be considered). About the Project: We are building an MVP for a marketplace platform designed to connect service providers and users. The platform will feature user-friendly booking functionality, provider management tools, and integrated payment systems. The goal is to create a seamless and scalable web application with a clean interface and efficient backend. We are looking for a skilled freelance developer to develop this MVP from the ground up. You will be collaborating with our team to create a polished, functional product within a specified timeframe. Scope of Work Core Features: 1. User Platform: - Search and filter options based on location, category, and avail...
I'm seeking an expert in Python and Machine Learning to develop a clustering model using my provided CSV/Excel files and complete a python scripts and create power point presentation from the template. Key Tasks: - Develop a clustering model using Python - Analyze the data and implement the model - Present the findings in a PowerPoint presentation geared towards business solutions Ideal Skills: - Proficiency in Python and machine learning - Experience with clustering algorithms - Strong data analysis skills - Excellent PowerPoint presentation skills Please note, the primary goal of this project is the development of a machine learning model, specifically a clustering model. All data will be sourced from CSV/Excel files.
I'm seeking an expert to create technical drawings for social media (instagram, facebook) as well as a comprehensive product roadmap that incorporates machine learning and AI elements. Key Requirements: - Creation of detailed technical drawings. - Development of a product roadmap leveraging machine learning, AI, and python. - Producing quality output is must Your bid should demonstrate your skills and experience in these areas.
...will not develop any backend logic. Frontend Technologies: React: JavaScript library for building the user interface. : React framework for server-side rendering, routing, and performance optimization. GitHub: For version control, collaboration, and deployment. CSS Framework/Library: (Suggest: Tailwind CSS or Material UI) - To be discussed with the freelancer for consistency and speed. API Interaction: The freelancer will be responsible for integrating with the provided API to fetch and display data. Testing: The freelancer will implement unit and integration tests to ensure code quality and functionality. Pages and Components (Detailed) Here's a breakdown of the pages and the functionality/components they will need, you can use this list when talking with the freel...
We are looking for a skilled developer to build a solution that identifies arbitrage opportunities using the sqrtPriceX96 value of token pairs across multiple decentralized exchanges (DEXs). The goal is to automate the process of finding and executing arbitrage opportunities by monitoring token pair prices on DEXs like Uniswap v3, Sushiswap, and others. The solution should follow a step-by-step process: 1. Query the liquidity pools of various DEXs for the sqrtPriceX96 values of token pairs. 2. Convert the sqrtPriceX96 values to actual token prices. 3. Identify price differences between DEXs to spot potential arbitrage opportunities. 4. Account for transaction fees (gas and conversion) when calculating potential profits. 5. Continuously monitor and automatically execute arbitra...
Hi leotung1104, I noticed your profile and would like to know if you know how to web scrape with python
I'm looking for a skilled content creator with a strong background in Python programming and social media marketing to generate intermediate-level Python programming tutorials for Instagram. Key Requirements: - Create engaging, easy-to-follow, and educational Instagram posts covering Python programming tutorials aimed at an intermediate audience. - Understand and implement Instagram's best practices for post creation to maximize viewer engagement and information retention. - Expertise in Python programming, with the ability to break down complex concepts into digestible content. - Previous experience with creating technical content for social media platforms is a plus. This project will require a combination of technical programming knowledge, cont...
We are seeking a skilled Software Developer with expertise in Python and Node.js to join our team on a project basis. The ideal candidate will be responsible for troubleshooting and resolving issues in our existing applications hosted on a Digital Ocean server. **Responsibilities:** - Analyze and troubleshoot existing Python code and Node.js applications to identify issues and improve performance. - Implement fixes and enhancements to ensure optimal operation and security of applications. - Collaborate with the development team to discuss issues, propose solutions, and deploy fixes. - Manage deployments and updates on a Digital Ocean server environment. - Document all work performed, including code changes and troubleshooting steps. - Provide regular updates on...
I need a freelancer who can help me change the public SSH key for my OVH instance. The new SSH key is already available in the OVH dashboard. Your task is to change the SSH key via the OVH website, using Anydesk for remote access. Requirements: • You will not be provided with the private SSH key for the new SSH key. • You must change the SSH key through the OVH website interface only. • Anydesk will be used for secure remote access to the system. • Ensure no interruptions or issues with the instance’s access after making the change. Skills Required: • Experience with OVH cloud platform and managing instances. • Proficiency in working with SSH keys. • Anydesk usage for remote troubleshooting or configuration. Please apply only if yo...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software s...can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I expect this to be completed within t...
I'm looking for a skilled data analyst and Python programmer to create a code in Jupyter Notebook for analyzing data from Excel files. The project involves: - Primarily focusing on data analysis - Utilizing Pandas and NumPy libraries Ideal candidates should have: - Extensive experience with data analysis and Python programming - Proficiency in using Pandas and NumPy - Ability to work with Excel files - Familiarity with Jupyter Notebook Please include in your bid examples of similar projects you've completed. You are required to write the necessary program and create an effective presentation describing: The military spending of at least the top 10 nations (in military spending) Compare the data to that country’s GDP, Compare the data to th...
I'm in need of an experienced embedded systems developer to help troubleshoot and debug some code running on a TI CC1352P micro-controller. The debugger will need to have a strong background in C/C++ and familiarity with TI Code Composer Studio. Given the complexity of the project, I'm looking for someone based in Ontario, Canada, who can potentially offer in-person assistance if necessary. Ideal Skills and Experience: - Proficient in C/C++ - Extensive experience with TI Code Composer Studio - Familiarity with TI CC1352P microcontroller - Embedded systems development background - knowledge of OpenThread Protocol - wireless thermostats (based on TI CC1352P micro-controller) creating Mesh Network (OpenThread Protocol) - Based in Ontario, Canada
...existing systems to adapt them to new requirements. Developing complete applications for web and mobile platforms. Deploying systems automatically to platforms like Heroku, Vercel, or custom servers. The AI assistant must function like a professional employee, capable of handling coding tasks autonomously. The user should only provide high-level instructions, and the assistant should deliver complete, functional systems. Key Requirements: AI Features: Use of OpenAI models (e.g., Codex, GPT) for code generation. Ability to understand user inputs in natural language. Continuous learning to improve over time based on user preferences. Development Scope: Backend: Frameworks like Node.js, PHP (Laravel), or Python. Frontend: Modern technologies like React.js, Vue.js, o...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I'm in need of a skilled VB.NET developer to help me create a program that can read and extract both personal details and biometric data from a Malaysia identity card using Dermalog. The program will also need to verify a thumbprint in real-time. Key Requirements: - VB.NET programming skills - Experience with reading data from identity cards - Familiarity with Dermalog tools - Ability to implement real-time thumbprint verification Please note that I do not have the necessary Dermalog SDK or tools, so the freelancer will need to provide these. If you have previously worked on a similar project, please include a link to a sample of your work.
I'm looking for a skilled Python developer with experience in building web-based content management systems (CMS). This project involves creating a CMS with specific features and functionalities tailored to our needs. Key Project Requirements: - Develop a robust, user-friendly web application with Python. - Implement a comprehensive content management system. - Incorporate essential features such as user roles and permissions to manage access and control content. Ideal Skills and Experience: - Proficient in Python with a strong portfolio of web applications. - Prior experience in developing content management systems is a plus. - Understanding and expertise in implementing user roles and permissions.
I'm seeking a Python expert to develop a script that automates sending documents from Google Docs to an email. The script should utilize the 'requests' library and employ 'OAuth2' for secure access. The ideal candidate should have experience with: - Python scripting - Google Docs API - Requests library - OAuth2 implementation The project will involve: - Automating the process of sending documents from Google Docs to an email - Ensuring the use of secure OAuth2 consent screen for authentication Please note, the specifics regarding the email service have not yet been determined. Your flexibility and expertise in navigating this will be crucial.
...create a system where, before generating content, users can select a client, and the tool will adjust its writing approach based on predefined client-specific parameters stored in a database. In addition, the tool should be able to learn and adapt its writing style over time by analyzing submitted content, allowing it to better understand and mimic each client’s voice. Since this is my first time using AI technologies for content generation, I would appreciate guidance and suggestions from an experienced developer on how best to build this tool. Scope of Work: Client-Specific Model Customization: Develop a system where users can select a client (e.g., Client A, Client B, etc.), and the tool will adjust its writing style, tone, and vocabulary based on client-specific para...
I am looking for a skilled developer to create a dynamic reverse proxy solution using and http-proxy-middleware. The proxy must function similarly to , offering seamless web proxy functionality with integration of a Service Worker on the frontend for advanced request handling. Requirements: Backend (Proxy Server): Build a reverse proxy using and http-proxy-middleware. Support dynamic target selection, routing requests to different backends based on specific rules (e.g., request paths, query parameters, or custom headers). Forward headers, cookies, and other request/response metadata correctly to emulate CroxyProxy's behavior. Implement custom middleware to modify or log requests and responses as required. Frontend
...information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Libre and similar platforms sometimes update their anti-scraping security measures. Therefore, I need a long-lasting, robust code that will remain functional over time. In case of failure, I require lifetime support as this functionality is the core of my operation. My website is: Please provide the implementation timeline and cost. I’ve already had a freelancer do it poorly, resulting in wasted time and a refund. I request honesty&mdas...
I need an expert in Python and natural language processing (NLP) with NLTK to help me analyze text from company blogs for negative message framing. Key Focus Areas: - Language Sentiment: I'm interested in how the language used in these blogs frames positive and negative messages. - Persuasive Techniques: I want to understand the persuasive techniques employed in these positive and negative framings. Ideal Skills: - Proficiency in Python and NLTK - Strong background in NLP - Experience with sentiment analysis and understanding of persuasive techniques in language - Ability to interpret and present findings in an insightful manner. Please note, the analysis will focus specifically on detecting and interpreting negative framing.
I'm facing compilation errors while using the pybind11 library. The issues arise specifically during the binding code compilation and stem from type mismatches. I am looking for an experienced C++ programmer who is proficient in working with templates to help me resolve these issues. Ultimately, your role will be to help me successfully compile the pybind11 binding code. If you want to have a look at my immediate problem, it's #5492 on the pybind11 github. It's somewhat likely that I'll find more problems, so this is (probably) more than a one-shot job. Specific replies only please. Messages from bots will be blocked.
I have to do the coding for attiny 85 to control the led and buzzer based on the buzz wire.
I'm experiencing a critical issue with my website's payment gateway - the OTP (One Time Password) required for transactions is not getting sent out. This is a custom solution integrated into the site...experiencing a critical issue with my website's payment gateway - the OTP (One Time Password) required for transactions is not getting sent out. This is a custom solution integrated into the site. Key Details: - Issue: OTP not sending because we are using custom css in iframe of the gateway code - Platform: Integrated into a website's payment gateway - OTP Service Provider: Custom solution Skills and Experience Required: - Proficiency in debugging and resolving issues within a payment gateway - Understanding of network payment gateway code - Abili...
