Python web scraping to database jobs
I'm looking for an expert to help me modify user activity history on a website's database. Ideal Candidate: - Proficient in database management and web technologies. - Previous experience with user data modification. - Knowledge of data privacy regulations and ethical standards. Task: - Edit existing user activity entries. Please note, the selected freelancer will have to work under strict confidentiality and adhere to data protection laws.
We are looking for an experienced developer or team to create a custom search engine from scratch. The goal is to build a fully functional search engine that operates independently, without relying on any third-party APIs (e.g., Google, DuckDuckGo, or Bing). In addition, the system will include a robust Web Crawler and Indexing System, along with an Admin Panel to manage the entire process. This project will involve developing a crawler, setting up an indexing system, and building an admin panel to control, monitor, and optimize the search engine. Key Requirements: 1. Web Crawler Development: • Purpose: Develop a custom crawler to scrape and collect data from websites. • Details: The crawler should follow rules and efficiently cra...
I'm in need of a Python script that can perform speaker diarization and transcription in real-time. The setup will involve one microphone capturing a conversation between two individuals. The script should be able to: - Store the audio from the mic into small arrays - Feed these arrays into a diarization system - Output speaker-labelled transcriptions as new arrays are created during the conversation. The audio input will be streaming audio, and the system is expected to handle two speakers. The transcription will only need to support English. Ideal skills and experience for the job include: - Proficiency in Python - Experience with audio processing and speaker diarization - Understanding of real-time data handling - Ability to create effi...
I am in need of a Microsoft Visual Studio expert with extensive experience in Visual Basic and database applications. I am currently developing a database application and require assistance with Microsoft Visual Studio. - **Skills Needed**: - Proficient in Visual Basic - Expertise in Microsoft Visual Studio - Experience with developing database applications - Excellent problem-solving and debugging skills - Familiarity with project setup and extension development in Visual Studio Your role will primarily focus on helping me set up the project correctly and ensuring that all components of the application interact seamlessly. If you are adept at troubleshooting and code debugging, it would be a huge plus. I am looking for someone who can help me make this p...
We are working on a computer vision project in the space domain. Our task is to find existing code for specific space-related applications, run the code on our computers, and understand how it works. (meaning we just have to run existing code from the internet e.g. GitHub... modifications on the source are allowed but no writing of code with no reference of an existing code) We have already identified the following applications and their corresponding GitHub repositories: 1. Crater detection on planetary surfaces Repository: [YOLOv5 Moon and Mars Crater Detection]((Krishna).ipynb) 2. Colorizing grayscale telescope images Repository: [Colorizing Space Images with GANs](https://www
I’m looking for an experienced Odoo developer to help automate the import of affiliate products from platforms like Ali Express, Amazon, eBay, Etsy and Temu into my Odoo e-commerce website. Scope of Work: Set up automated product imports using APIs, third-party tools, or custom scripts. Map product data (title, description, price, image, affiliate link) to Odoo’s product fields. Ensure seamless integration with Odoo’s e-commerce module. Set up periodic updates for product details (e.g., price, availability). Requirements: Proven experience with Odoo (e-commerce module, APIs, and customizations). Familiarity with Amazon PAAPI, eBay API, or AliExpress product data extraction. Knowledge of automation tools like Zapier or Make (Integromat). Strong understandin...
I'm looking for a Python developer to enhance the user interface of my .exe script. The project involves: - Improved layout: I want a cleaner arrangement of elements to facilitate a more intuitive user experience. - Better visual design: A refined color scheme is needed to create a more visually appealing interface. Ideal candidates should have significant experience in Python development and UI/UX design. A strong understanding of visual design principles and layout strategies will be crucial to the success of this project.
**Here is a simplified and clear version for the Beesocial web app, with a design inspired by Linktree. The goal is to create an intuitive interface that allows users to display their social networks with clickable redirect links.** **Functional Structure of the Beesocial Web App (Simplified Version)** 1. **Access to the Web App** - The user scans an NFC sticker or a QR code placed in the establishment. - They are automatically redirected to a personalized page associated with the establishment. 2. **Display of Social Networks** The page will display: 1. **User/Visitor Name:** - Displayed at the top of the page (e.g., “Marie D. | Follow Me!”). 2. **Profile Picture (Optional):** - Allows the user t...
...Description: We are looking for an experienced freelancer or team to develop a paddy testing equipment system for quality analysis. The system will include hardware (sensors and microcontroller) and software components to measure parameters such as moisture content, weight, and color quality of paddy grains. Additionally, we may require optional enhancements like a database and dashboard. Key Tasks and Requirements: 1. Hardware Setup: Components: Moisture sensor Load cell (with HX711) for weight measurement Color sensor or camera for visual quality analysis Microcontroller (Raspberry Pi or Arduino) Additional components: breadboard, jumper wires, power supply, etc. Responsibilities: Design and set up the hardware system. Connect sensors to the microcontroll...
Writing HTML and Python Sections for: Business Computer Applications **Description:** I am looking for a professional writer to help draft two specific sections for an academic project. The details are as follows: 1. *HTML and Website Design:* - Discuss the importance of an online presence for businesses and the impact of website design on customer engagement. - Analyze the role of user experience (UX) and accessibility in driving business success. - Provide real-world examples of companies that have leveraged website design to achieve growth. - Use reliable sources and support the content with references in APA format. 2. *Python for Business Analytics:* - Conduct independent research on how Python is applied in business analytics. - Discuss why...
I'm seeking assistance with modifying a flat file database. The task primarily involves updating existing records. This is a one-time project.
Looking for a Python programmer to do the following: User will press a button. program will activate an output that will turn off at a preset time by the system (Regardless if the user continues to press in the input) The system will then wait a preset time before it will allow the input to activate the out put. Example: Preset on time := 10 Sec. (This should be a retentative timer), so if the user only holds for 4 seconds and lets go. they still have 6 seconds remaining Preset wait time: = 40 min. When the user presses in the input the output will turn on (for as long as the user presses the input or 'on time' (10 seconds has been reached) The user can try and press the input in after this but the output will not turn on. until the wait time has r...
I'm looking for a data entry specialist to collect email addresses from a specific website. The site has 480 pages, and there are 10 companies per page. What You Need to Do: - Navigate through the 480 pages and 10 companies per page. - Collect email addresses and input them into an Excel file. - Format: One email per cell. Ideal Skills and Experience: - Proficient in Excel. - Good attention to detail. - Previous experience in data collection or web scraping is a bonus. Please note, I only require the email addresses, not any additional information.
We are seeking a skilled developer to create an AI form filler capable of navigating a list of URLs, identifying contact forms, and autonomously filling them out and submitting the data. The solution should be efficient, reliable, and easy to integrate with existing systems. Familiarity with web scraping and AI technologies is essential. If you have a proven track record in developing similar applications, we would love to hear from you.
...development of a fully functional website is required to allow online publication and product sales. The website must include advanced functionalities such as product catalogs, user registration options, online orders, and a customized interface that provides a unique user experience. --- #### 2. General Structure of the Website 1. **Homepage**: - Attractive visual presentation with featured products and promotions. - Quick access to product categories. 2. **Product Catalogs**: - Division of products into main categories and subcategories. - Filter system for users to search products by price, brand, features, etc. 3. **Product Details**: - Detailed description of each product (name, price, features, images, reviews). - "Add to car...
Job Title: Software Developer Intern (Automation & Web Scraping) Location: Remote About Us: We are a dynamic tech company dedicated to building innovative solutions for data processing and automation. We are looking for a motivated Software Developer Intern who is passionate about web automation and data scraping to join our team. This is an exciting opportunity to work on real-world projects and gain hands-on experience in the tech industry. Role Overview: As a Software Developer Intern, you will be responsible for developing automation tools that can scrape data from websites using available APIs. You will be working with modern technologies like Postman, Selenium, Python, and various automation techniques to build sol...
This project leverages NLP and transformers to build an intelligent Interview Reminder Scheduling System that streamlines communication between recruiters and candidates. By utilizing state-of-the-art transformer models, the system will automate the process of scheduling, sending reminders, and handling candidate responses effectively. NLLP Framework: Hugging Face Transformers (e.g., BERT, T5, or GPT models). Backend: Python (FastAPI/Flask/Django). Frontend: React.js or Angular for user-friendly interaction. Database: PostgreSQL, MongoDB, or DynamoDB for candidate data. APIs: Twilio (SMS/WhatsApp), SendGrid (Email), or Google Calendar for integration. Deliverables: A fully functional system capable of intelligent interview reminder management. NLP-powered automated wo...
...skilled developer to help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation. Current Situation: I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached). The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable. What I Need: A robust and reliable solution for faster and more efficient scraping without interruptions. The ability to download HTML files in the required str...
I'm a recent high school graduate seeking assistance with data entry into my SQL-based database. Ideal Skills: - Proficient in manual data entry - Experienced with SQL databases (e.g., MySQL, PostgreSQL) - Strong attention to detail and accuracy - Good communication skills - Problem-solving abilities
I'm seeking a professional to automate my day trading strategy using the Interactive Brokers (IB) Trader Workstation (TWS) API. Key Requirements: - Expertise in Python programming language - In-depth knowledge of day trading strategies - Experience with IB TWS API - Ability to develop an automated system that can: - Execute trades based on predefined signals - Monitor and manage open positions - Generate trade alerts and reports Please provide examples of similar projects you've completed in the past.
...model built in Python using machine learning model such as randonforestcalssifier adversarial variation , designed to analyze daily variances of a user activity metric score from a time series data set. The model should alert me whenever today's variance surpasses a specified threshold such as an AUC score.. This threshold will be determined during the model's training phase. The project also requires a forecasting component. Key Requirements: - Extensive experience in Python and AI model development. - Proficiency in time series analysis. - Ability to create a forecasting component within the model. - Experience working with user activity data is a plus. - Skills in setting up alert systems based on model outputs. Please, bid only if you are con...
...and Deepstream 7.1. The goal is to detect garbage in my garden using a USB camera. Your tasks will include: - Creating and configuring C++ and Python examples for the detection of garbage - Utilizing CUDA for optimized processing - Providing guidance on machine configuration for optimal performance Ideal skills for this project include: - Extensive experience with NVIDIA Jetson platforms - Proficiency in C++ and Python, particularly in the context of Deepstream and Jetson - Familiarity with garbage detection models - Experience in configuring and optimizing machine performance This project requires a keen understanding of AI and deep learning, specifically in object detection. The camera will primarily be used to monitor my garden, so the model will need...
...programmer to automate a BTC trading strategy on Delta Exchange using Tradetrone. Below are the specific requirements: Buy Entry Conditions: - A green candle is detected; execute Buy trade at market price after candle close. - Check difference: Close Price minus Low Price <= 3 points. - Stop Loss: Set at 3 points. - Trailing Stop Loss: Based on the lowest price of the previous candle. Sell Entry Conditions: - A red candle is detected; execute Sell trade at market price after candle close. - Check difference: Close Price minus High Price <= 3 points. - Stop Loss: Set at 3 points. - Trailing Stop Loss: Based on the highest price of the previous candle. Additional Conditions: - If a Buy position is active, do not execute Sell trades, and vice versa. Ideal Candidate: - Expe...
I'm looking for an expert with a strong background in algo trading to help me build a trend-following trading strategy for BTC in Delta exchenge. This strategy should be tailored for short-term trades. Key Tasks: - Develop a trend-following trading strategy using Tradetrone or paythan. - The strategy will be applied to BTC on delta exchange. - The focus will be on short-term trading. Ideal Skills: - Extensive experience in Python programming. - Proven track record in developing algo trading strategies. - Deep understanding of index options and trend-following strategies. - Ability to create strategies for short-term trading. Please only bid if you can demonstrate relevant experience and have a portfolio of similar projects.
Job Title: Develop a Workflow for Scraping Global Mosque & Muslim-Based NGO Data with Detailed Documentation ________________________________________ Job Description: I am looking for a skilled automation expert to build a workflow that scrapes Google for global contact details of mosques and Muslim-based NGOs. The workflow must allow for targeted searches by category (e.g., society, charity, non-profit) and be optimized for credit efficiency in Make.com. The final system should produce structured data outputs and include clear, beginner-friendly documentation. ________________________________________ Scope of Work: 1. Automation Workflow: 1) Build a workflow to scrape Google for the following details: a. Organization Information: i. Organization Name ii. Organi...
We are looking for an experienced developer or team to create a custom search engine from scratch. The goal is to build a fully functional search engine that operates independently, without relying on any third-party APIs (e.g., Google, DuckDuckGo, or Bing). In addition, the system will include a robust Web Crawler and Indexing System, along with an Admin Panel to manage the entire process. This project will involve developing a crawler, setting up an indexing system, and building an admin panel to control, monitor, and optimize the search engine. Key Requirements: 1. Web Crawler Development: • Purpose: Develop a custom crawler to scrape and collect data from websites. • Details: The crawler should follow rules and efficiently cra...
Hello, I have experience in Python, web scraping, and data extraction using tools like Scrapy, Pandas, and Selenium. I can quickly debug your script and ensure it meets all your requirements. Here’s how I plan to help you: 1. Fix bugs in your script within 2-3 hours. 2. Add functionality to match conditions and extract data as per your requirements. 3. Provide an easy-to-use script for future use. I will deliver the output in the required Excel format. Looking forward to your response so we can start immediately! Budget: $8 (as per your project description). Timeframe: First phase within 2-3 hours. Thank you,
I'm looking for a comprehensive database of 10,000 active job seekers with a focus on entry-level & mid-level Software Development skills. Requirements: - Job seekers should be looking for job in IT field. - Database should include first name, last name, email, and phone number. Please note, the job seekers must be currently seeking IT roles.
I'm looking for a Python script, or a similar tool, that can, FOR EXAMPLE, take a photo from a source like Airbnb and transform it into a unique piece of content. The goal is to ensure that the altered photo cannot be found using Google Image or any other image search engine. IMPORTANT: The photo must remain the same, visualy. Maybe with a few small changes Key Features: - The script should incorporate multiple methods of alteration, including changing pixels, adding noise, and modifying the canvas size. - The new canvas size should either be the same as the original or larger. - The tool should have the capability to perform a variety of pixel changes, such as color adjustments, blurring, and random pixel shifts. Ideal Skills: - Proficiency in Python o...
I'm looking for a skilled web scraper with API development experience. The task involves extracting product information from three specific websites. Key Requirements: - Extract product descriptions from specified websites - Develop an API to facilitate this - Present data in a user-friendly JSON format Ideal Skills: - Strong background in web scraping techniques - Proven experience with API development - Attention to detail - Ability to work independently If you've successfully completed similar projects in the past, I would love to hear from you!
I'm seeking a fresh Python backend developer with a focus on API development, specifically RESTful APIs. The primary task will be implementing user authentication within these APIs. Ideal Skills: - Proficiency in Python - Basic understanding of RESTful APIs - Experience with implementing user authentication This is a perfect opportunity for a recent graduate or someone looking to gain practical experience in the field. I am open to mentoring and guiding the right candidate.
I'm seeking a skilled developer to build a Removalist App to Minimum Viable Product (MVP) standards. The project entails creating an app with essential features for both customers and removalist staff. Key Features: - A comprehensive booking system that allows customers to schedule their removal services via a step-by-step form - Think Uber for Removalists - Real-time tracking functionality for monitoring removalists during the job. - A secure and efficient payment processing system. Ideal Skills & Experience: - Proven track record in mobile app development, preferably with experience in creating service-based applications. - Strong understanding of user interface design, ensuring the app is easy to navigate for both customers and staff. - Expertise ...
I'm seeking a talented eLearning trainer to help build high-quality tech-related courses for my YouTube channel. You will be provided with a company logo and instructions, and your task will be to create engaging videos for each topic in selected technologies. Technologies to cover: - React JS - Javascript Object Oriented - Data Science and Machine Learning - Next JS - Design - Photoshop - .Net Core - Python - DevOps Requirements: - Create high-quality videos with excellent sound - Use a clear, globally understandable accent - No face showing required Payment: Maximum of 1000 INR per video Ideal Skills and Experience: - Previous experience in eLearning course creation - Proficiency in the mentioned technologies - High-quality video production skills - C...
I'm seeking a freelancer who can provide me with a daily supply of up to 30K email addresses of individuals aged between 50 and 60 in the USA. The primary purpose of this email database will be for marketing campaigns, so the emails should be valid and ideally have a history of engagement with similar campaigns. Skills and Experience Required: - Data mining and web scraping - Experience with email list building - Understanding of demographic targeting - Knowledge of email marketing standards Please note, the lists need to be delivered daily, and must be of high quality to ensure maximum deliverability and engagement.
I'm seeking a backend engineer skilled in Python, and data preparation activity for ML. Key Responsibilities: - Collaborate in the design and development of a robust, efficient, and secure RESTful API. - Implement best practices in API development for scalability and maintainability. Ideal Skills: - Proficient in Pytho - Proven track record in RESTful API development. - Strong understanding of backend engineering principles. - Excellent problem-solving and communication skills.
...software engineer to develop a custom interactive software system for a haunted attraction. The system will use motion detection, face recognition, and AI-powered image manipulation to create a unique special effect. The goal is to capture a patron’s face, morph it into a ghostly or monstrous appearance, embed it into a pre-existing video, and play the video back on a hidden TV in real-time when triggered. This system must operate smoothly to ensure seamless operation without causing delays in crowd throughput. Project Scope: 1. Hardware Integration: • Raspberry Pi 5 as the primary controller. • Hailo AI HAT with 13 TOPS for image processing and AI tasks. • Night vision Raspberry Pi camera for face capture in low-light conditions. &b...
I'm in need of a Python developer to improve my Whisper script. The project involves: - Upgrading the current script to include better UI elements using PyQt - Implementing some new file processing functions The UI should be compatible with a desktop application. Ideal skills for this project include: - Proficiency in Python, with a focus on desktop application development - Extensive experience with PyQt - Strong skills in file processing programming - Previous experience enhancing scripts for improved functionality and user interface Please provide examples of similar projects you've completed in your bid.
I am seeking an experienced DevOps and QA professional who can implement a robust CI/CD pipeline and comprehensive QA testing for my GitHub repository. This repository contains code written in JavaScript, Python, and Java. Key Responsibilities: - Set up a seamless CI/CD pipeline utilizing GitHub Actions or similar tools. - Develop and implement unit tests, integration tests, and end-to-end tests. - Ensure the code is thoroughly tested and ready for deployment. Ideal Skills: - Proficient in JavaScript, Python, and Java. - Extensive experience with GitHub and CI/CD tools. - Strong understanding of different testing methodologies. - Previous experience with setting up CI/CD and QA for multi-language repositories will be highly regarded.
I need a comprehensive database to streamline my housing assistance work. The system should identify potential housing matches based on both member budgets and location requirements. Key Requirements: - The database should track various rental properties, including their address, type, cost, and availability, as well as landlord contact information. - On the member side, it should store budget limits, preferred locations, and contact details. Ideal Skills: - Database development - Data management - Software development - Ideally, some understanding of housing assistance systems, though not strictly necessary. This database will greatly enhance my efficiency in helping people find homes. Please provide examples of similar projects you have completed.
Host My already API based Python website you have to rehost on vps server like hostinger
I'm looking for a skilled Python developer to create a simple web automation script for me.
...in need of a Python backend developer, preferably a fresher, with a focus on API development and database management. The project will primarily involve working with SQL databases and leveraging the Django framework. Key Responsibilities: - API Development: Building, testing, and maintaining APIs to support various applications and services. - Database Management: Overseeing the interaction with our SQL databases, ensuring data integrity and optimizing performance. Ideal Skills: - Proficiency in Python, particularly in a backend context. - Familiarity with SQL databases, including basic query writing and database design. - Prior experience or knowledge of the Django framework. - Understanding of API structures and principles. This is a great ...
I need an expert in Python and server management to rehost my existing API-based Python website on a VPS server. Key Responsibilities: - Rehost the website on a Linux-based VPS server - Ensure all APIs are functioning correctly post-migration - Optimize server settings for best performance Ideal Skills: - Strong Python programming skills - Extensive experience with VPS server management - Familiarity with API-based applications - Problem-solving skills to troubleshoot any issues that arise during rehosting Please note, the details about the VPS server and the code repository have not been finalized yet. Flexibility and readiness to assist with these aspects would be advantageous.
I'm seeking a freelancer to create an animal database for free use by K-12 students aimed at enhancing environmental education. The comprehensive specifications are attached. Please read the attached project details. Only apply if you're confident in meeting all project objectives and constraints. Key Project Requirements: - Development of an animal database encompassing various information categories as detailed in the attached instructions. - The database must be accessible via a link from an existing environmental education website. Ideal Skills and Experience: - Proficiency in database creation and web development. - Prior experience in educational software development is a plus. - Strong understanding of environmental education con...
I'm trying to learn things online by gathering the CC of Videos into TXT files and read it instead. I need a way to automate the gathering of the text files with the close captioning. Here is a video explaining: Job Posting: YouTube Caption Extraction Bot Developer Position Overview: Looking for a Python developer to create a YouTube channel caption extraction bot with specific requirements for handling large-scale video processing. Project Requirements: Create a bot that processes YouTube channel video pages (e.g., @TheCookingFoodie/videos) Core Functionalities: Process all videos from a channel's video page Extract and save: Video titles Video URLs Closed captions (CC) Save data in text
I need a skilled Python developer to create a web scraper for me. The scraper should be able to extract structured data, like tables, from various e-commerce websites. The project requires a deep understanding of web scraping techniques and best practices in Python.
I'm looking for a Python-based email validation checker that can efficiently check millions of email addresses against the Kucoin sign-up page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the load of millions of checks with a budget of $200 worth of proxies. - Store results: The checker should store the results of the email validation in a file. The output format for the results file should be TXT. Ideal candidates for this project would be those with extensive experience in Python, web scraping, and proxy handling. A deep understanding of email validation and experience working with cryptocurrency exchange websites would be a significant plus.
Please Sign Up or Login to see details.
...seeking an experienced developer with a strong background in Solana and Raydium development to assist with a specific project. I have Python code that interacts with Uniswap (Ethereum) for minting and managing LP positions, swaps, and more. I’m looking to replicate this functionality for Raydium on Solana. Key Requirements: - Proven experience integrating systems with Solana using Python. - In-depth knowledge of Raydium, including crypto token minting and liquidity provision processes. - Strong understanding of transaction speed optimization and security best practices within the Solana ecosystem. Project Scope: - Develop a Python function to mint an LP position on Raydium. I will provide existing Python code for Uniswap as a refe...
