Web scraping python mysql jobs
Requirements: 1. Select Traffic Module: Youtube/Website No of threads Insert human behaviours like mouse movent, scroll etc. Website: 1. Website URL 2. traffic source: Google search, Bing search,Facebook,Quora,Direct, custom url (EX:if google is selected then need option to enter keyword) 3. Webpage top to bottom scroll speed: 4. Visit duration Min Sec/Max sec 5. Visit random URLs: Yes/No ( file path option) 6. random URLs visit duration: random urls top to bottom scroll speed (file path option and website API option) (file path option and website API option) option Select click based on "selector/xpath" (Example if click option is selected then it should click on selected banner/ads and do activity like slow scroll, wait time and visit internal link. ) 10. Click ctr...
I’m looking for an experienced web developer to create a Minimum Viable Product (MVP) version of a basketball stats website. The website will feature sortable and filterable dashboards for players and teams in the 2025 NBA season. This is a small-scale project aimed at validating the concept before expanding to additional features. Project Scope: Player Dashboard: Display data for 400 players with ~50 data points each (e.g., points, assists, advanced stats). Include filtering, sorting, and color-coded rows (green-to-red scales based on performance metrics). Team Dashboard: Display data for 30 teams with ~50 data points each. Include filtering, sorting, and comparison functionality for multiple teams. User Interface: A clean, responsive design for both desktop and mobile users...
I'm seeking a skilled Python developer to create a program for analyzing text data from databases. Key Responsibilities: - Develop a Python program primarily for data analysis. - Extract and analyze text data from various databases. Ideal Skills and Experience: - Proficient in Python with a strong focus on data analysis. - Extensive experience with text data processing. - Familiarity with database handling and extraction. - Ability to create efficient and effective data analysis tools.
...Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The tool must be capable of accurately identifying and extracting the names of companies and their decision-makers. Ideal Skills: - Proficiency in AI and machine learning. - Experience in web scraping and data extraction....
I need a desktop-based software for an ESP32 development module educational kit. This software should allow users to write code, compile and upload it to the module...software should allow users to write code, compile and upload it to the module. It should support different sensors and provide a user-friendly Graphical User Interface (GUI). Key Requirements: - Code writing in Scratch, C and Python - Compilation and uploading to the ESP32 module - Interaction with various sensors - Intuitive GUI - Compatibility with Windows and MacOS Ideal Skills: - Proficient in software development for educational purposes - Experience with ESP32 and various sensors - Skilled in creating GUI software - Knowledgeable in Scratch, C and Python - Able to ensure cross-platform compatibility (W...
Instructions for Data Scraping Task Your task is to extract specific information from job posting links. Below are the detailed requirements: Data Points to Scrape: 1. Company Information: - Company Name - Company Details: Brief about the industry or type of work they do. - Company Website - LinkedIn Page: URL to the company’s official LinkedIn page. 2. Email IDs (3 Required): - Find 3 individuals' email IDs from the following departments: - Admin - Human Resources - Head of Sales/Top Leadership (CXO level in Sales) - Marketing Head/Top Leadership (CXO level in Marketing) - Founders/CEOs/Co-founders/Owners 3. Email Requirement: - The email IDs must be professional (e.g., `name at `). - Avoid generic emails like `info@`,...
...Optimize solutions for speed, accuracy, and adaptability. Test systems in multiple environments to ensure consistent performance. Reliability and Reporting: Implement error-handling mechanisms and maintain detailed logs for troubleshooting. Create systems that notify or retry when submissions fail. Requirements Technical Skills: Strong proficiency in Python. Expertise in Selenium or similar frameworks. Experience in developing Chrome extensions or web automation tools. Experience: Proven ability to build reliable, scalable automation solutions for data input or form workflows. Familiarity with APIs, databases, and handling dynamic or multi-step forms. Problem-Solving: Ability to troubleshoot and resolve issues related to form structures or data integration. Adaptabilit...
...Platform Location Preference: Jaipur (Remote candidates with strong portfolios will also be considered). About the Project: We are building an MVP for a marketplace platform designed to connect service providers and users. The platform will feature user-friendly booking functionality, provider management tools, and integrated payment systems. The goal is to create a seamless and scalable web application with a clean interface and efficient backend. We are looking for a skilled freelance developer to develop this MVP from the ground up. You will be collaborating with our team to create a polished, functional product within a specified timeframe. Scope of Work Core Features: 1. User Platform: - Search and filter options based on location, category, and avail...
I'm seeking an expert in Python and Machine Learning to develop a clustering model using my provided CSV/Excel files and complete a python scripts and create power point presentation from the template. Key Tasks: - Develop a clustering model using Python - Analyze the data and implement the model - Present the findings in a PowerPoint presentation geared towards business solutions Ideal Skills: - Proficiency in Python and machine learning - Experience with clustering algorithms - Strong data analysis skills - Excellent PowerPoint presentation skills Please note, the primary goal of this project is the development of a machine learning model, specifically a clustering model. All data will be sourced from CSV/Excel files.
I'm seeking an expert to create technical drawings for social media (instagram, facebook) as well as a comprehensive product roadmap that incorporates machine learning and AI elements. Key Requirements: - Creation of detailed technical drawings. - Development of a product roadmap leveraging machine learning, AI, and python. - Producing quality output is must Your bid should demonstrate your skills and experience in these areas.
Hi leotung1104, I noticed your profile and would like to know if you know how to web scrape with python
I'm looking for a skilled content creator with a strong background in Python programming and social media marketing to generate intermediate-level Python programming tutorials for Instagram. Key Requirements: - Create engaging, easy-to-follow, and educational Instagram posts covering Python programming tutorials aimed at an intermediate audience. - Understand and implement Instagram's best practices for post creation to maximize viewer engagement and information retention. - Expertise in Python programming, with the ability to break down complex concepts into digestible content. - Previous experience with creating technical content for social media platforms is a plus. This project will require a combination of technical programming knowledge, cont...
We are seeking a skilled Software Developer with expertise in Python and Node.js to join our team on a project basis. The ideal candidate will be responsible for troubleshooting and resolving issues in our existing applications hosted on a Digital Ocean server. **Responsibilities:** - Analyze and troubleshoot existing Python code and Node.js applications to identify issues and improve performance. - Implement fixes and enhancements to ensure optimal operation and security of applications. - Collaborate with the development team to discuss issues, propose solutions, and deploy fixes. - Manage deployments and updates on a Digital Ocean server environment. - Document all work performed, including code changes and troubleshooting steps. - Provide regular updates on progress and ...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software s...can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I expect this to be completed within t...
I'm looking for a skilled data analyst and Python programmer to create a code in Jupyter Notebook for analyzing data from Excel files. The project involves: - Primarily focusing on data analysis - Utilizing Pandas and NumPy libraries Ideal candidates should have: - Extensive experience with data analysis and Python programming - Proficiency in using Pandas and NumPy - Ability to work with Excel files - Familiarity with Jupyter Notebook Please include in your bid examples of similar projects you've completed. You are required to write the necessary program and create an effective presentation describing: The military spending of at least the top 10 nations (in military spending) Compare the data to that country’s GDP, Compare the data to the overall mili...
... Developing complete applications for web and mobile platforms. Deploying systems automatically to platforms like Heroku, Vercel, or custom servers. The AI assistant must function like a professional employee, capable of handling coding tasks autonomously. The user should only provide high-level instructions, and the assistant should deliver complete, functional systems. Key Requirements: AI Features: Use of OpenAI models (e.g., Codex, GPT) for code generation. Ability to understand user inputs in natural language. Continuous learning to improve over time based on user preferences. Development Scope: Backend: Frameworks like Node.js, PHP (Laravel), or Python. Frontend: Modern technologies like React.js, Vue.js, or others. Database management: MySQL, MongoDB, or e...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I'm looking for a skilled Python developer with experience in building web-based content management systems (CMS). This project involves creating a CMS with specific features and functionalities tailored to our needs. Key Project Requirements: - Develop a robust, user-friendly web application with Python. - Implement a comprehensive content management system. - Incorporate essential features such as user roles and permissions to manage access and control content. Ideal Skills and Experience: - Proficient in Python with a strong portfolio of web applications. - Prior experience in developing content management systems is a plus. - Understanding and expertise in implementing user roles and permissions.
...can help me connect my Node.js server to a MySQL database in a Kubernetes environment. The connection should utilize a connection pool. - Connection Type: The connection between the Node.js server and MySQL should be established using a connection pool. This means that multiple connections can be reused, improving the efficiency of data handling. - MySQL Operations: The majority of operations will be writing data to the database. Therefore, experience in optimizing write operations in MySQL will be beneficial. - Kubernetes Service: The Node.js server will be exposed using the ClusterIP service. Familiarity with this service and its configuration is crucial. Ideal candidates for this project should have: - Proven experience with Node.js and MySQL - Ex...
I'm seeking a Python expert to develop a script that automates sending documents from Google Docs to an email. The script should utilize the 'requests' library and employ 'OAuth2' for secure access. The ideal candidate should have experience with: - Python scripting - Google Docs API - Requests library - OAuth2 implementation The project will involve: - Automating the process of sending documents from Google Docs to an email - Ensuring the use of secure OAuth2 consent screen for authentication Please note, the specifics regarding the email service have not yet been determined. Your flexibility and expertise in navigating this will be crucial.
...Required Skills: OpenAI API Expertise: Strong experience with OpenAI’s GPT models (GPT-3, GPT-4, etc.) and integration into web applications. Machine Learning: Experience in using machine learning techniques to adapt AI models to specific writing styles. Knowledge of NLP techniques for style recognition, fine-tuning, and model adaptation. Database Design & Management: Experience building and managing databases to store client-specific writing parameters and content history. Frontend Development: Expertise in building user-friendly interfaces for content generation tools (e.g., React, Angular, or similar). Backend Development: Experience with backend systems (e.g., Python, Node.js) to handle data processing, machine learning tasks, and OpenAI API calls. Consultat...
I need to install a page on my website, in PHP 8, where I can select an XLSX file and insert some data directly into the Mysql database. On this import page, in addition to inserting the xlsx file, I also add text to explain what it is about. (example in the link ) I tried doing something like the video above, but it didn't work. Database and rows: INSERT INTO Tablegroup (idgrupo, idplataforma, idpais, idestado, idcidade, idempresa, idusuario, idusuario_indicador, ididioma, membros, group_id, titulo, url, status, categoria, datacadgrupo) VALUES (NULL, '1', '2', '70', '0', '1', '7', '7', '1', '12312', NULL, 'Teste Delete', '', '1', '20'
...created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Libre and similar platforms sometimes update their anti-scraping security measures. Therefore, I need a long-lasting, robust code that will remain functional over time. In case of failure, I require lifetime support as this functionality is the core of my operation. My website is: Please provide the implementation timeline and cost. I’ve already had a freelancer do it poorly, resulting in wasted time and a refund. I ...
...a drag and drop capability that allows users to drag and drop documents and forms in addition to menu navigation importing. Ensure we do not lose this capability by employing too new version of OS or SuiteCRM software. Add capabilities: Email send/receive (standard for SuiteCRM send/receive capabilities) Currently, I cannot login to backend using admin username and pass. I see it there in the mySQL databases; I just can’t get it to login. I belive someone may have tinkered with the file. I would like to configure the databases to live on an additional server storage drive, not the same drive used for the website itself. It uses a Esxi virtualized VM. This way, the size of the website databases can expand without worrying about disk size. Once the install is complete,...
I need an expert in Python and natural language processing (NLP) with NLTK to help me analyze text from company blogs for negative message framing. Key Focus Areas: - Language Sentiment: I'm interested in how the language used in these blogs frames positive and negative messages. - Persuasive Techniques: I want to understand the persuasive techniques employed in these positive and negative framings. Ideal Skills: - Proficiency in Python and NLTK - Strong background in NLP - Experience with sentiment analysis and understanding of persuasive techniques in language - Ability to interpret and present findings in an insightful manner. Please note, the analysis will focus specifically on detecting and interpreting negative framing.
I'm looking for a skilled Android app developer to create an application for my company. Key Features: - The app will display the current time and company name at the top center of the screen. - Users will log i...right and in a font size smaller than 16. CSS: Background: #000 Font Color #fff Button Color: orange Authentication: - The app will utilize an NFC system for authentication, along with a clear username and password scheme. - Users will authenticate using a text-based password or NFC. Database: - The app will need to connect to a remote MySQL database. Ideal Skills: - Proficient in Android app development. - Experience with NFC technology. - Knowledge of MySQL databases. - Ability to implement secure authentication methods. Please bid only if you can me...
Manuscript Index Website with Protected Login Project Overview We need a secure, user-friendly website to serve as an index for manuscripts. The platform will provide authorized users access to a centralized database where they can view, upload, search, and manage manuscript-related information. The system will suppo...number of manuscripts and concurrent users. Optimized for fast loading and search performance. Security Encrypted storage of sensitive data (e.g., passwords, user information). Protection against common vulnerabilities such as SQL injection, XSS, and CSRF attacks. Regular backups to prevent data loss. Technical Stack Preferred framework/language for backend: [Node.js]. Database: [PostgreSQL, MySQL]. Frontend: [React.js, Angular, Vue.js]. File storage: cloud-based...
need to update a custom MySql CRM , with fixes at contact dashboard and create a new Pipeline Dashboard using database contacts. please check carefully the doc attached. regards
I'm looking for a Python developer. Key Responsibilities: - Develop Python scripts for various tasks Ideal Skills: - Strong knowledge and experience in Python See attached text file for details and say "Halo" so i know you have read the file otherwise i will ignore your bid Needed to complete wikipedia script quickly within hours if you can budget is 12 usd per site i only need scripts
I must do a web application in wordpress. It must have a landing page stile, the payment of service, so creation of account, login and payment. It must have a form plugin to do questionnaire. At th eend of the questionnaire the AI must show a report baed on answers. The web must have a form plugin jotform) The job to do: make the landing pages with information of service, add the buy page of service and method of payment (you can use woocommerce); add jotform; integrate the questionnaire of jotform and the answer with AI to create the authomatic report. The questions of jotform and the answer of jotform must be saved inside my mysql database. So it is necessary create a plugin to create the tables and save the answer ad a plugin or code to to comunicate with an AI th...
Arbitrage Trading Requirements Experience in this field required. Using DEX’s, uniswap, kyber, 0x, bancor, balancer, sushiswap etc. Preferably Python but not mandatory. Preferably VS Code. Some of #1 have been done in Python and but requires serious testing. Stage 1 (Proof of concept): Obtain batch pricing of DEX coins from , thegraph or etc. Create a GUI frontend for identifying, highlighting opportunities. Textbox for minimum % profit, excluding all others. Implement profitably of trade with total cost of trade, including gas fees. Possibly implement triangular trade analysis for obscure trading opportunities. Stage 2 (Implementation of trades): Wallet code for trading. Implement buying and selling of identified pairs within/across
I'm in need of a seasoned full stack developer specialized in Laravel and Vue for creating a custom web application with a primary focus on data analytics and reporting. Key Responsibilities: - Develop a robust custom web application - Implement user management features - Integrate data analytics and reporting functionalities - Ensure seamless integration with various data sources Ideal Skills: - Proficiency in Laravel and Vue - Extensive experience in REST API development - Strong background in data analytics and reporting - Skilled in working with databases (e.g., MySQL, MongoDB) and APIs (e.g., REST, GraphQL) The project will involve integrating with multiple data sources, including databases and APIs. Experience with external data sources such as CSV and E...
I'm in need of a comprehensive hospital management system developed in Python. The system should primarily encompass patient management and medical records features. Key Components: - **Patient Management**: This module should facilitate seamless patient registration etc - **Medical Records**: Although I haven't specified particular features for this module, it's crucial that the system can handle electronic health records, lab results, and prescription management. Ideal candidates for this project should have proven experience in Python development, particularly in creating healthcare management systems. They should be adept in managing databases and ensuring the security and confidentiality of sensitive medical information. Prior experience in developing a ...
I must do a web application in wordpress. It must have a landing page stile, the payment of service, so creation of account, login and payment. It must have a form plugin to do questionnaire. At th eend of the questionnaire the AI must show a report baed on answers. The web must have a form plugin jotform) The job to do: make the landing pages with information of service, add the buy page of service and method of payment (you can use woocommerce); add jotform; integrate the questionnaire of jotform and the answer with AI to create the authomatic report. The questions of jotform and the answer of jotform must be saved inside my mysql database. So it is necessary create a plugin to create the tables and save the answer ad a plugin or code to to comunicate with an AI th...
I'm in need of a Python script that can extract numerical data from an Excel/CSV file. The ideal freelancer for this project should: - Have extensive experience with Python, particularly in data extraction. - Be proficient with handling Excel and CSV files. - Be able to write clean, efficient code. Please note, the data will be purely numerical. The script will need to be able to handle large datasets with ease.
I am looking for a python selenium engineer to do some automate. Requirement - Strong in Python + Selenium - Have experience in automate website - Have macbook to work It will be full time position and long term.
I'm looking for a proficient web scraper who can extract the tokens from the GMGN website. The data should be delivered in a neatly organized CSV file. I want to scan this web: I want that every time a new token appears on the right side (Gastado en DEXScreaner) I save in a csv both the date/time, the token name and the token address. The website I pull from will keep the filters applied (I think if I'm logged in it will keep them). Python code to be able to do this scanning every minute. (En Jupyter notebook) When a new token appears in this window, add it to the CSV. Translated with (free version) Ideal skills for this project include: - Proficiency in web scraping tools and languages (like Python, BeautifulSoup, Scrapy etc....
Project Description: Turnkey Web Application Development Using Django MAXIMUM BUDGET: USD 2,250. 1. Project Conditions Exclusive internal use: The application is intended only for the employees of the importing company. No external users will have access or be able to make purchases through the application. Deadline: 3 weeks from the project award. Current status: The project is already 20% complete. Partial deliveries: At least 2 partial revisions are required before the final delivery for feedback. 2. Objective Develop a turnkey web application for an importing company that facilitates: - Management of customer orders. - Consolidation of purchases made from factories. - Administration of an inventory. - Registration and customization of client information. - The appli...
I'm looking for a seasoned backend developer skilled in , PostgreSQL, MySQL and SQL to collaborate with my frontend developer on a application. Your main task will be working on custom backend services. Experience in building and managing databases is crucial, as is the ability to seamlessly integrate with third-party APIs. Ideal Skills: - Proficient in - Experienced with PostgreSQL, MySQL and SQL - Able to develop custom backend services - Familiar with integrating third-party APIs - Great team player for collaborating with frontend developer
Im looking to update a MySql database used for CRM I need to fix some funytions on what I have and add a new PIPELINE dashboard please chec documentation, is very clear
I'm in need of an expert to conduct a thorough security check on the backend of my website an... preventing unauthorized access. - **Vulnerability Scanning and Patching**: Identifying potential vulnerabilities and ensuring they are patched appropriately. You will have full access to conduct this assessment, including admin access to the backend, source code access, and limited access through the API. Ideal skills for this project include: - Proficiency in backend technologies (Node.js, Python, PHP) - Extensive experience in cybersecurity - Familiarity with vulnerability scanning tools - Excellent understanding of data protection and encryption methods - Knowledge of authentication and authorization protocols. Your expertise will help me ensure the safety and security of my o...
I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.
I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.
...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data's from the stated Site in to o...
...site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site : Check the above websites and need something similar ASAP
I need an expert in machine learning, specifically with experience in fine-tuning the Wav2Vec2 model on custom data. The primary aim is to improve the model's speech recognition accuracy....the Wav2Vec2 model on our speech recordings with transcriptions. - The recordings primarily consist of conversations, so the model should be capable of understanding and processing dialogue. - Ultimately, the goal is to enhance the performance of speech recognition on our custom data. - Create future pipeline for 2nd layer of finetuning with Industry specific data Ideal Skills: - Proficiency in Python and Pytorch. - Extensive experience with Wav2Vec2. - Ability to work with labeled speech data and fine-tune models for improved accuracy. - Strong understanding of machine learning principles ...
