Web crawling and scraping using python仕事
I'm in need of a comprehensive database of verified and accurate email addresses for key positions within all nonprofit organizations across the USA. This includes Presidents, CEOs, Executive Directors, Development Directors, Fundraising Chairs, Special Event Managers, Grant Managers, and Directors of Advancement. The Email addresses MUST belong to a qualified nonprofit organization domain name and cannot be gmail / yahoo or other public email accounts. Ideal skills for this project include: - Data mining and web scraping - Proficient in using LinkedIn and other professional networks - Excellent understanding of nonprofit sector - Strong attention to detail to ensure data accuracy - Established connections within the nonprofit ...
...application(Android & IOS) using Flutter and Firebase. The application will incorporate several core features and systems. The project includes the following features: Stock Calls Feature: Provide stock suggestions and recommendations for users. Dynamic data updates to reflect which stocks to buy. Referral System: Implement a referral program where users can invite others and earn rewards. Phonepe Payment Gateway Integration: Seamless and secure payment processing for premium content or stock services. Admin Panel:(Web Application) Manage content, users, stock calls, lms, and system settings dynamically. Real-time control and updates for the entire application. Requirements: Expertise in Flutter for front-end devel...
I'm seeking a developer who can add a "Name On Card" box on my billing form and repair some existing web scraping code. react node js
I'm seeking a proficient Python programmer who can leverage Google Gemini to programmatically answer a large number of mixed-type exam papers for me. Altogether I have 800 exam papers. The exam papers are in PDF format, and the response to the prompts or gemini outputs need to be copied and pasted into a Word document template I have. Currently a simple prompt such as 'answer the questions contained in this exam paper' and attaching the pdf file gives me what I need. Key Requirements: - Use Python and Google Gemini to automate the answering of exam papers - Handle mixed-type questions (multiple choice, essay type, etc.) - Transfer the answers into a Word document, following a specific naming convention: the output file should have...
My Python script has stopped writing its output to a CSV file and I need it fixed. The output data is primarily text, so the script needs to be able to handle this appropriately. I anticipate the need to review this script on a regular basis. The selected person would be the leading contender to conclude an ongoing maintenance contract for this work, if interested. Ideal Skills: - Python programming - Experience with CSV file handling - Debugging skills to identify and fix issues What I Need: - The script fixed and writing to the CSV file again - The ability to handle mainly text output Investigate the issue without specific error messages and ensure robust error handling in the script.
...media. Focus Areas: Understanding structure (e.g., 3-act structure) Developing characters and dialogue Plot and theme development Writing for specific formats (screenplay, stage play, etc.) Industry trends and pitching ideas Where to Learn: Online platforms like MasterClass, Coursera, or Udemy Film schools or creative writing courses Writing communities and workshops --- 2. Education in Scripting (Programming) Definition: Learning to write scripts (automated instructions) in programming languages like Python, JavaScript, or Bash. Focus Areas: Understanding syntax and language features Writing automation scripts for tasks Scripting for web development, data analysis, etc. Debugging and testing Where to Learn...
...media. Focus Areas: Understanding structure (e.g., 3-act structure) Developing characters and dialogue Plot and theme development Writing for specific formats (screenplay, stage play, etc.) Industry trends and pitching ideas Where to Learn: Online platforms like MasterClass, Coursera, or Udemy Film schools or creative writing courses Writing communities and workshops --- 2. Education in Scripting (Programming) Definition: Learning to write scripts (automated instructions) in programming languages like Python, JavaScript, or Bash. Focus Areas: Understanding syntax and language features Writing automation scripts for tasks Scripting for web development, data analysis, etc. Debugging and testing Where to Learn...
...an experienced Python developer to assist with enhancing and expanding the features of an existing Python Blackjack game script. The script includes basic gameplay, and we are looking to incorporate advanced features such as card counting, next move predictions, and card predictions. Additionally, we want to integrate PyAutoGUI for user interaction on the screen. Requirements: Blackjack Game Enhancement: Implement advanced features like card counting. Integrate next move predictions based on the current game state. Predict the next card in the deck. PyAutoGUI Integration: Use PyAutoGUI to interact with the game screen, enabling the selection of options. Implement logic for doubling down and splitting based on user input. OCR Integration: Ut...
I'll show the custom text on oled with raspberry pi 5 using Python.
I'm in need of a seasoned Python developer with expertise in algorithmic trading to create and deploy a trend-following strategy on AWS. This script should be compatible with brokers like Angel One or Dhan. Key Requirements: - Development of a trend-following algorithmic trading strategy. - Focus on Futures and Options as the primary financial instruments. - Utilization of various data sources for analysis including historical price data, live market data, and news & social media feeds. Ideal Skills: - Proficient in Python with a strong background in algorithmic trading. - Experience with AWS deployment. - Familiarity with brokers like Angel One or Dhan. - Ability to analyze and interpret data from diverse sources. Include risk manageme...
I'm seeking a skilled developer to build a new desktop application using Java and Python. The primary focus of the application will be data processing. Key Requirements: - Expertise in Java and Python - Significant experience in desktop application development - Strong skills in data processing implementation Your role will be to bring this application to life, incorporating robust data processing capabilities. Please provide examples of similar projects you've completed, showcasing your ability to deliver on this type of work.
...(CP) is an innovative email marketing and CRM platform aimed at empowering businesses with AI-driven email automation, CRM integration, and marketing insights. The platform will be a SaaS product, accessible via subscription, and will cater to small businesses, e-commerce brands, and marketing teams. Our goal is to develop an easy-to-use platform with robust features like automated email marketing workflows, CRM management, custom email templates, A/B testing, and analytics—all powered by cutting-edge AI for optimization and automation. Required Team Structure and Roles Given the scope of the platform, we require a small, efficient development team to complete the project within a 3-month timeline, ensuring quality and scal...
...seasoned web scraper who specializes in PHP to develop several scripts aimed at extracting valuable data from trading websites. Key Responsibilities: - Create efficient PHP scripts for web scraping - Handle login mechanisms, dynamic content, and anti-bot measures - Store scraped data in JSON or MySQL databases You will primarily be scraping data related to market trends. Therefore, a comprehensive understanding of trading websites and their data is a plus. The ideal candidate should be proficient with web scraping tools like Puppeteer, BeautifulSoup, Selenium, or Scrapy, and be able to deliver high-quality, optimized scripts in a timely manner. Skills and Experience Required: - Proficient in PHP - Extensive experie...
...design with a focus on user-friendliness and privacy. Website Features: Product Search and Filtering Options: Search bar for targeted product search. Filters by price, brand, material, reviews, availability. Sorting options (e.g., price ascending/descending, popularity, new arrivals). Product Pages: Detailed product information (description, materials, reviews). Comparison table for prices and vendors. "Buy Now" button with redirection to vendor websites. Reviews and Ratings: Aggregation of reviews from multiple sources. Option for users to submit their own reviews. Recommendation System: Display of similar products or “frequently bought together” recommendations. Discreet Mode: An option to present the website with minimalistic, ne...
We're an EdTech platform seeking a dedicated Django backend developer to enhance our ne...backend developer to enhance our nearly completed platform. Key Responsibilities: - Implementing new features and optimizing performance - Fixing bugs and issues - Collaborating on building new features and troubleshooting - Developing and maintaining RESTful APIs Critical Data Management Tasks: - Database optimization - Data migration - Ensuring data security Ideal Candidate: - Proficient in Python and Django - Experience with backend development - Familiar with EdTech platforms - Committed to quality and timely delivery Commitment: - 3 hours daily, Monday to Saturday - Long-term, freelance engagement To Apply: Please submit your portfolio...
...which represent 4 stock or futures products of the US and Hong Kong markets. The program should be able to read the latest green up arrow which is a buy signal and the red down arrow which is a Sell signal. At the start of the program, it should ask for the market name, product name, no. of lots to trade and the stop loss level in no. of points for each of the graphs on the upper left, upper right, lower left and lower right of the screen. If all 4 products are entered, the program should be able to trade all 4 products simultaneously by auto trading using a Python program with an Interactive Brokers live account in Part 2. Part 2. Once a buy or sell arrow is scanned on the latest right side of the graph, it should inform the Python ...
...with expertise in Python and R programming to assist with statistical data analysis for projects related to cardiology, proteomics, and omics research. While a background in biology or life sciences is preferred, candidates with a strong scientific background and the ability to perform high-quality data analysis are encouraged to apply. This is a flexible, remote freelance role offering hourly compensation. Key Responsibilities: Perform statistical data analysis using Python and R to support research projects in cardiology, proteomics, and omics-related studies. Conduct static analysis, ensuring accuracy and reproducibility of the data. Collaborate with researchers to translate data into action...
...developer to create an MSI installer for a Python project I will host on GitHub. Please read the requirements carefully before responding. I am looking for clear and definitive offers without unnecessary delays or irrelevant features. Any deviation from the specified requirements will result in the developer being excluded from consideration. Core Requirements for the Installer: Install Python 3.12 via its MSI installer. License Check: The installer must validate the license before proceeding (details below). Install Project: Use pip to install the project directly from the GitHub repository. Desktop Shortcut: Add an icon for the program to the desktop. System PATH Update: Ensure the program's directory is correctly added to the system PATH: C:/.../python...
...Description: We are looking for an experienced Python / Django / Woocommerce SENIOR developer with strong UI/UX skills to maintain and improve our clothing retail system. The main task is to fix collision of URL because same name of product issues with our online store (WooCommerce) and ensure seamless integration between platforms. Responsibilities: • Troubleshoot and resolve fix collision of URL because same name of product issues. • Maintain and optimize the existing system for performance and reliability. • Enhance the UI/UX for both internal and external users. • Collaborate with our team to implement additional features as needed. Requirements: • Proven expertise in Python and Django. &...
Web Scraping Specialist Needed Description: We are seeking a skilled freelance web scraping expert to extract and organize data from websites efficiently. The ideal candidate should have experience handling large-scale data scraping projects and working with both static and dynamic websites.
...SystemVerilog,UVM,C,C++,VHDL,Python,Firmware etc. Familiar with using: Linux, Windows,Unix,MS-DOS,FreeRTOS. PreviousFields: AISC/IP/IC design,SOC design/verification,FPGA Design/Verification and debugging,AI (especially deep learning),complex digital systems,complex communication systems,mixed digital and analog systems. Work experience focused in Beijing China 5+ years of ASIC experience and 10+ years of FPGA experience, experienced Senior Technical Lead with a demonstrated history of working in the semiconductors industry. Part of 5+ tape outs. Lead Subsystem and ASIC/SoC front end Design. Worked on chips centering to Communication/High Speed Rail/Ecommerce, Automotive and Industrial applications. Extensive digital signal proc...
I'm seeking a skilled programmer with Python expertise and a finance background to create a predictive model. This model will leverage both shallow and deep learning techniques, as well as neural networks, to predict the EUR vs AUD currency pair. - Data Utilization: The model will primarily utilize freely available data on the web, rather than specific datasets. - Performance Expectations: I'm aiming for a model that achieves moderate accuracy. Ideal candidates for this project should have: - Proficient Python programming skills. - A solid understanding of finance and currency trading. - Experience applying shallow and deep learning techniques and neural networks. - Ability to develop a predictive model from publicly av...
I'm seeking a Python expert to create a video scraper that downloads videos. While the exact platforms and video types have yet to be determined, the ideal candidate should be flexible and capable of adapting to various needs. Key Responsibilities: - Develop a reliable video downloading scraper using Python - Ensure the scraper can be adapted for various platforms and video types in the future Required Skills: - Proficient in Python and previous experience with video scraping projects - Ability to develop adaptable, long-term solutions - Excellent problem-solving skills Experience with platforms like YouTube, Vimeo, and Dailymotion will be a plus.
...experienced Python developer to create a robust and scalable scraper and extractor capable of fetching videos from all types of video websites, including those in the adult category. This will be a long-term collaboration, and the developer must also provide a user-friendly API for seamless integration into our systems. Responsibilities: Develop a Python-based scraper/extractor to fetch videos from various video platforms, including: Popular streaming sites. Adult content sites. Sites using complex JavaScript, dynamic content, or encryption methods. Handle: Encrypted or segmented video streams (e.g., m3u8, HLS). Anti-scraping measures (e.g., captchas, IP blocking). Provide a scalable API for: Fetching video URLs or downloading videos. S...
I'm looking for a skilled developer to enhance my Asterisk system. ...the call. Ideal skills for this project include: - In-depth knowledge of Asterisk and its APIs - Experience in developing and integrating survey plugins into telephony systems - Proficiency in database management and storage solutions - Understanding of Caller ID systems and related technologies - Strong programming skills, preferably in languages commonly used with Asterisk like Java or Python. - Experience with VoIP protocols such as SIP, IAX, and H.323 - Skills in integrating third-party APIs with Asterisk - Knowledge of telephony security and encryption methodologies Please provide examples of similar projects you have completed in your proposal. The Caller ID...
I need to scrape a table from a website. We will be using python for this purpose. I need to scrape this table everday. The scraped data should be saved in CSV format. thankyou
We are a UAE-based distribution company seeking a creative graphic designer who can assist us in designing custom packaging for a new potting soil brand that we intend to sell in the UAE market. The designs are to be created using any of the below FILE FORMATS in high resolution: a. AI, EPS – up to Adobe Illustrator CC; b. PDF – Portable Document Format: Acrobat 8 (PDF 1.7) We have attached several sample designs for ideas and to take reference on these bags' specifications, dimensions, and overall themes. Our item's brand name is 'Vrienzenveen Potting Soil'. Note: We have attached a JPG file of a potting soil brand 'Bogro'. The new bag designs that you will create from the front/face of the bag will be almost identical t...
...in India to identify areas with significant construction activity and trends in building materials. ### Scope of Work: 1. **Data Collection**: - Gather relevant public data sources related to home building in India, including but not limited to: - Government databases - Real estate reports - Construction permits - Building material sales data 2. **Data Analysis**: - Analyze the collected data to identify: - Areas with heavy construction activity (hot pockets). - Trends in the types of building materials being used. - Historical data trends to predict future construction activity. 3. **Data Visualization**: - Create vi...
I have launched an online course and need a minimalist-style logo. The logo should incorporate both text and an icon, and should be in a blue and white color scheme. Ideal freelancer skills: - Graphic Design - Logo Design - Branding Please provide a portfolio that demonstrates your experience with minimalist design and your ability to create engaging, clean, and professional logos. Please have the look at the current logo of the course. I want to change current logo. Thanks
...system. managers login admin can add multiple users and assign roles to manage multiple or single roles 1. Employee Management System This module will handle employee-related information. Features: Employee: A form to add a new employee. Fields: Employee Name, Employee Number (or ID), Contact Information. Employee List: Displays a list of all employees. Includes options to Edit and Delete employee information. Employee Attendance: Admin can record employee attendance. Record the employee’s absence and the reason for the absence. Show Attendance: A report displaying the list of absent employees with columns: Employee Name Date of Absence Reason for Absence 2. Vehicle Management System This module manages vehicle information and di...
...currently building a matching website using the HivePress plugin. We are looking for someone to help us solve the following problems within 3 days (72 hours). If the project is not completed within this timeframe, it will be canceled. Please ensure strict adherence to the deadline. ■ Development environment System: WordPress Theme: Divi (DIVI editor) Plugins: HivePress, Meta Box, etc. ■ Project Summary This project is to add 4 FIELD GROUPs created by Meta Box or ACF to the front-end profile modification page generated by HivePress using ACF, etc., and display them in order, so that users can modify them on the front end. Display the title of each FIELD GROUP above the four FIELD GROUPs to be additionally displayed. ■ Details Create a front-end profile edit page ...
I'm looking for a professional with strong scripting skills to edit a script and run it. The script requires some feature additions. Ideal candidates should: - Have significant experience with scripting languages, preferably Python, JavaScript or Shell Script. - Be able to understand and implement feature additions efficiently. - Have a knack for detail and a commitment to quality. Please note, the specific script type and features to be added are yet to be determined. Therefore, flexibility and a problem-solving approach will be key to the success of this project.
I'm looking for a proficient programmer to develop a bot capable of executing day trades on various crypto currencies via the Binance exchange. The bot's trading decisions should be based on specific price thresholds plus some o...or not there is an existing order within my account for the specific crypto being traded - The bot should be able to be set up to trade multiple crypto currencies at the same time Ideal Skills: - Extensive experience with cryptocurrency trading bots, particularly for day trading. - Proficient in programming and familiar with the Binance API. The bot should include advanced security features like multi-factor authentication and IP whitelisting. The bot should be developed using Python or JavaScript. The bot should allow adva...
...experienced Python/Django developer with strong UI/UX skills to maintain and improve our clothing retail system. The main task is to fix collision of URL because same name of product issues with our online store (WooCommerce) and ensure seamless integration between platforms. Responsibilities: • Troubleshoot and resolve fix collision of URL because same name of product issues. • Maintain and optimize the existing system for performance and reliability. • Enhance the UI/UX for both internal and external users. • Collaborate with our team to implement additional features as needed. Requirements: • Proven expertise in Python and Django. • Experience with WooCommerce integration and A...
Hide my website IP using reverse proxy. I have a VPN for this.
I'm seeking a professional with experience in server management and web scraping to help me install Node.js version 22 and Puppeteer version 17.1.3 on my Linux server (ubuntu24.04 lts). This is to run the 'Ultimate Web Novel and Manga Scraper' plugin for my WordPress site. The installation of puppeteer should be done in the following directory: cd /var/www/ After installation, I need you to: - Test that everything is functioning correctly on the various scraper sites. - Specifically check the performance on Web Novel site A, Web Novel site B, and several Manga and other sites. You will have full root access to the server, so you can execute necessary commands without restriction. Please refer to this g...
...are looking for a skilled and versatile web developer based in India, with solid expertise in web development and design. Our ambitious project requires a professional capable of designing, developing, and optimizing innovative digital solutions while adhering to the latest technological trends. Required Skills: Front-End Development: Proficiency in HTML5, CSS3, JavaScript, and frameworks such as React, Angular, or Vue.js. Experience with responsive design and a strong understanding of UX/UI principles. Back-End Development: Expertise in Node.js, PHP, Python, or other back-end programming languages. Knowledge of frameworks like Laravel, Django, or Express.js. Strong command of relational databases (MySQL, PostgreSQL) and...
...deep expertise in Linux, Python, and C++. The task involves installing necessary packages, compiling, and executing existing code related to bilinear pairing and discrete log libraries. The ultimate aim is to bolster the security within a secure scheme. Key Tasks: - Set up a Linux (Ubuntu) environment and install all required packages. - Compile and execute provided code. - Lead a step-by-step walkthrough of the process via a virtual meeting. - Create a detailed, comprehensive ReadMe file so I can replicate the setup independently. - Develop troubleshooting guidelines for common setup issues. - Optimize the performance of the implemented security code. Ideal Candidate: - Expert-level skills in Linux, particularly Ubuntu. - Strong programming b...
I'm looking for a Python expert to help me compile a simple one-page GUI. Key Requirements: - Primary function of the GUI is for user interaction, specifically handling button clicks and drag-and-drop actions. - While the specific library for the GUI hasn't been chosen yet, I am open to suggestions. However, Tkinter, PyQt, and Kivy are all potential candidates. Ideal Skills: - Proficiency in Python, especially with GUI development. - Experience with user interaction design. - Knowledge of Tkinter, PyQt, and Kivy. type "dragon" in the begining of your proposal . Your task will be to create a simple, user-friendly interface that allows for easy interaction. Please provide examples of similar projects you have completed in yo...
I need a Python developer to create a RESTful API. The main tasks for the API will be CRUD operations. Ideal Skills: - Proficiency in Python - Extensive experience in creating RESTful APIs - Understanding of CRUD operations - Experience with Flask frameworks Experience: - Previous projects involving Python and RESTful API development - Proven track record in API functionality implementation The API should connect to a PostgreSQL database.
I'm looking for a data scientist who can scrape a review website and apply BERT topic modelling on the reviews. Key Requirements: - Directly scrape reviews from a specified website - Apply BERT topic modelling to these reviews - Communicate findings clearly Skills and Experience: - Proficient in web scraping - Experience with BERT and topic modelling - Ability to analyse and interpret data All reviews are in English. Please provide examples of similar projects you have completed in your proposal.
I'm looking for a professional who can help with data scraping from a website that requires login credentials. The task involves scraping text data on a daily basis, analyzing it with ChatGPT or a similar tool, consolidating the findings, and sending them to my email. Ideal Skills: - Proficient in web scraping - Experienced with data analysis tools, preferably ChatGPT - Good understanding of email automation Key Responsibilities: - Daily scraping of text data from a specified website - Utilizing ChatGPT or a similar tool for data analysis - Consolidating the analyzed data into a comprehensive report - Sending the report via email Please note, the data will solely consist of text, and the analysis required is summary generation. I...
I'm looking for a Python developer to create a simple program that interfaces with the CoinMarketCap API. The program should filter digital currencies based on criteria I specify, including coin listing date, market cap, liquidity, platforms, price, quantity, and some technical indicators. Key requirements: - The program should be compatible with Windows. - The results should be displayed in the console. Ideal skills and experience: - Proficiency in Python and experience with API integration. - Familiarity with financial data and digital currencies. - Ability to create efficient filtering algorithms. The filtered results should be displayed in the console as a formatted table. Include averages, RSI, and some simple indicators as tech...
We are looking for a Smartsheet expert who can offer an implementation service for: - project management: task, milestones, timing, resources and budget - tracking the project progress - tracking the hours of each resource and the expenses that occurred - report - dashboard
...freelance and gig opportunities for income generation. Key Responsibilities: - Develop a new feature for an AI-based financial assistant that identifies and integrates freelance and gig opportunities. - Ensure the feature is user-friendly and efficient. - Optimize algorithms to ensure accurate match between user skills and gig opportunities. - Implement robust data security measures to protect user information and financial data. - Design and implement API integrations with popular freelance platforms. - Develop real-time notification system for new gig opportunities. - Train and optimize machine learning models to improve opportunity matching quality. - Create a feedback loop to continuously improve feature based on user experien...
Need a data scraping expert proficient in Python, who can expertly navigate and overcome anti-scraping mechanisms on a website. Key Requirements: - Extensive experience in data scraping, particularly on USA websites. - Previous experience in overcoming anti-scraping mechanisms. - Proficiency in Python and understanding of its libraries for web scraping. - Familiarity with paid proxies and can effectively utilize them.
Mi empresa se dedica al reparto de paquetes y al final de mes tenemos una tabla Excel con las ubicaciones en las que ha estado cada repartidor. Queremos un script que procese ese excel y calcule los kilometros recorridos por cada conductor a poder ser con Google Directios API.
...for an experienced Python/Django developer with strong UI/UX skills to maintain and improve our clothing retail system. The main task is to fix synchronization issues with our online store (WooCommerce) and ensure seamless integration between platforms. Responsibilities: • Troubleshoot and resolve synchronization issues between the retail system and WooCommerce. • Maintain and optimize the existing system for performance and reliability. • Enhance the UI/UX for both internal and external users. • Collaborate with our team to implement additional features as needed. Requirements: • Proven expertise in Python and Django. • Experience with WooCommerce integration and API handl...
I need one expert of Python, Flask for my project I need work for long term
