Web crawling and scraping using python jobs

We are looking for a highly skilled Python developer with expertise in API integrations, web scraping, and webhooks to work on a complex recruitment automation project. The core of this project involves integrating with the Manatal recruitment platform API, processing data from external services like OpenAI, and automating workflows to enhance candidate evaluation. This includes fetching candidate data, dynamically associating job descriptions, processing resumes via OpenAI's API, and updating scores and custom fields directly in the Manatal platform. Additionally, the project requires monitoring assessment completion through webhook events and triggering automated reminders or updates based on specific conditions. The ideal can...

We build django bootstrap sites for clients, you just need to understand code. you will copy and paste code from chatgpt+

...experience in application development Understanding of Scala and willingness to learn 2+ years’ experience with Python 2+ years’ experience with SQL Must possess exceptional communication skills and the ability to effectively defend ideas and solutions; produce technical relevant presentations, convey complex information in a manner that is easily understood and actionable to both non-technical and technical leaders  Professional experience identifying and gathering solution needs; performing risk analysis, collaborating on architecture / solution design; acting and driving key stakeholder acceptance  Ability to communicate at all levels, build and foster relationships, including coaching and mento...

As discussed in chat. the other pages in the order process, starting from Physical try on. As per the image flow image provided.

...help me organize and analyze IRCG data from 1984-2024. The data will be focused on Political Risks (IRCG Table 3b) and Financial Risks (IRCG Table 4b) from PRS Group, and will involve estimating macroeconomic indicators with a specific emphasis on FDI inflows, export performance, the International Country Risk Guide (ICRG), and tariffs. Only individuals who have access to the required data or can arrange it should apply. Reference: Key Responsibilities: - Organizing and cleaning the IRCG data - Performing data analysis - Utilizing provided estimation models Skills and Experience: - Proficient in using Stata/R/Python/SPSS for data analysis - Strong background in data analysis, particularly in the areas of predictive modeling ...

...development team to create a cutting-edge recruitment platform that not only matches job descriptions with candidate CVs using AI but also automatically extracts key information from CVs to populate user profiles. Here are the detailed requirements: **Key Features:** 1. **User Registration & Profiles:** - **Recruiters:** - Registration with company details, job roles, and contact information. - Dashboard to post job descriptions (JDs) and view AI-matched CVs. - **Job Seekers:** - Profile creation where the platform reads, parses, and populates information from uploaded CVs. - Manual editing options for all auto-populated data to ensure accuracy and completeness. - Control over CV visibility settings (public, semi-pr...

I'm looking for a web scraper to help my asphalt sealing company find leads. The ideal freelancer would be able to extract information from Google, Zillow, and Chamber of Commerce websites to find both residential and commercial properties with driveways or parking lots in my local area. Key Requirements: - Ability to find and extract pertinent information from web sources, including the name, address, email, and phone number of property owners or managers. - Prior experience with web scraping and lead generation. - Capacity to prioritize the search for properties on the specified websites. Ideal Skills: - Proficient in web scraping tools and software. - Excellent data collection and analysis ...

Restaurant data collection project. 90 percent is complete. Need an expert to fix the last areas of code and help complete the job done.

...video, audio, and camera effects through a subscription system. The plugin must be secure, efficient, and compliant with GDPR regulations. Core Functionalities 1. Subscription System Login and Authentication: Use HTTPS for all communications. Implement secure login with JWT (JSON Web Tokens) for session management. Passwords must be hashed using bcrypt or a similar algorithm. Restrict login attempts per IP to prevent brute force attacks. Ensure protection against SQL injection, XSS, and other common vulnerabilities. Subscription Types: Manual Subscription: Users can only access effects available at the time of their subscription. Automatic Subscription: Users gain continuous access to all current and future effects. Subscripti...

I'm in need of a skilled data scraper who can extract phone numbers from various websites. Key Requirements: - Expertise in web scraping techniques and tools. - Proficiency in data sorting and filtering. - Prior experience in extracting contact details. Ideal Skills: - Web Scraping - Data Analysis - Python/Scraping Tools (like BeautifulSoup, Selenium, etc.)

I need an expert in Python and visualisation. YOU MUST HAVE EVIDENCE YOU CAN DO THE JOB OR DONT APPLY AS YOU WILL BE IMMEDIATELY REJECTED. Please supply proof with your submission. DONT SUBMIT WITHOUT EVIDENCE OF EXPERIENCE IN THIS SPECIFIC REQUIREMENT I DO NOT CARE ABOUT ANY OTHER QUALIFICATION YOU HAVE LETS NOT WASTE EACH OTHER TIME EH! I need someone to take data turn it in to a dashboard. I need the data to be segregated by user account so one user cannot see another users details. Background We have 50 different locations. Some locations are owned by more than client so lets say we have 40 clients We have reports for each location which need to see individually We need to see rolled up accounts per client We need all client reports rolled up in to a single repo...

...an experienced and skilled Cloud Engineer with expertise in AWS architecture design, backend development, and AWS services integration. You will play a pivotal role in designing, developing, and integrating scalable cloud solutions for our projects. This is a contract-based freelance position with the opportunity to collaborate on cutting-edge projects in a fast-paced environment. Key Responsibilities: • Design and implement robust, scalable, and secure cloud architectures using AWS services. • Develop and maintain backend systems using modern programming languages and frameworks. • Integrate various AWS services such as Lambda, API Gateway, DynamoDB, RDS, S3, and others into our infrastructure. &b...

...monitors specific profiles on X (formerly Twitter) for posts indicating a **memecoin launch**. The bot should notify us **via Telegram** as soon as one of the monitored accounts posts a relevant update. The bot should be quick, efficient, and not require any paid developer tools or APIs. - Monitor X Profiles: - Track a predefined list of X profiles (such as influencers, crypto-related accounts, or meme-focused accounts). - Focus on posts related to **memecoin launches**, such as mentions of new tokens, specific hashtags, or key phrases related to crypto and meme coins. - **Real-Time Detection**: - The bot should scan posts in **real-time** to identify when a memecoin-related post is made. - It should capture signals such as the **mention of new tokens**, ...

I'm looking for a Python machine learning expert who can help me with a machine learning project. The specifics of the project have not been defined yet, so flexibility and a broad range of skills and experience will be key. Ideal Skills and Experience: - Proficient in Python with a strong understanding of its machine learning libraries such as Scikit-Learn, TensorFlow, Keras, etc. - Experience in a variety of machine learning techniques. - Ability to work with different types of data. - Strong problem-solving skills and creativity to define the project objectives.

We are seeking talented and motivated individuals to generate leads for our performance marketing (PPC) services. You can use your expertise in online bidding, cold emailing, cold calling, LinkedIn outreach, or any other effective lead generation strategies. Compensation: Fixed Monthly Payment: ₹5,000 (negotiable based on experience) Per Lead Bonus: ₹100 per qualified lead Key Responsibilities: Generate high-quality leads for our PPC services through your preferred methods. Identify and connect with potential clients using tools like LinkedIn, email campaigns, or data scraping. Maintain accurate records of leads generated and status updates. Collaborate with our team to ensure lead qualification. Requirements: Proven experience in lead generation, dat...

I'm in need of a Python programmer who can create simple scripts for automating various tasks. Ideal Skills: - Proficient in Python programming - Experience in writing simple automation scripts - Problem-solving skills to understand and automate tasks efficiently The scripts will be straightforward, aimed at streamlining repetitive tasks to enhance productivity. You don't need to deal with complex algorithms or data analysis for this project. Your primary focus will be on creating easy-to-understand and effective scripts that can take over simple tasks.

...creating a simple Python strategy to be used for crypto trading on Binance. The script is basically a simple trade management and hedging script that will allow me to open and manage multiple orders in hedge mode. The key input variables to be specified by the user are: Trading Symbol Upper Limit Price Lower Limit Price Take Profit (In Percentage) Stop Loss (In Percentage) Initial Trade: Long or Short Hedge Multiplier Maximum Number of Hedges If the user specifies Initial Trade = Long, the trading engine will seek to open BUY STOP orders at the Upper Limit Price and undertake SELL STOP orders at the Lower Limit Price (as a hedge) Let’s assume that the current market price is $100. The user specifies Initial Trade = Long and sets the ...

I'm looking for a skilled professional to set up a GitHub repository for a production-grade, FastAPI-based web application built with Python and Docker. This repository will be crucial for the deployment and maintenance of the application. Key Requirements: - Expertise in Python and FastAPI is a must. - Proven experience with Docker for containerization. - Prior experience in setting up GitHub repositories for production-level projects. - Knowledge of best practices for GitHub usage in a production context. The ideal candidate will not just set up the repo, but will also ensure it's optimally configured for our production needs. Github repo is

...Ground floor : Pic 1. 1. reuse this red wooden panels as the background decoration for the ground floor throughout. This includes the (4) vertical green and blue panels with their decoration as well as the horizontal ones on the top. Those green and blue panels are made in stained glass (see through). 2. in the central arch (which is not a door) the bottom part (from 75cm high to 1.50 cm high we put the black deco as later in pic x) while the bottom is blue and the top is part ... 3. is white with bue clouds as in pic x 4. the windows above the doors have their shapes changed 5. the left one is sun like with rays like in pic x (but no face) and as well asian deco patterns in the right window 6. which follows moon shape with asian deco patterns as in pic x 7. ...

I'm in search of an experienced Python/Django developer to assist in the creation of a web application. The application will require functionalities typical of a web platform. Ideal Skills: - Proficient with Python and Django - Web application development experience - Understanding of user interface and user experience (UI/UX) design principles - Knowledge of deploying and maintaining web applications Please note: The specifics of the application features are yet to be defined, but your input on best practices will be valuable.

...Accepted Responsibilities: • Manage and maintain OpenShift Container Platform environments, ensuring optimal performance and reliability. • Implement, monitor, and troubleshoot OpenShift clusters and workloads. • Perform upgrades, patching, and scaling of OpenShift clusters. • Configure and manage container orchestration tools, including Kubernetes. • Collaborate with development, operations, and security teams to support containerized applications. • Automate repetitive tasks using scripting and Infrastructure-as-Code (laC) tools like Ansible, Terraform, or similar. • Ensure platform security by implementing best practices, including role-based access control (RBAC) and security &bu...

I am looking for a data scrapper who can scrap the reviews and product ratings for the few product categories from Amazon. Product Categories: - Electronics Specific Products: - Personal Audio - Large Audio (home speakers) - Wireless Speakers - Smartwatches - Smart Rings - Activity Tracker Ideal Skills: - Expertise in web scraping - Experience with data analysis - Familiarity with Amazon's platform and its product categories Please note, I only require data from Amazon, not Flipkart. Your bid should reflect your understanding of this project scope.

I need a skilled data scraper who can efficiently extract text from JPEG images and organize it into a Google Sheet. Key Project Details: - Source Format: The images are in JPEG format. - Data Type: The data to be extracted is purely textual. - Organization: The extracted text needs to be placed in multiple columns in the sheet. Ideal skills for this task include: - Proficiency in data scraping - Experience with image data extraction - Familiarity with Google Sheets and its functionalities Please provide examples of your previous work, specifically any similar data extraction projects you've completed.

I need a Python expert to develop a script for automating my marketing emails. Moreover, my business website requires a UI/UX overhaul, specifically in its navigation layout, color scheme, and responsive design. Ideal Skills: - Proficient in Python, with prior experience in email automation. - Strong background in web design/UI and UX principles. - Familiarity with SEO and website performance optimization. Requirements: - Develop a Python code for email automation focused on marketing campaigns. - Revamp the design/UI of my business website, enhancing its navigation layout, color scheme, and responsive design.

...- Taxpayer Identification Number (TIN) - Address - Phone number The parsed data needs to be delivered in an Excel format, as I plan to use it for marketing purposes. This is a one-time task, so I do not need the parsing to be done periodically. Ideal skills for this project include: data parsing, data entry, and Excel proficiency. Experience with web scraping and handling large datasets is a plus. Please ensure that your bid reflects your ability to deliver this data accurately and efficiently....

I'm seeking a Python expert to create a script that connects to the Polymarket API. The script should be capable of: - Retrieving market prices and trading volume. - Placing buy orders, sell orders, and conditional orders. - Utilizing an API key for authentication. Ideal candidates will have a strong background in Python and experience with API integration, specifically with financial or trading platforms. Knowledge of Polymarket will be an added advantage. Please provide examples of similar projects you have completed. I am a novice coder myself and have built various bots, such as a binance trading bot. However I do not have the spare time to create this bot, I know this is not a difficult task so I am excited to work with someone who can...

I have a ready-to-go Python script that I need deployed on Digital Ocean Apps. The script is an automation tool and interacts with several external APIs. Key Requirements: - Deploy the script from my GitHub repo - Configure the necessary environment variables (I have a complete list of these) - Ensure the script is able to interact with the required external APIs Ideal Skills and Experience: - Proficient in Python programming - Experience with Digital Ocean Apps deployment - Familiarity with GitHub - Knowledge of setting up environment variables - Understanding of integrating with external APIs. Please ensure to review the script on GitHub before bidding. Thank you.

I need assistance extracting some information from a website. The data to be extracted is specific. The extracted data should be formatted as a CSV file. This is a one-time extraction task, so no ongoing work is required. Ideal skills for this job include web scraping, data extraction, and CSV file management. Experience with handling diverse types of data is a plus. Please ensure you can deliver a clean, well-structured CSV file. I need python script which i can run when i need to extract data. i script should take list of symbols which to use to go to site.

I'm looking for a freelancer to design and develop a modern, professional and corporate style website for my AI agency. This site should be fully optimized for SEO with the primary goal of lead generation and providing comprehensive information about our AI services. Key Features: - All standard website pages (Home, About Us, Contact Us, etc.) - High SEO standards to enhance visibility and lead generation Ideal Skills: - Strong experience in web design and development - Proficient in SEO strategies and techniques - Capable of creating a professional and corporate design AI Agency Website Development Project Overview: I am looking for a professional web developer/designer to create a modern, responsive, and SEO...

I'm looking for a Python developer with strong experience in creating trading systems to help me implement a scalping strategy on the Australian ASX. The system should include: - Real-time data analysis: The system needs to analyze market data in real time to identify profitable scalping opportunities. - Automated order execution: The system should be capable of executing trades automatically based on the predefined scalping strategy. - Backtesting capabilities: The system should allow for backtesting against historical data to fine-tune the trading strategy and assess its potential profitability. Ideal candidates should have previous experience in developing automated trading systems, particularly for scalping strategies, and a deep understanding of the ASX m...

I'm looking for an experienced Python developer who can create the software architecture for a project. This will involve using MongoDB and FastAPI, so fluency in these technologies is a must. Ideal candidates will have: - Extensive experience with Python - Strong understanding of software architecture - Proficiency with MongoDB - Expertise in FastAPI Please note that the specifics of the project will be discussed further and it’s a few hour task and it’s very urgent

...develop, and optimize audio processing algorithms and plugins. * Implement DSP modules in C++ using frameworks like JUCE (7/8). * Develop analog modeling algorithms to emulate vintage and modern audio equipment. * Collaborate with cross-functional teams to ensure seamless integration with major DAWs (AAX, VST, AU). * Optimize code for real-time performance and scalability. * Maintain and enhance existing plugins with new features and improvements. * Stay updated with the latest advancements in DSP and audio software. Requirements: * Proven experience in DSP programming and algorithm development. * Strong proficiency in C++ and experience with JUCE (7/8) framework. * Solid understanding of real-time audio processing ...

I'm in need of a professional logo designer with extensive experience in Corel DRAW. The task at hand is to create a modern-style logo for my brand. Ideal Skills: - Proficient in Corel DRAW - Strong portfolio in modern logo design - Excellent communication skills for project updates and revisions

We are searching a skillful editor to edit our video content of our food oriented brand from a famous Chef. Edits need to be done in CapCut desktop in order to share the project online, because voiceover and subtitles need to be added by us and may some minor edits needed. This project is for a long term collaboration so consider that a demo edit will be required.

...skilled professional who can scrape B2B data from Google Maps and other sources, specifically targeting the Australian market. The focus is primarily on the commercial and industrial sectors, including industries such as manufacturing, logistics, production, engineering, refrigeration, meat wholesalers, food wholesalers and mechanical. Key Responsibilities: - Scrape B2B data from various platforms - Enrich the scraped data using Clay and other AI tools to get comprehensive company details - Capture the main contacts and their details, including mobile numbers and email addresses Ideal Skills: - Proficient in data scraping and data enrichment - Familiar with Clay and similar AI tools - Understanding of the Australian...

Automatic Customizable Table or Report by Scraping, especially stock market fundamental data Do you want to have data to help you make more infromed decisions? demo: the table can be downloaded from website price: 70 USD per month per table, billed quarterly Affiliate Marketing: You help me find customers, I pay you 30% of the revenue for the first 3 months

I'm looking to detect specific emotions in recorded lectures and presentations using the DaiSEE dataset. The primary emotions of interest include engagement. Key requirements: - Experience with emotion detection using video datasets. - Proficient in using dataset similar to DaiSEE dataset for video processing - Previous work with object detection in videos is a plus. - Ability to provide performance metrices and analyze the model

We are looking for a python developer to create a scheduled program that uses an Excel sheet template with placeholders and data from a Mysql database to create paginated reports and saves the reports as pdf. Be aware that the Excel sheet will contain content like imported images, a page header, etc., which has to be considered during the pagination process. Program needs to run on Ubuntu, not Windows

...for both Android and iOS platforms using Expo, React Native, and TypeScript. The backend APIs and authentication services are already developed. The app will include user sign-in, sign-up (for both users and professionals), biometric authentication, language selection, profile completion, and service booking features. Additionally, we require a polished design, custom logo, and deployment pipelines for app stores. Project Scope (MVP 1): This is the first iteration (MVP 1) of the mobile application. The app will include essential features such as user authentication (sign-in, sign-up), biometric or PIN-based login, profile completion, language selection, and service booking. Future iterations (up to MVP 7) will expand upon this fo...

...operators can then print the QR code and provide it to their customers. Customers will use their respective QR codes to make monthly payments conveniently. Customer Management Panel with QR Code Generation, Payment Gateway Integration, and Telegram Notifications ________________________________________ Project Overview I need a web-based platform with a secure login system for managing customers, generating unique QR codes linked to their accounts, and integrating a payment gateway (PhonePe) to track payments. The platform should also include a dashboard for tracking customers and payments, exporting data in various formats, and generating reports. Additionally, the system should have the ability to scale with a super admin panel to allow other ...

...skilled full-stack web developer to create a modern, minimalist e-commerce site. The project involves both frontend and backend development. Key requirements include: - Building a user-friendly shopping cart - Implementing an efficient product search and filtering system The ideal candidate should have a strong portfolio of e-commerce sites, with demonstrated experience in both frontend and backend development. A keen understanding of modern, minimalist design principles is crucial. Proficiency in integrating responsive design and ensuring cross-browser compatibility will be highly valued. Your technical skills should ideally include: - HTML, CSS, JavaScript for frontend development - Python, Ruby, PHP or similar for backend development - ...

...for an experienced email marketer, proficient with mailchimp and data scraping, to help me develop relationships with service providers for eCommerce. The ultimate goal of this campaign is vendor development in Canada, focusing on all types of service providers in Canada, including but not limited to IT, marketing, and consulting services. Key Responsibilities: - Design and execute an email marketing campaign aimed at engaging potential service provider vendors. - Utilize data scraping techniques to identify and reach out to relevant service providers. - Employ Mailchimp for effective campaign management and monitoring. Ideal Skills: - Extensive experience in email marketing, particularly with Mailchimp. - Proficient in data scraping...

...Amazon repricing and competitor analytics app. The ideal candidate will be responsible for backend and frontend tasks, integrating APIs, enhancing scraping pipelines, and preparing the app for beta testing. This role requires expertise in Node.js, Python, React, and MongoDB, as well as excellent communication and teamwork skills. You will play a critical role in completing the app, ensuring a smooth user experience, and implementing efficient backend processes. The app will eventually integrate AI and deep learning algorithms for advanced repricing. Responsibilities: Backend Development (Node.js, Python): • Collaborate on API development and integration to connect the backend with the frontend. •...

...to revise my current database for better functionality and to assist with web data population. This project has two key phases: 1) Revision of the existing MS Access Database - Correcting Form view fields: There are some fields in form view that are incorrect or incomplete, such as: **Fields to be added: "Contact 4" information - Name, Title, Phone, Email, Disposition. A "Status" field should be added on the header that will align to Active, Deleted, Archived PE Info field to be added ** Fields to be corrected: "Ownership" should be select list (Private, Public, PE Support, Unknown). Notes field to be split to allow for multiple notes to be entered. Each will track the date, the note, an indicator if follow-up is needed, and...

I'm looking for a Python expert who can create a basic dashboard for analyzing user engagement data. The dashboard should be able to display some analysis of the data and the results of various models. Key requirements: - The project must be completed within 6 hours from now. - The dashboard should include visualizations in the form of bar charts, line graphs, and pie charts. - The freelancer should be capable of creating a user-friendly interface. Ideal skills and experience: - Proficiency in dash ,Python - Experience in creating dashboards. - Ability to deliver quality work under tight deadlines.

...source code, AI's, Software, and API's that will be needed to build what I need. You must get approval or verify it is allowed to be used in my software construction and use for profit for my business and that I own the copyrights to all work it creates for my business. Create a platform that replaces actors in live-action footage with CG characters. The system should automate body motion capture, facial animation, and scene integration using open-source or one-time purchase software (no subscriptions). All source code programs and AI's and software programs used to build my software must allow my software to be used for profit and for my business. Key Requirements: 1. Motion Capture from Video: Track actor body mo...

...editor** built using **PySide6 (Qt for Python)**. It already includes the following: 1. **Core Components**: - **NgvScene**: Manages nodes, edges, and the undo/redo stack. - **NgvView**: Handles rendering and user interactions (e.g., zooming). - **NgvControls**: UI for adding rectangular and elliptical nodes. - **Nodes**: Rectangular (`NgvRectNode`) and elliptical (`NgvEllipseNode`) nodes with input/output ports. - **Edges**: Lines connecting nodes (`NgvEdge`). - **Undo/Redo**: Implemented via commands (`NgvAddNodeCommand`, `NgvAddEdgeCommand`, `NgvMoveNodeCommand`). 2. **Basic Unit Tests**: - Tests for node/edge creation, movement, and undo/redo are already implemented in ``. - Coverage includes basic scenarios ...

We use Skyvern OSS project and I need an experienced Playwright developer to update my browser automation tool. Need to add support for the following: - Inserting session cookies manually or via API calls - Able to debug automation instructions not working The primary purpose of this tool is for web scraping. Ideal candidates should have a strong background in Playwright, API integration, and web scraping. Please share your relevant experience when bidding.

I'm ...team as a part-time Technical Interviewer. In this role, you’ll conduct interviews, assess technical skills, and provide valuable insights into candidates’ programming abilities. Key Responsibilities: - Primarily assessing technical skills of candidates. - Conducting interviews and providing insights on candidates. Ideal Skills: - Deep knowledge and advanced understanding of JavaScript, Typescript, Python, React, Angular, Node, React Native and Restful API. - Some experience with AWS and Azure Cloud - Passion for technology and recruitment. - Exceptional technical evaluation skills. - Clear and effective communication abilities. If you're tech-savvy, have a knack for recruitment, and can evalua...

I'm looking to scrape 10000 websites in Australia to analyze their payment gateways. The primary purpose of this task is to conduct competitor analysis. I also need to gather the contact information from these sites. The ideal freelancer for this task should be skilled in web scraping, data analysis, and have a keen eye for detail. Requirements: - Extensive experience in web scraping - Proven track record in data analysis - Ability to gather and organize contact information - Skills in competitor analysis - Attention to detail The scraped data should be provided in Excel format. Please ensure that the payment gateway details are included as part of the contact information. Please organize the scraped data in an Excel file format that you de...