Web crawling and scraping using pythonpráce

...skilled full-stack web developer to create a modern, minimalist e-commerce site. The project involves both frontend and backend development. Key requirements include: - Building a user-friendly shopping cart - Implementing an efficient product search and filtering system The ideal candidate should have a strong portfolio of e-commerce sites, with demonstrated experience in both frontend and backend development. A keen understanding of modern, minimalist design principles is crucial. Proficiency in integrating responsive design and ensuring cross-browser compatibility will be highly valued. Your technical skills should ideally include: - HTML, CSS, JavaScript for frontend development - Python, Ruby, PHP or similar for backend development - ...

...for an experienced email marketer, proficient with mailchimp and data scraping, to help me develop relationships with service providers for eCommerce. The ultimate goal of this campaign is vendor development in Canada, focusing on all types of service providers in Canada, including but not limited to IT, marketing, and consulting services. Key Responsibilities: - Design and execute an email marketing campaign aimed at engaging potential service provider vendors. - Utilize data scraping techniques to identify and reach out to relevant service providers. - Employ Mailchimp for effective campaign management and monitoring. Ideal Skills: - Extensive experience in email marketing, particularly with Mailchimp. - Proficient in data scraping...

...Amazon repricing and competitor analytics app. The ideal candidate will be responsible for backend and frontend tasks, integrating APIs, enhancing scraping pipelines, and preparing the app for beta testing. This role requires expertise in Node.js, Python, React, and MongoDB, as well as excellent communication and teamwork skills. You will play a critical role in completing the app, ensuring a smooth user experience, and implementing efficient backend processes. The app will eventually integrate AI and deep learning algorithms for advanced repricing. Responsibilities: Backend Development (Node.js, Python): • Collaborate on API development and integration to connect the backend with the frontend. •...

...to revise my current database for better functionality and to assist with web data population. This project has two key phases: 1) Revision of the existing MS Access Database - Correcting Form view fields: There are some fields in form view that are incorrect or incomplete, such as: **Fields to be added: "Contact 4" information - Name, Title, Phone, Email, Disposition. A "Status" field should be added on the header that will align to Active, Deleted, Archived PE Info field to be added ** Fields to be corrected: "Ownership" should be select list (Private, Public, PE Support, Unknown). Notes field to be split to allow for multiple notes to be entered. Each will track the date, the note, an indicator if follow-up is needed, and...

I'm looking for a Python expert who can create a basic dashboard for analyzing user engagement data. The dashboard should be able to display some analysis of the data and the results of various models. Key requirements: - The project must be completed within 6 hours from now. - The dashboard should include visualizations in the form of bar charts, line graphs, and pie charts. - The freelancer should be capable of creating a user-friendly interface. Ideal skills and experience: - Proficiency in dash ,Python - Experience in creating dashboards. - Ability to deliver quality work under tight deadlines.

...source code, AI's, Software, and API's that will be needed to build what I need. You must get approval or verify it is allowed to be used in my software construction and use for profit for my business and that I own the copyrights to all work it creates for my business. Create a platform that replaces actors in live-action footage with CG characters. The system should automate body motion capture, facial animation, and scene integration using open-source or one-time purchase software (no subscriptions). All source code programs and AI's and software programs used to build my software must allow my software to be used for profit and for my business. Key Requirements: 1. Motion Capture from Video: Track actor body mo...

...editor** built using **PySide6 (Qt for Python)**. It already includes the following: 1. **Core Components**: - **NgvScene**: Manages nodes, edges, and the undo/redo stack. - **NgvView**: Handles rendering and user interactions (e.g., zooming). - **NgvControls**: UI for adding rectangular and elliptical nodes. - **Nodes**: Rectangular (`NgvRectNode`) and elliptical (`NgvEllipseNode`) nodes with input/output ports. - **Edges**: Lines connecting nodes (`NgvEdge`). - **Undo/Redo**: Implemented via commands (`NgvAddNodeCommand`, `NgvAddEdgeCommand`, `NgvMoveNodeCommand`). 2. **Basic Unit Tests**: - Tests for node/edge creation, movement, and undo/redo are already implemented in ``. - Coverage includes basic scenarios ...

We use Skyvern OSS project and I need an experienced Playwright developer to update my browser automation tool. Need to add support for the following: - Inserting session cookies manually or via API calls - Able to debug automation instructions not working The primary purpose of this tool is for web scraping. Ideal candidates should have a strong background in Playwright, API integration, and web scraping. Please share your relevant experience when bidding.

I'm ...team as a part-time Technical Interviewer. In this role, you’ll conduct interviews, assess technical skills, and provide valuable insights into candidates’ programming abilities. Key Responsibilities: - Primarily assessing technical skills of candidates. - Conducting interviews and providing insights on candidates. Ideal Skills: - Deep knowledge and advanced understanding of JavaScript, Typescript, Python, React, Angular, Node, React Native and Restful API. - Some experience with AWS and Azure Cloud - Passion for technology and recruitment. - Exceptional technical evaluation skills. - Clear and effective communication abilities. If you're tech-savvy, have a knack for recruitment, and can evalua...

I'm looking to scrape 10000 websites in Australia to analyze their payment gateways. The primary purpose of this task is to conduct competitor analysis. I also need to gather the contact information from these sites. The ideal freelancer for this task should be skilled in web scraping, data analysis, and have a keen eye for detail. Requirements: - Extensive experience in web scraping - Proven track record in data analysis - Ability to gather and organize contact information - Skills in competitor analysis - Attention to detail The scraped data should be provided in Excel format. Please ensure that the payment gateway details are included as part of the contact information. Please organize the scraped data in an Excel file format that you de...

2D drawings, 3D models and renders for 3 chairs.

...agency. - Proficiency in Flask and Python. - A quick learner who can adapt to new challenges with ease. - Prior experience in LLM training is a big plus. - A strong commitment to putting in more than 40 hours per week. - Ability to work efficiently, meet deadlines, and collaborate closely with the team. - Freelancers: This must be your sole ongoing project if you join us. - Willingness to attend Zoom meetings (camera on) for video conferences and team discussions. - Fluent in English, with excellent communication skills. What We Offer: - Bonuses and rewards to recognize your hard work. - Exciting perks, like airline tickets for team retreats. - The opportunity to be part of a fast-growing startup. - Long-term, consistent work with opportunities for g...

I need a professional who can convert my scanned PDF bank statement into an Excel. I have been trying to do it via a python script and while I can extract the text the data is not being pasted into the correct columns. My script is not accounting for the fact not all columns are populated. The primary purpose for this conversion is data extraction for analysis. The data should be organized in the Excel file by column from the statement. Specifically, I need the following columns from the bank statement to be included: Date, details, Debit €, Credit €, Balance €. Ideal Skills: - Proficient in data extraction and analysis - Experienced in Excel script creation - Detail-oriented to ensure accurate data conversion

...cryptocurrency trading bot that already has basic trading functionality, risk management, and automated alerts. Most of the core features are implemented, but we need an experienced developer to fine-tune the code, debug any issues, and add a few advanced features to improve performance and usability. Tasks: • Debug and finalize existing trading features. • Add advanced trading algorithms (e.g., token filtering by sentiment or volume analysis). • Incorporate basic portfolio management capabilities. • Prepare and deploy the bot on a cloud platform (e.g., AWS, DigitalOcean). Requirements: • Proven experience in cryptocurrency trading bot development. • Proficiency in Python, API integration, and librari...

I'm seeking an experienced programmer with expertise in C/C++ and Python, particularly C++ for code generation using a language model (LLM). This project centers on generating code that optimizes performance within a High-Performance Computing (HPC) environment. Key Responsibilities: - Utilize LLM to generate C++ code. - Focus on creating algorithms that enhance performance. - Implement the generated code in an HPC setting. Ideal Skills: - Proficiency in C/C++ and Python. - Experience with High-Performance Computing. - Familiarity with code generation using language models (LLM). - Strong understanding of performance optimization techniques.

We are seeking a skilled Python programmer to enhance our existing Tkinter GUI application. The app currently merges PDF files into a single PDF file and adds page numbers to each file. We aim to enhance it by enabling the conversion of images, Word documents, and PowerPoint presentations into PDF files and then merging them all into a single PDF file with page numbers added. More details are provided in the attachments. The current source code will be sent once you are accepted for the job. **Relevant Skills:** - Python programming - Tkinter GUI development

I'm looking for a professional who can extract phone numbers from Google Maps for various types of businesses. This includes: - Restaurants - Retail Stores - Service Providers (like Plumbers, Electricians, Hairdressers, etc.) The ext...a professional who can extract phone numbers from Google Maps for various types of businesses. This includes: - Restaurants - Retail Stores - Service Providers (like Plumbers, Electricians, Hairdressers, etc.) The extraction needs to be comprehensive and cover all these categories on a national scale. Ideally, you should have: - Proficiency in data mining and web scraping techniques. - A keen attention to detail. - Familiarity with Google Maps as a data source. Your work will significantly aid my outreach efforts, so t...

...Company with expertise in digital marketing and web development to manage various projects like. Logo & Graphic Design Website Design & Revamp Content Writing & Website Maintenance Software Development E-Commerce Solutions Digital Marketing Services Google Ads (PPC) Social Media Marketing (SMM) Search Engine Optimization (SEO) One of the key projects is an Odoo e-commerce website that requires: Optimization for User Experience (UX): Fine-tuning the website for optimal usability and navigation to ensure a seamless shopping experience. Affiliate Product Integration: Aliexpress Amazon Ebay Etsy Temu Importing affiliate products into the Odoo database. This will involve either API management skills or the ability to develop and utilize data ...

More details: Is this project for business or personal use? Maybe an enterprise in the future but as a test as of now What information should successful freelancers include in their application? Experience How soon do you need your project completed? Within a month

I need assistance in migrating my Flask project from PythonAnywhere to Heroku. The project is utilizing a MySQL database and has dependencies listed in a file. Key requirements: - Proficient in Python and Flask - Experience with Heroku and PythonAnywhere - Familiarity with MySQL - Ability to work with to install dependencies Please ensure you're capable of handling this migration smoothly and efficiently. Thank you!

I'm looking for an expert in web scraping to help me gather specific data from 99acres. Your task will focus on extracting: - Buyer contact details from 99acres. The ideal candidate should have: - Proven experience in web scraping, particularly from real estate platforms. - Understanding of data privacy regulations and ethical considerations in data scraping. - Proficiency in using scraping tools and software. Please note that the volume of data may be significant, so efficiency and speed are essential.

I'm in need of a script that can scrape price and stock information from Amazon on a scheduled basis. - Data Export: The script must export the scraped data into a CSV, Json format. - Frequency: It should check for updates on an hourly basis. - CAPTCHA Handling: The script must be capable of handling Amazon's CAPTCHA challenges, as this is a requirement. The script should be able to monitor approximately 5,000 to 10,000 items in one go. Ideal candidates will have experience with web scraping, particularly with Amazon, and be familiar with handling CAPTCHA challenges. Proficiency in developing scripts that can run on a scheduled basis is essential.

I'm looking for a seasoned Python developer with strong experience in gRPC and Protobuf, to help me develop a new Tenant Service, along with a User Management Service. Key Requirements: - Proficient in Python and gRPC, with a track record of developing similar services. - Familiarity with Protobuf for defining APIs. - Knowledge of containerization using Docker. - Deep understanding of microservices architecture and event-driven systems. - Proven experience in integrating and connecting multiple microservices. - Basic knowledge of database integration and state management. - Strong debugging and troubleshooting skills. The ideal candidate will not only help in the development but also ensure seamless integration of these...

I'm looking for a skilled web scraper who can extract contact information from various e-commerce websites. Ideal Skills and Experience: - Proficiency in web scraping tools and software. - Familiarity with e-commerce platforms. - Data validation and cleaning skills. Please note, while I have not specified the exact types of contact information I'm looking for, a comprehensive understanding of e-commerce websites and their potential data points is crucial for this project.

I am looking for a data scraping expert to help me scrape some websites. Please note that the specifics of the project, such as the format of the scraped data, the types of websites to scrape, and the frequency of the scraping, have not yet been finalized. Ideal Skills and Experience: - Proficient in data scraping tools and techniques - Experience with data analysis and processing - Familiarity with different data formats (CSV, JSON, XML) - Ability to work flexibly and adapt to project changes

I'm in need of a proficient Python Developer to build an AI-Based Chatbot for customer support on our website. Key Project Requirements: - Development of an AI-based Chatbot - Implementation for customer support use - Integration with our website Ideal skills and experience: - Advanced knowledge in Python - Proven experience in AI application development, particularly Chatbots - Web integration skills - Customer support oriented perspective

We have an existing website scraping script that needs to be repaired. This script scrapes the following e-commerce website: The script scrapes the products to create 2 files: 1. Product List Table - a summary table for each product present, including brand name, product name. Each product has a unique product URL 2. Product Details Table - a detailed table recording price, product descriptions, ingredients list etc. For a product (i.e. a unique product URL), it may have multiple entries in this table if it has different variants (e.g. 500ML, 1000ML, red colour, blue colour) The current issues with the script is that in the Product Details Table: 1. The descriptions, full ingredients, price, variant name fields have no data captured 2. Rating is not captured 3.

We have an existing website scraping script that needs to be repaired. This script scrapes the following e-commerce website: The script scrapes the products to create 2 files: 1. Product List Table - a summary table for each product present, including brand name, product name. Each product has a unique product URL 2. Product Details Table - a detailed table recording price, product descriptions, ingredients list etc. For a product (i.e. a unique product URL), it may have multiple entries in this table if it has different variants (e.g. 500ML, 1000ML, red colour, blue colour) The current issues with the script is that in the Product Details Table: 1. The descriptions, full ingredients, price, variant name fields have no data captured 2. Rating is not captured 3.

...skilled freelancer to help extract and organize product data, including: Part Numbers Manufacturer Information Pricing (New, Used, and Repair Service options) Project Scope: Extract product details from provided sources (websites, PDFs, or spreadsheets). Organize data into a structured format for easy import into our database (e.g., Excel or CSV). Ensure accuracy and completeness of all extracted information. Requirements: Proven experience in data extraction and handling. Proficiency in tools like Python, Excel, or other scraping software. Attention to detail to ensure error-free data entry. Ability to manage large datasets efficiently. Deliverables: Completed dataset with part numbers, manufacturer names, and pricing details for ...

I'm seeking an in-person, advanced Python trainer. The training will need to cover: - Data structures and algorithms - Machine learning and AI - Web development with Django/Flask The ideal candidate will have extensive Python knowledge, with proven experience in these specific areas. Excellent teaching skills are a must, as is the ability to tailor sessions to my learning pace and style.

I'm an advanced Python user looking to speed up my learning for task automation. I need to work on simulation automation using python. Mostly for complex electronic systems automation. I have 3 months to become master in python. I can spend 5 hours in weekend and 5 hours in week days to achieve this. Im a beginner. Looking for a dedicated experienced teacher. No casuals please. Ideal Skills: - Advanced Python knowledge - Experience in teaching Python - Expertise in task automation - Familiarity with data entry automation

...venue booking app, which is already live on Android. The app is built using React Native, and the iOS version should maintain feature parity with the Android version. The app includes the following key integrations and functionalities: OTPLESS authentication for seamless login. Google Maps API for venue location and navigation. Google Login for user authentication. Razorpay for secure payment processing. firebase for notifications Key Requirements: Proficiency in React Native development for iOS. Experience integrating third-party APIs (OTPLESS, Google Maps, Razorpay, etc.). Familiarity with iOS-specific deployment processes, including TestFlight and App Store submissions. Ability to ensure app performance, usability, and responsiveness. Prev...

I am looking for Promnt expert who is experienced with OpenAI to optimize promnts in my I need is to: - get only relevant responses limited to my topic - minimalize potential halucinations - try force LLM to answer that it does not know answer if it is unsure - try to force LLM at the end to encourag...potential halucinations - try force LLM to answer that it does not know answer if it is unsure - try to force LLM at the end to encourage to use our services. - force LLM conduct only on-topic dialog. If LLM considers off-topic it should return "That topic is not related to ...." - allow LLM to ask extra question if user provides something unclear. Use negative promnts if required. DO NOT modify python code. Before bid please analyse code! Code is passworded - ask priv I...

Hi Nelson, We just noticed that you posted a project for "Python-Django Based College Portal Development" (https://www.freelancer.com/projects/python/Python-Django-Based-College-Portal/details) We’d love to take on your project! At Code Frenzy, our team operates under one roof, offering unmatched accountability, quality, and transparency. We ensure your project is completed on deadline and with precision by our professionals. Let’s connect and discuss

Intelligent Voice Transcriber Project Description: Develop a simple Windows application that converts voice into text with high accuracy using the OpenAI API (GPT) and Whisper. The software will feature a user-friendly interface where transcribed text is displayed in real-time. Users can easily copy or transfer this text to tools like Gmail, Notepad, Messenger, and other applications. Key Features: Real-Time Voice-to-Text Transcription: Use OpenAI’s Whisper for voice recognition and conversion to text. High accuracy in multiple languages, including English and French. Contextual and Automatic Text Correction: Integration with OpenAI GPT to correct grammatical errors and enhance text clarity. User-Friendly Interface: Compact interf...

use the excel sent to data scrape web designers in all US zip codes

Descripción: Hola, Somos una empresa en proceso de desarrollo de una plataforma de marketplace innovadora, y estamos en busca de un desarrollador web experimentado para liderar su construcción. Buscamos a alguien con experiencia en marketplaces complejos tipo Amazon o Treatwell, que pueda integrar funcionalidades clave como: - Gestión de usuarios y proveedores - Pagos integrados y seguridad en transacciones - Paneles de administración avanzados - Optimización UX/UI para una experiencia fluida y eficiente - Escalabilidad y rendimiento garantizados** Estamos interesados en profesionales con sólidos conocimientos en React, Node.js, Laravel, Python o tecnologías similares, con enfoque en arquitectura escalable, segurid...

...am looking for a skilled Python developer with experience in creating highly accurate virtual try-on technology for changing clothes. Key requirements and expectations: - The developer will be responsible for creating this technology that can work on a yet-to-be-determined platform (Website, Mobile App, or Desktop Application). - The technology should support various types of garments. While the specific categories (Casual wear, Formal wear, Athletic wear) have not been finalized, flexibility and adaptability in design are key. - The virtual try-on technology should be able to work with different types of input images. This could involve user-uploaded photos, predefined models, or a live camera feed. Ideal candidates should have: - Extensive experience in Pyth...

...assist with a project involving a Raspberry Pi and load cells (HX711 module) to create an automated watering system for plants. Scope of the Project: 1. Hardware: • 4-corner load cells with 3 wires (white, red, and black) connected to the HX711 module. • Relays to control watering valves. • Raspberry Pi as the controller. 2. Software Requirements: • Calibrate the load cells to ensure accurate weight readings. • Store calibration data persistently (not lost on system restart). • Measure the weight of pots and trigger relays to water plants when the weight is below a set threshold. • A simple and modular Python script for managing the load cell data and watering logic. • Include debugging tools ...

I am looking for assistance in automating the process of generating metrics to minimize human interaction and increase efficiency. My current approach involves the use of Excel Query, but I am open to exploring other Excel-based solutions if they offer better automation.

I am looking for assistance in automating the process of generating metrics to minimize human interaction and increase efficiency. My current approach involves the use of Excel Query, but I am open to exploring other Excel-based solutions if they offer better automation.

I'm seeking a professional with expertise in data scraping, specifically with Sales Navigator, to gather leads from Sales Navigator for Indistry professional in Media Productions. You have to be based in Bangladesh to take this job. You have to have a paid Sales Navigator in order to take this job. This is a long term job. Ideal Skills and Experience: - Proven experience with data scraping and Sales Navigator. - Prior work within or knowledge of the media production industry will be highly regarded. - Excellent understanding of lead generation for email marketing purposes.

...for a device testing application. Use wxWidgets to create this GUI in Python. It will run in windows 11, but it might later be ported to linux. The screen size will be 1920 × 1200 pixel. Create a WELL DOCUMENTED Python script which shows the GUI. The layout of the GUI can be modified A BIT, but all information should still be there. The undermost line is just visible in the system's debug mode and is not visible normally. There is no need to animate the GUI / update the text. This code will be written later. The colors, the font, the buttons etc. can be changed. It should look professional with a good contrast. Before awarding you as the winner, I want to check the script. Therefore, make an entry which shows your GUI and I will contact you via...

Python scripts for implementation of ML model for Water potability prediction

I'm looking for a comprehensive AI solution that assists in employee recommendations based on skills and job descriptions, pulling data from LinkedIn. This system should support both Arabic and English. Key Requirements: - Implementation of a supervised learning model. - Utilization of various LinkedIn data points: Skills and endorsements, Job history and descriptions, and Educational background. - Complete solution developed in Python. Ideal Skills: - Proficiency in Python and machine learning. - Experience with LinkedIn data extraction and analysis. - Ability to develop bilingual (Arabic and English) software solutions. - Familiarity with supervised learning models.

...possible and requires manual technical intervention. Project Details: 1 Migration from Version 17 to 18: - Adapt the existing customizations to ensure compatibility with version 18. - Identify and resolve compatibility issues with modules. 2 Error Resolution: - One custom modules is currently not installable after the migration and need to be updated to function correctly. - Handle missing or incompatible Python dependencies (e.g., the library). - Analyze and fix errors generated during the migration process. 3 Validation and Testing: - Ensure all functionalities, customizations, and modules work properly after the migration. - Perform unit and functional tests. 4 Environment: - Migration will be performed on the platform. -...

I need a small web scraping project to extract property listings from the site: ******************* The script should be able to scrape the following details from each property listing: - Property address - Price - Description The ideal freelancer for this project should have experience with Scrapy and web scraping in general. The code needs to be runnable by myself on a virtual server, which I can rent if necessary. It should be capable of running daily, without any captchas but with some tricks to bypass potential obstacles on the site. Please provide me with an estimation for this micro-project. Thank you.

K zobrazení podrobností se zaregistrujte nebo přihlaste.

...a skilled developer to create an automated intraday trading bot using the Angel One API for a client project under NDA. Key Responsibilities: - Integration of the bot with real-time data from the Angel One WebSocket API to monitor market movements and execute trades based on predetermined conditions. - Utilization of tools like Pandas and NumPy for data analysis and profit calculation in real-time. - Consideration of latency issues to ensure timely execution of trades. Ideal Candidate: - Prior experience with trading bots and related APIs is crucial. - Exceptional skills in Python, with a focus on data analysis libraries. - Understanding of various trading strategies and order types is beneficial. - Able to work under NDA and re...

...processing images, so a deep understanding and experience in handling image data is crucial. Key Responsibilities: - Develop an AI system capable of image classification and image segmentation. Ideal Skills: - Proficient in AI and machine learning, specifically in the domain of computer vision. - Hands-on experience with image processing and computer vision tasks. - Familiarity with developing AI for image classification and segmentation. - Proficient in using relevant programming languages and tools (Python, TensorFlow, etc.). - Develop, test, and maintain Python-based applications. - Collaborate with cross-functional teams to design and implement new features. - Optimize and refactor code to improve ...