Web crawling and scraping using pythonemplois

We will start with the 2 bugs as we discuddes

Maybe using Puppeteer? because website seems very protected. I'm looking for a skilled web scraping expert with a focus on e-commerce. The project involves extracting specific product information from only one platform. Key Requirements: - Extracting price and availability from product pages - Experience with web scraping tools and techniques - Response in json format Please note that I will disclose the specific platform to scrape during the project. I have a shared server so this ideally would have to be done with php.

We will start with the 2 bugs as we discuddes

...seeking highly skilled and experienced Machine Learning engineers to join our team and revolutionize how autonomous vehicles perceive the world. You will play a critical role in developing cutting-edge algorithms and ML models to automate data annotation and processing, enabling the creation of robust and reliable perception systems for autonomous vehicles. Your expertise in 3D point cloud processing and multi-sensor fusion will be essential in building high-performance models that can accurately understand complex driving environments. Responsibilities: Design, develop, and implement ML algorithms for automated annotation and classification of LiDAR, radar, and camera data for autonomous driving applications. Process a...

I'm looking for a skilled web designer to create a website for my AI agency using Framer. I already have a complete brand kit, including color palettes, fonts, and overall style. I’ve reviewed Framer templates and have specific references for the design I want (templates will be shared with you for reference). After the website is built, I will need a full walkthrough of the finished product/pages. Requirements: - Build the website using Framer based on provided brand guidelines and design references. - Ensure the website works exactly as intended with no major bugs. - Incorporate interactive animations and real-time user interactions to create engaging, reactive elements. - Submit your portfolio in the proposal. Proposals wit...

We are seeking an experienced web scraping professional to assist in extracting all content from a substantial website comprising approximately 700 pages. The project requirements are as follows: Content Extraction: Scrape the entire website, ensuring all textual content, images, and media files are accurately captured. Image Handling: Some images are hosted on external Content Delivery Networks (CDNs). These must be identified and included in the extraction process. PDF Generation: Create PDF documents for each webpage that precisely mirror the live site's appearance in desktop view. While mobile view PDFs are not mandatory, they would be considered a valuable addition. Static Site Deployment: Provide a fully functional static version of the website th...

I'm in need of an expert data scraper who can help me gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names...gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names - General contact information Ideal Skills: - Proficient in data scraping - Familiar with Excel for data formatting Primary Deliverable: - A neatly organized Excel spreadsheet containing all the scraped data. Please note, the website is quite extensive and would require someone with exper...

We are seeking a highly skilled and experienced Java Developer with a proven track record in delivering high-quality applications. If you're passionate about building modern, scalable, and robust software solutions, we want to hear from you! Required Qualifications 7+ years of software development experience with a focus on delivering robust and efficient solutions. Strong proficiency in Java and its latest versions and expertise in developing Java-based applications. Hands-on experience with relational databases and proficiency in writing complex SQL queries. Familiarity with Enterprise Java (J2EE / JavaEE / Spring) application architectures. Demonstrated history of delivering modern, high-cadence applications using: Agile method...

I'm looking for a script that can find photos of generic product categories from e-commerce websites and add them to an Excel file. The images should be saved in JPEG format. Ideal Skills: - Proficient in scripting languages (Python, JavaScript, etc.) - Knowledge of web scraping techniques - Familiarity with Excel automation Please include your relevant experience in your bid.

I'm seeking a seasoned professional with expertise in Machine Learning and Python to develop a trading algorithm tailored for intraday trading in the Indian stock market. Key requirements: - The algorithm should analyze: - Historical stock prices - Real-time market data - News and social media feeds - The primary objectives of the algorithm: - Maximize returns - Minimize risk - Improve trade execution speed Ideal candidates should have a robust understanding of trading strategies, machine learning, and Python. Experience in developing trading algorithms for the Indian stock market will be a significant advantage. Please provide examples of similar projects you've completed in your proposal.

...should have an intuitive user interface that allows interaction via voice commands and supports uploading custom datasets, such as textbooks, text files, or question-and-answer pairs. The key requirements are: Requirements: 1. LLM Installation and Optimization: • Install and configure DeepSeek R1 LLM or a compatible model on the Raspberry Pi 5. • Optimize the model for the Raspberry Pi’s hardware (e.g., quantization or ONNX conversion). 2. Data Integration: • Create a feature to upload and manage custom datasets (e.g., PDFs, text files, or structured Q&A). • Enable the model to respond accurately to user questions based on the uploaded data. 3. Voice Interaction: • Integrate voice input for asking questions ...

I need someone who can scrap data from the existing site and enter it on the WordPress site, We also provide a product CSV file but its not complete.

I'm looking for a professional to help me as i conduct an interview for a FAANG company. I will require live assistance during my interview focusing primarily on various data structures. Ideal candidate should: - Have extensive knowledge of Python and data structures including leetcode style questions including but not limited to Arrays and Linked Lists, Stacks and Queues, Trees and Graphs, dynamic programming, etc. Prior experience in technical recruiting or mentoring is a plus. If you have experience helping candidates pass interviews, or tried methods, i will pay a lot

...requirements: - The solution can be created with Python, Node.JS, Powershell, or and exe program but will need to be triggered using a Windows batch command or VBA. Original source txt file is built from an excel worksheet, so an alternate solution can be building files as described via excel VBA from existing excel spreadsheet as long as it includes a PUT command to the FTP location for all built files. Ideal skills for this project include: - Proficiency in writing Windows batch files. - Excel VBA. - Experience with file handling and FTP in a Windows environment. I have an FTP location and credentials ready. Files should retain the original filename with a numeric suffix (e.g., , ). Will supply example of full source file and/or original ex...

I need a script that can crawl through selected socia...need a script that can crawl through selected social media sites, seeking out specific keywords and returning the associated text data. This data should be compiled into a CSV format for easy analysis. Key requirements: - The ability to traverse social media sites efficiently and effectively. - The capability to filter text data based on a pre-defined list of keywords. - The proficiency to compile and deliver the data in a CSV format. Ideal skills and experience: - Proficient in programming languages such as Python or JavaScript. - Previous experience with web scraping and data collection. - Familiarity with social media site structures and data dissemination. - Excelle...

...**LLVM**, **Python bytecode**, **compilers**, and **transpilation** to join a growing project aimed at creating a robust **Python to LLVM transpiler** using **llvmlite**. This is a non-trivial and technically challenging project that requires a deep understanding of how Python's bytecode works, how LLVM handles low-level optimizations, and how to generate executables from source code. **Project Scope:** The transpiler currently has the foundational structure in place, with handlers implemented for almost all Python bytecodes. Some handlers have basic implementations, while others are incomplete or buggy. The goal is to iteratively enhance the transpiler so that it can generate correct executables from Python snippets, ensuri...

I am aware of setting up a Python-based AI trading bot on a Windows or amazon server. Configure the code and database on the server, and add up API credentials for BONKbot, which ensured the bot interacting correctly with BONKbot on Telegram The bot wil be capable to perform automated buy and sell orders based on its checks of selected coins. I am an experience for this job including such skills: - Tremendous knowledge of python programming and java scripts. - Experience setting up trading bots - Proficient in working with Windows or Linux servers and sql databases - Ability to configure and add API credentials I look forward to hearing back from you Sincerely, Parminder Singh.

...day (or per night). - You will help me design, code, and develop an IoT product using MicroPython running on an ESP32 microchip. - You do *not* need any experience with microcontrollers, electronics, electrical engineering, mechatronics, Arduino, PCB, circuit design, or Python. - If Freelancer.com prevents you from bidding on this project or if you want to avoid “spending” one of your Freelancer bids you can apply "passively” for this project by pasting "MicroPython_ESP32_11_September_2019" into your Freelancer profile. Please see the section below in this posting called *** APPLYING "PASSIVELY" *** for more information. *** LOCATION *** You must live the Western Balkans in one of the following countries... ...

I'm in need of a professional Python programmer to create an algorithm for trading multiple cryptocurrencies on Binance. The algorithm will leverage the ADX (Average Directional Index) technical indicator, executing trades at every crossover. Key Requirements: - Proficient in Python with experience in developing trading algorithms. - Understands the use of the ADX technical indicator. - Able to program the algorithm to trade on multiple cryptocurrencies. Risk Management: - The algorithm will inherently manage risk based on ADX crossovers. - Experience in incorporating risk management strategies into trading algorithms is a plus. Frequency: - The algorithm should check for ADX crossovers every minute. - Previous experience in creating high-frequency trading algorithms ...

I need assistance with my custom-built software on Windows that currently supports loading up to 6 cameras via RTSP links. The goal is to modify the software so it can handle any number of cameras without any lag in the video streams. Ideal skills and experience for the job: - Proficiency in Python: The custom software is written in Python, so deep knowledge and experience with this programming language is essential. - Experience with RTSP and camera integration: Prior work with Real Time Streaming Protocol (RTSP) and camera systems would be a significant advantage. - Software optimization skills: The ability to enhance the software for seamless, lag-free streaming is critical. - Windows environment familiarity: Understanding of the Windows opera...

Please consider that this is a fixed-budget project 24USD Summary: I want you to integrate a Python script with LangSmith via API and then deploy it to a account Details: We are creating an AI Agent in Python, and now we want to integrate it with LangSmith via API. After that, we need to deploy this agent to a account so we can test and use LangSmith in our project. 1 - Integrate the Python script with LangSmith via API. 2 - Deploy this script to render.com. ONLY ACCEPT IF you really have experience with Python, OpenAI API, API integrations. P.S.: You don’t need to be an expert in LangSmith—just ensure the connection works and deploy it online () and that is it.

I have 3 years of sensor data from my equipment, specifically temperature and vibration readings, that I need help with. There are around 18 parameters in total, and all relevant parameters are to be considered not just the above goal of the project is to predict equipment failure and estimate the time until the next failure. Key tasks include: - Data Preparation: This involves cleaning the data and splitting it for training and testing purposes. - Model Development: You'll need to select appropriate algorithms, train and evaluate them, and tune the models for optimal performance. - Deployment: The final model needs to be deployed on AWS SageMaker. The data is currently housed in an SQL database and you would be required to ac...

...day (or per night). - You will help me design, code, and develop an IoT product using MicroPython running on an ESP32 microchip. - You do *not* need any experience with microcontrollers, electronics, electrical engineering, mechatronics, Arduino, PCB, circuit design, or Python. - If Freelancer.com prevents you from bidding on this project or if you want to avoid “spending” one of your Freelancer bids you can apply "passively” for this project by pasting "MicroPython_ESP32_11_September_2019" into your Freelancer profile. Please see the section below in this posting called *** APPLYING "PASSIVELY" *** for more information. *** LOCATION *** You must live the Western Balkans in one of the following countries... ...

We are seeking an experienced Python/Django developer to assist our junior developer with resolving specific tasks. This is a short-term engagement, requiring 1-2 hours per day over a period of 10 days. Required Skills: Frontend: jQuery, CSS Backend: Python, Django Responsibilities: Provide guidance and solutions to our junior developer. Assist in debugging and optimizing the existing codebase. Help resolve specific frontend and backend development tasks. This is a great opportunity for someone who enjoys mentoring and can work collaboratively to solve problems efficiently. If you are interested, please share your portfolio, experience, and availability. Looking forward to hearing from you!

I'm trying to create a fighting robot that's 6 inches tall. I want it to be able to move and fight like the boxing robots "Noisy Boy", "Atom" and "Midas" from the movie Real Steel but at a 6 inch scale. I want the motions to be smooth and realistic. I didn't know where to start so I asked ChatGPT for help. Is it possible to make something like this if you followed the instructions? I know nothing about robotics or coding but want this vision to come to life. If you could build it for me or help me build it that would be great thank you! 1. Concept Mechanics: Up to ~12–15 Degrees of Freedom (DoF) for realistic human-like movement: Arms: Shoulder (2–3 DoF), elbow (1–2 DoF), wrist (1 DoF). Legs: Hip (2–...

I'm looking for a proficient web developer who can create a web scraper for a real estate website, specifically propertyfinder.com. The scraper should be able to extract comprehensive property details, agent information, size, pictures, bedrooms, and location. Key Requirements: - Extract data from - Save the scraped data in Excel/CSV format. Ideal Skills: - Proficient in web scraping - Familiarity with real estate websites - Excellent data handling skills. Please include examples of similar projects you've completed in your proposal.

...all data related to students, their enrollment, and academic progress. - Fee Management: A critical module for tracking and managing school fees and other financial transactions. - Attendance Tracking: This will monitor student attendance and participation. Technology Stack: The ideal candidate should have strong experience and proficiency with Python/Django, as this will be the primary technology used for this project. User Roles: The system needs to support various user roles including: - Students: They should be able to access their information and track their progress. - Teachers: They will need access to student data, attendance, and the ability to input grades. - Administrators: They will manage the overall system, inputtin...

I'm in need of a reliable tool that can meticulously scour the web for email addresses of approximately 7,000 businesses. The businesses will predominantly be located in one state, but will span across different cities. Key Requirements: - The tool must prioritize high accuracy over speed. The searches should be thorough and precise, ensuring that the email addresses collected are valid and relevant. - The results of each search should be exported in a CSV file (.csv). The file should contain the business name, address, and corresponding email address. Ideal Skills and Experience: - Proficiency in web scraping and data mining - Experience with CSV file handling and data organization - Ability to design a tool that balan...

I'm seeking a skilled Python developer with solid experience in Kafka, Avro schema, and MySQL. The key focus of this project is to assist in producing Kafka messages through the following tasks: - Fetching records from a MySQL database, specifically transactional data. - Handling mixed data types (both text and binary) from the database. - Utilizing a pre-defined Avro schema for data validation before publishing to a Kafka topic. Ideal candidates will have: - Proficiency in Python and its libraries for Kafka and MySQL. - Proven experience working with mixed data types. - A comprehensive understanding of Avro schema and its application in Kafka. Your primary goal in this project will be data validation and publishing. Please n...

Fix the Python code and output as per my requirement

...technologies to provide seamless solutions for managing operations, automating compliance, and facilitating secure exchanges. We are looking for skilled developers to create the core infrastructure and develop essential features to simplify global business transactions. We're looking for skilled developers to help us create the core infrastructure of the platform and develop key features to make international trade easier, faster, and more secure. Key Features: AI-Powered Tools: Machine learning algorithms to optimize logistics, predict market trends, and provide actionable data-driven insights for importers and exporters. Blockchain-Based Payments: Secure, transparent, and decentralized payment solutions using blockchain t...

I need a Python-based data scraper that can automatically scrape text data from vehicle dealership websites, such as: I would need the scraper to do multiple different URLs with the final of each CSV uploaded to my server. This scraper would need to run once a day. For example, the multiple URLs would need to be defined by the Porsche Centre search field which gives different IDs for each location, eg: I have a list of what data needs to get scraped and can help with the before/after code of where this information sites. I would also need to include some standard information to go in each CSV also. The project

...where admins can send messages, and users (Clients/Support) can view them. User Roles: -> Clients -> Support -> Admin Screens (Client): Splash Screen (app name/logo for a few seconds). Onboarding Screen (app features overview). Login & Registration (email/password). Account Verification (OTP on email). Home/Group Chat (view admin-created project groups). Chat Screen (communicate with group admin). Notification Screen (real-time push notifications). Settings (edit profile, change password, notifications, logout/delete account). Support & Tickets Section. Subscription Screen (Stripe integration). Screens (Support): Similar to Clients, but includes one-to-one chats with clients and view-only access to admin groups. Screens (Admin): Manage user accounts ...

I need a seasoned AI developer with a strong background in Natural Language Processing (NLP) to help me with a sentiment analysis project. Key R...strong background in Natural Language Processing (NLP) to help me with a sentiment analysis project. Key Responsibilities: - Develop an NLP model capable of sentiment analysis for our website. - Ensure the model is accurate and efficient. Ideal Skills: - Extensive experience in NLP, particularly in sentiment analysis. - Proven track record of developing AI models for website deployment. - Strong programming skills, preferably in Python and JavaScript. Your expertise will be crucial in interpreting user sentiment and helping us enhance our website's interactivity and user experience. Please provide ex...

1. Connecting mine domain from GoDaddy to my hosting ( directAdmin) 2. Installing POS system script that I bought on Codecanyon to my hosting. The name of the script that I bought is OffPos by DoorSoft.

I need a skilled Machine Learning expert to help train a Convolutional Neural Network (CNN) model for classifying breast cancer images using the CBIS-DDSM, MIAS, and INbreast datasets. The goal is to achieve high performance metrics, specifically aiming for: - Accuracy: Up to 95% - Recall/Sensitivity: Up to 95% - Specificity: Up to 95% - Precision - F1 Score The project needs to be implemented in Python, using GPU Tensorflow on a native Windows local environment. Familiarity with the Tensorflow installation process for Windows is a plus. Please note that data preparation has not yet started, so experience in data pre-processing and augmentation is essential.

We have been using the Boulevard "BLVD" as our booking & payment platform to track all our customer & booking data. We collect data from BLVD using Daily Recurring Report Exports through their API created by GraphQL, the report exports are in CSV format and the data is automatically updated. All the report CSV's are exported from BLVD using fileURLs, and the fileURL provides an automatic download of the CSV with all the related data, there's 12 fileURLs/CSVs each updated with the related data. Each fileUrl is a static, signed url that will reference the latest version of the export, an example of the fileURL link: /api/2020-01/report_exports/(id).csv?signature=(signature) I'm making this listing because I can't seem...

I am seeking a skilled developer located in India to create a web scraper for me. The goal of this project is to collect open interest data from the National Stock Exchange of India (NSE). Key Responsibilities: - Design and implement a robust data scraping tool capable of extracting open interest data from the NSE. - Ensure the tool can operate continuously and efficiently, collecting data for analysis on a daily basis. Ideal Skills: - Proficiency in data scraping and web development. - Experience with financial market data, particularly from the stock market. - Familiarity with the National Stock Exchange of India and its data. I would prefer a freelancer who has prior experience in developing similar tools and can demonstr...

I am seeking an expert in data scraping to collect text content from a specific websites (aprox 25 of them). The purpose of this project is to aggregate the scraped content for further use. Each of the target sites have contact section with offices listed. We need to aggregate working hours for these. Ideal Skills: - Proficient in data scraping tools and techniques - Experience with content aggregation projects - Strong attention to detail -python Please bid only if you have proven experience in scraping website text content and are able to deliver clean, structured data fast! Message for more details.

I'm looking for a proactive Django developer t...e-commerce website. The enhancements include implementing a multi-product 'Add to Cart' feature and a tracking-focused user dashboard. Key Responsibilities: - Implement 'Add to Cart' function allowing for multiple product selections - Develop a user-friendly dashboard with a focus on user activity tracking - Ensure seamless integration of new features with existing website setup Ideal Skills: - Proficient in Django, Python, API, CSS, JavaScript - Prior experience with e-commerce website development - Strong attention to detail and web development best practices The dashboard should track purchase history and provide insights on user behaviour. If you are passionate about develo...

I have Manufacturer Name Model of device I need price mapping (do web crawling )

...automation and analysis system for a Blackjack card game using computer vision and game strategy analysis. The system should be able to: Monitor the screen in real-time to track the game. Keep track of the history of dealt cards. Restart the game when needed. Analyze the dealer's hand. Provide strategy recommendations for the next move based on my hand. Requirements: Screen Capture and Monitoring: The system must continuously monitor the screen in real-time to capture and detect gameplay. Utilize screen capture tools (OpenCV or similar) to detect cards, the dealer’s hand, and the player's hand during the game. Card History Tracking: The system should keep a log of all the ca...

...roadmap and guidance documents for implementing an online e-voting system. The project involves a few key components: **Design & Prototyping:** - Utilize a design tool to create user-friendly and intuitive interfaces. Although the choice of design tool (Figma, Adobe XD, Sketch) is open, the ability to create advanced functionality is crucial. - Develop user flows and wireframes to visualize the voting process. **System Architecture:** - Design the system architecture, including the selection of appropriate frontend technologies (HTML, CSS, JavaScript, React, Angular, Vue.js), a suitable backend programming language and framework (Python/Django, Node.js/Express, Ruby on Rails), and a secure database system (MySQL, PostgreSQL, MongoDB). - C...

I need a professional Excel expert with strong skills in data analysis, macros, and VBA. You will be required to create a sophisticated Excel spreadsheet for analyzing trading data. Key Responsibilities: - Create an advanced Excel spreadsheet for trading data analysis - Incorporate real-time data updates into the spreadsheet - Implement advanced charting and visualization techniques - Design automated trading signals within the spreadsheet Ideal Skills: - Excel: Advanced spreadsheet creation and optimization - Macros and VBA: Proven experience in automating tasks and enhancing workflow - Python: Familiarity with Python for data analysis and Excel integration would be a big plus. Payment: - The designer will be compensated on a dai...

...involves using CBIS-DDSM, MIAS, and INbreast datasets to train the model and evaluating its performance based on specific metrics. Key Responsibilities: - Build a CNN model for breast cancer detection. - Use normalization, data augmentation, and resizing as preprocessing steps. - Implement the model using VGG16 and ResNet50 architectures. - Split the data 80% for training and 20% for testing. Performance Goals: - Achieve an accuracy of up to 95%. - Achieve a recall/sensitivity of up to 95%. - Achieve a specificity of up to 95%. - Evaluate precision and F1 Score. Technical Requirements: - Implement the project using Python with GPU Tensorflow on a native-Windows local environment lab. - Familiarity with Tensorflow i...

We have been using the Boulevard "BLVD" as our booking & payment platform to track all our customer & booking data. We collect data from BLVD using Daily Recurring Report Exports through their API created by GraphQL, the report exports are in CSV format and the data is automatically updated. All the report CSV's are exported from BLVD using fileURLs, and the fileURL provides an automatic download of the CSV with all the related data, there's 12 fileURLs/CSVs each updated with the related data. Each fileUrl is a static, signed url that will reference the latest version of the export, an example of the fileURL link: /api/2020-01/report_exports/(id).csv?signature=(signature) I'm making this listing because I can't see...

I'm in need of a skilled data scraper to extract information from a variety of sources. Website Scraping: - Text content - Links Social Media Scraping: - Data from Facebook - Data from Twitter - Data from Instagram The ideal freelancer for this project should have extensive experience in web scraping and social media data extraction. Proficiency in programming languages such as Python is a plus.

We need a developer to work on: -Nextjs front end using ReactJS -Python and Typescript based backend -Mobile Application Development It's important that the work is high quality and well documented.

We need a developer to work on: -Nextjs front end using ReactJS -Python and Typescript based backend -Mobile Application Development It's important that the work is high quality and well documented.

We are looking for a Data Scientist with expertise in AI and Machine Learning to develop a time series forecasting model. The project involves analyzing historical sales data using AWS and Snowflake. The ideal candidate should have strong skills in Python, machine learning, and predictive analytics. This is a short task estimated to take 1-2 hours. Please apply with your relevant experience and availability!