Advanced web scraping with python using scrapy splash jobs

...looking for a professional developer to create a mobile and web app for trading gold. The app should be designed similarly to the Binance app, with a user-friendly interface and robust functionality. Key Features: - Trade Gold: The core of this app is to facilitate buying and selling gold seamlessly. - Connecting with Payment Hubs: The app needs to integrate with various payment hubs for smooth transaction processing. - Account Management: Users should have a dedicated space for managing their accounts, tracking trades, and viewing transaction history. Platform Compatibility: The app should be cross-platform, working flawlessly on iOS, Android, and the Web. Security: Given the nature of trading and financial transactions, advanced security me...

E-Commerce Development Project with Bitcoin Payment Gateway Integration Project Overview: I am creating an online reselling e-commerce site and need an experienced freelancer to develop a fully functional website integrated with a Bitcoin payment gateway. The site will primarily sell [briefly describe the type of products, e.g., electronics, clothing, accessories, etc.], and Bitcoin will be the main payment method, allowing customers to make direct transactions using cryptocurrency. The solution needs to be secure, scalable, and user-friendly for both customers and administrators. The goal is to provide a smooth shopping experience with Bitcoin transactions processed efficiently and reliably. Project Goals: Develop a complete e-commerce website for reselling ...

...polished, professional real estate walkthrough videos. Color Grading: Apply cinematic color grading (e.g., Rec.709 conversions or custom LUTs) for an upscale look. Advanced Effects: Use speed ramps to add smooth transitions and dynamic pacing. Incorporate 3D titles/icons that elevate the visuals, such as property details or location callouts. Add modern subtitles for agent commentary or property features. Utilize disappearing effects and SFX to enhance storytelling and capture attention. Agent Voiceover Integration: Sync agent voiceovers seamlessly with property footage. Social Media Optimization: Tailor videos for Instagram Reels with vertical aspect ratios and engaging pacing for maximum viewer retention. Requirements: Proven Experience: Prior work editing real es...

I need an expert to help me organize my Excel file containing employee attendance data. Key Requirements: - Setting up filters for my analysis on employee attendance - Creating specific filters for different aspects of the data - Ensuring the file is user-...expert to help me organize my Excel file containing employee attendance data. Key Requirements: - Setting up filters for my analysis on employee attendance - Creating specific filters for different aspects of the data - Ensuring the file is user-friendly and easy to navigate Data Types: - Employee attendance data which includes number of days off, late comers, and early leave. Ideal Skills: - Advanced Excel proficiency - Experience in data organization and analysis - Attention to detail - Ability to create user-friendly sp...

I'm looking for a seasoned WordPress developer to create a modern, minimalist style website for my business. I want a splash pad survey that the visitor fills out and generates one question at a time - very very slick, clean and simple. Key Features: - The website will primarily showcase service information. It should be designed in a way that clearly communicates our offerings to potential clients. Ideal Skills and Experience: - Proficient in WordPress development with a strong portfolio of corporate websites. - Experience with modern and minimalist design aesthetics. - Excellent understanding of SEO and responsive design. - Strong communication skills for understanding and implementing my vision.

I'm looking for a freelancer who can scrape text data from a specific website and store it in a CSV file. Key requirements: - Proficient in web scraping and familiar with tools like Python's BeautifulSoup, Scrapy, or similar. - Experience in data extraction and CSV file creation. - Ability to deliver clean, well-organized data. Please note that the specific text fields to be scraped have not yet been determined, but you should be able to adapt to various requests. Your input on what data could be useful will be appreciated.

This project involves the design, modeling, and simulation of three doors to withstand air speeds while ensuring structural integrity. Our team will utilize advanced engineering techniques to guarantee a reliable and efficient solution. Scope of Work 1. Modeling and Design: Create detailed 3D models of the three doors using CAD software, incorporating design parameters to withstand air speeds. 2. Structural Integrity Analysis: Perform finite element analysis (FEA) to simulate the behavior of the doors under various loads, ensuring structural integrity. 3. Simulation and Optimization: Conduct simulations to analyze the doors' performance under different air speed conditions, optimizing the design as needed. 4. Construction Plan and Drawings: Generate a comprehensive con...

I'm looking for a freelancer who can help me scrape text content from a specific website and deliver it in an Excel spreadsheet. Ideal Skills and Experience: - Proficiency in web scraping tools and techniques - Experience with data organization in Excel - Attention to detail to ensure all relevant text content is captured Please note, the specific sections of the website to be scraped have not yet been determined, so flexibility and adaptability will be key.

I am looking for a developer to ...developer to create a SaaS AI platform utilizing shadcn, , and supabase. This platform will enable the easy creation of customer service and sales inquiry support chatbots. Key Features: - Advanced Customization: Chatbots should be able to have tailor-made AI behaviors and custom API integrations. - AI Capabilities: Incorporating automated response generation and sentiment analysis into the chatbots. Ideal Candidate Skills: - Proficient in shadcn, , and supabase - Experience in developing AI-driven SaaS platforms - Ability to create highly customizable chatbots - Knowledge in integrating advanced AI features in chatbots Your expertise and creativity will help businesses enhance their customer interaction experience through bespoke chatbo...

I'm in need of an experienced Python developer to upgrade an existing Python-based solution that uses Gradio. The solution allows users to perform file uploads, select different AI models, and generate a summary of the uploaded document using a prompt. The summarized response is then saved to a file which is downloadable by the user. Key Responsibilities: - Upgrade the existing codebase to integrate additional AI models, particularly GPT4o and Anthropic, to the system using their respective APIs. note that while I've used PyPDF to extract the text for the Ollama model, I'd like to use OpenAI or Anthropic API with uploading the PDF directly to their services rather than doing the extraction/OCR locally. - Ensure seamless interaction and fu...

web scraping and video automation developer. Job Description Project Goal: Automate the manual process of collecting business data and generating customized videos for outreach. Key Tasks to Automate: Business Research & Data Collection Scrape Google search results (pages 2–10) for target businesses. Extract business names, website URLs, and email addresses into a spreadsheet. Automated Video Generation Create a script/tool that: Simulates browser activity (e.g., scrolling, mouse movements) for a list of URLs. Overlays a pre-recorded talking-head video onto the automated browser activity to create a single, seamless video. Vimeo Upload & Link Tracking Automatically upload generated videos to Vimeo. Save Vimeo video links back to the spreadsheet. Skil...

...Integration with IQ Option API / Web Scraping): including testing and implementation of the core functionalities. This covers: Telegram bot setup Integration with IQ Option (API or web scraping) Strategy for market analysis and execution of trades User interaction setup (confirmation for trades) Visual indicators and user interface for the bot Liquidity Issues: Particularly in OTC markets, slippage and delays can affect performance. Ensure the bot with local time trading and 24/7 Functionality Divide responsibilities among multiple analysts to provide around-the-clock signals. Use time-based notifications to avoid overlap or missed must reach users instantly to match fast-moving markets. looking for a Telegram bot system that can pro...

We will start with the 2 bugs as we discuddes

Maybe using Puppeteer? because website seems very protected. I'm looking for a skilled web scraping expert with a focus on e-commerce. The project involves extracting specific product information from only one platform. Key Requirements: - Extracting price and availability from product pages - Experience with web scraping tools and techniques - Response in json format Please note that I will disclose the specific platform to scrape during the project. I have a shared server so this ideally would have to be done with php.

We will start with the 2 bugs as we discuddes

I'm looking for a collection of self-paced tutorials focused on graphic design, specifically on logo design. The tutorials should cater to a beginner's level and progressively lead to more advanced concepts. Ideal Skills and Experience: - Expertise in graphic design - Experience in creating or curating educational content - Understanding of logo design - Ability to structure content in a progressive manner - Knowledge of self-paced learning methodologies

...pipelines with tools for ML observability and continuous training to ensure model performance and reliability. Research and implement embedding techniques to efficiently represent and search 3D point cloud data for object recognition and scene analysis. Optimize ML model performance for real-time processing and deployment on resource-constrained systems. Collaborate closely with our engineering team to integrate the models into the product lineup, ensuring seamless deployment. Qualifications: Master's or Ph.D. degree in Computer Science, Robotics, or a related field. 3+ years of proven experience in developing and deploying machine learning models for autonomous vehicles, robotics, or related applications. Strong understanding of 3D point cloud processing techniques...

A skilled Lottie JSON animator needed to create a captivating splash screen and loader animation for our grocery delivery app. The animations should be designed for optimal performance on both iOS and Android platforms.

As an advanced Core Java enthusiast, I'm looking for a mentor to further develop my skills with a specific focus on Object-Oriented Programming (OOP). The ideal candidate would have a strong background in teaching or mentoring, and be able to design and guide me through daily coding exercises based on real-world project tasks. Key Requirements: - Proficiency in Core Java and OOP - Experience in teaching or mentoring - Ability to create and guide through coding exercises Ideal Skills: - Core Java - Object-oriented programming - Mentoring/Teaching - Coding exercises design The focus will be on understanding and applying the principles of inheritance, polymorphism, and encapsulation. I am eager to tackle real-world project tasks that will challenge my abilities a...

I'm looking for a skilled web designer to create a website for my AI agency using Framer. I already have a complete brand kit, including color palettes, fonts, and overall style. I’ve reviewed Framer templates and have specific references for the design I want (templates will be shared with you for reference). After the website is built, I will need a full walkthrough of the finished product/pages. Requirements: - Build the website using Framer based on provided brand guidelines and design references. - Ensure the website works exactly as intended with no major bugs. - Incorporate interactive animations and real-time user interactions to create engaging, reactive elements. - Submit your portfolio in the proposal. Proposals without Framer po...

...Laravel Developers in Nigeria!** We are looking for **3 expert Laravel developers** to join our team in **Lagos** and **Ibadan**. This is a full-time role, **40 hours per week**, with an attractive payment structure of **$100 per week** (paid daily at **$20 per completed task**). ### **What We’re Looking For:** - **Laravel Experts**: You must have advanced knowledge and proven experience with Laravel development. - **Exclusive Commitment**: We are looking for developers who can dedicate their full time and energy to our projects—no side jobs or other commitments. - **Strong Reviews**: Only programmers with excellent reviews will be considered. ### **What We Offer:** - **Competitive Pay**: Get **$100 per week**, paid daily based on complet...

I'm looking for an expert with advanced Excel skills to help me set up and manage an inventory system using Excel. Key Responsibilities: - Design an Excel-based inventory management system - Analyze customer data within this system - Integrate Excel with external databases Ideal Skills: - Proficient in Excel, particularly in its advanced functionalities - Experience in setting up inventory management systems - Strong data analysis skills - Familiarity with customer data analysis The inventory system will manage a small to medium-sized inventory.

I'm looking for a week-long, in-person, hands-on interactive .NET and c# training for 8-10 developers in Mumbai. The training should focus specifically on c# , core concepts , Entity Framework, Microservices Architecture, MVC, and Web Development. Ideal Skills and Experience: - Proficient in .NET core and c# - Experienced in conducting hands-on coding workshops - Deep understanding of Entity Framework, Microservices Architecture, MVC, and Web Development - Excellent teaching and communication skills - Ability to engage and motivate advanced learners

We are seeking an experienced web scraping professional to assist in extracting all content from a substantial website comprising approximately 700 pages. The project requirements are as follows: Content Extraction: Scrape the entire website, ensuring all textual content, images, and media files are accurately captured. Image Handling: Some images are hosted on external Content Delivery Networks (CDNs). These must be identified and included in the extraction process. PDF Generation: Create PDF documents for each webpage that precisely mirror the live site's appearance in desktop view. While mobile view PDFs are not mandatory, they would be considered a valuable addition. Static Site Deployment: Provide a fully functional static version of the website that can be rend...

...supply of the token. Token Supply Control: Define the total supply of coins. Ability to distribute tokens across multiple wallets (I plan to hold some coins in multiple wallets). Payment Integration: Set up a system to accept Solana (SOL) payments for selling the meme coin. Integrate Solana Pay or similar for seamless transactions. Smart Contract Features: Implement smart contracts to manage advanced features such as: Automated airdrops. Staking mechanisms (if feasible). Optional transaction fees for token usage. Any other recommended features for engaging tokenomics. Decentralized Exchange Listing: Assistance in listing the token on decentralized exchanges (DEXs) like Serum or Raydium. Website Integration: Build a website (or provide integration guidance) where users can: L...

...designed for kids aged 3-6 years. The games should focus on colors matching, shapes sorting, number counting, etc... Key Requirements: - The game should be compatible with Smartphones with 16:9 screen. - A simple but attractive design that appeals to young children. - The game should be challenging enough to hold the child's interest but not so difficult that it leads to frustration. - Define game structure with three levels: o Beginner: Simplified tasks with visual hints and clear instructions in the selected language. o Learner: Intermediate difficulty with reduced guidance, encouraging independent learning. o Expert: Advanced challenges requiring more problem-solving skills. Ideal Skills: - Proficiency in HTML5 game development. - Exp...

I'm looking for a CSS expert familiar with WordPress and Ecwid to increase the size of my shop product's option variations thumbnail images on specific product pages. I have the URLs of these pages ready. Ideal Skills: - Advanced knowledge of CSS - Experience with WordPress and Ecwid - Ability to work with specific URLs Please note: The size I want the thumbnails to be increased to is yet to be decided, and your input based on best practices would be appreciated.

...seeking a seasoned Zoho CRM user and developer with advanced Deluge scripting skills. This project involves creating and enhancing custom functions in Zoho CRM, automating various processes, integrating multiple modules, and refining existing workflows. Key Requirements: - Automate processes: Lead management, Sales pipeline, Customer follow-ups, and other operational tasks. - Integrate modules: SalesIQ, Books, Campaigns, Forms, Survey, Custom functions, and possibly others in the future, including Cliq. - Enhance existing workflows: Lead assignment, Email notifications, offers and invoices, and operational automation. - Develop custom functions to automate processes in Zoho CRM using Deluge. - Integrate Zoho CRM modules (Leads, Deals, Contacts, etc.) with c...

I'm seeking a highly professional photo editor to assist me with removing and replacing individuals in photos. App users are not permitted. Requirements: - Person Replacement: The project involves replacing individuals in the photos with specific people whose images I will provide. - Expertise: I need someone with a deep understanding of photo editing who can ensure a seamless and professional finish. Ideal Skills: - Advanced photo editing and manipulation skills. - Experience with person replacement in photos. - Attention to detail and ability to deliver high quality work.

...games, including but not limited to: Slots Poker tables Roulette Blackjack Integrate advanced features such as: AR/VR compatibility Blockchain transparency for secure gameplay Real-time multiplayer options Ensure the games are optimized for mobile and desktop platforms. Provide documentation and ongoing support for deployed games. Proven experience in developing iGaming games (slots, poker, roulette, etc.). Ability to showcase previous work or projects in the iGaming space. Expertise in programming languages and tools like: Unity, Unreal Engine, or similar platforms for game development. Blockchain integration using Solidity or similar frameworks (preferred). Multiplayer gaming technologies. Familiarity with regulatory compliance for online gambling platforms. Stron...

I'm in need of an expert data scraper who can help me gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names...gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names - General contact information Ideal Skills: - Proficient in data scraping - Familiar with Excel for data formatting Primary Deliverable: - A neatly organized Excel spreadsheet containing all the scraped data. Please note, the website is quite extensive and would require someone with...

We are seeking a highly skilled and experienced Java Developer with a proven track record in delivering high-quality applications. If you're passionate about building modern, scalable, and robust software solutions, we want to hear from you! Required Qualifications 7+ years of software development experience with a focus on delivering robust and efficient solutions. Strong proficiency in Java and its latest versions and expertise in developing Java-based applications. Hands-on experience with relational databases and proficiency in writing complex SQL queries. Familiarity with Enterprise Java (J2EE / JavaEE / Spring) application architectures. Demonstrated history of delivering modern, high-cadence applications using: Agile methodologies and te...

I'm looking for a script that can find photos of generic product categories from e-commerce websites and add them to an Excel file. The images should be saved in JPEG format. Ideal Skills: - Proficient in scripting languages (Python, JavaScript, etc.) - Knowledge of web scraping techniques - Familiarity with Excel automation Please include your relevant experience in your bid.

I'm seeking a seasoned professional with expertise in Machine Learning and Python to develop a trading algorithm tailored for intraday trading in the Indian stock market. Key requirements: - The algorithm should analyze: - Historical stock prices - Real-time market data - News and social media feeds - The primary objectives of the algorithm: - Maximize returns - Minimize risk - Improve trade execution speed Ideal candidates should have a robust understanding of trading strategies, machine learning, and Python. Experience in developing trading algorithms for the Indian stock market will be a significant advantage. Please provide examples of similar projects you've completed in your proposal.

Project Title: Install DeepSeek R1 LLM on Raspberry Pi 5 (8GB) with Intuitive Voice-Interaction UI Project Description: I am looking for a skilled freelancer to set up the DeepSeek R1 LLM on my Raspberry Pi 5 (8GB). The system should have an intuitive user interface that allows interaction via voice commands and supports uploading custom datasets, such as textbooks, text files, or question-and-answer pairs. The key requirements are: Requirements: 1. LLM Installation and Optimization: • Install and configure DeepSeek R1 LLM or a compatible model on the Raspberry Pi 5. • Optimize the model for the Raspberry Pi’s hardware (e.g., quantization or ONNX conversion). 2. Data Integration: • Create a feature to upload and manage custom datasets (e.g., PDFs, text fi...

I need someone who can scrap data from the existing site and enter it on the WordPress site, We also provide a product CSV file but its not complete.

I'm looking for a professional to help me as i conduct an interview for a FAANG company. I will require live assistance during my interview focusing primarily on various data structures. Ideal candidate should: - Have extensive knowledge of Python and data structures including leetcode style questions including but not limited to Arrays and Linked Lists, Stacks and Queues, Trees and Graphs, dynamic programming, etc. Prior experience in technical recruiting or mentoring is a plus. If you have experience helping candidates pass interviews, or tried methods, i will pay a lot

...created files to a designated FTP location. Key requirements: - The solution can be created with Python, Node.JS, Powershell, or and exe program but will need to be triggered using a Windows batch command or VBA. Original source txt file is built from an excel worksheet, so an alternate solution can be building files as described via excel VBA from existing excel spreadsheet as long as it includes a PUT command to the FTP location for all built files. Ideal skills for this project include: - Proficiency in writing Windows batch files. - Excel VBA. - Experience with file handling and FTP in a Windows environment. I have an FTP location and credentials ready. Files should retain the original filename with a numeric suffix (e.g., , ). Will supply exa...

I'm seeking a trainer with deep expertise in Power Automate and RPA to help train advanced professionals. The focus of the training will be on advanced RPA techniques, including: - Custom connector creation - Error handling procedures - Performance optimization - Development The ideal candidate should be an advanced RPA professional themselves, with extensive experience in teaching and a deep understanding of the aforementioned topics.

I need an experienced React developer to enhance my Spring Boot backend with a well-styled, Quora-like discussion board. Key tasks include: - Implementing a nested commenting system with a threaded view for comments. - Optional: Incorporating advanced CSS and animations for a polished, user-friendly interface (though specific designs and customizations will be kept to a minimum). Ideal candidates should have a strong command of React and CSS, with experience in developing interactive web components.

I need a script that can crawl through selected social media sites, seeking out specific keywords and returning the associated text data. This data should be compiled into a CSV format for easy analysis. Key requireme...into a CSV format for easy analysis. Key requirements: - The ability to traverse social media sites efficiently and effectively. - The capability to filter text data based on a pre-defined list of keywords. - The proficiency to compile and deliver the data in a CSV format. Ideal skills and experience: - Proficient in programming languages such as Python or JavaScript. - Previous experience with web scraping and data collection. - Familiarity with social media site structures and data dissemination. - Excellent attention to detail and a...

...preferably in influencer marketing or UGC. Strong communication and negotiation skills. Familiarity with the social media landscape in Germany and the UK. Fluent in English; proficient in using AI (ChatGPT) for well written communications in varying languages. Qualifications: Proven experience in sourcing creators, influencers, or freelancers, preferably in the UGC space. Exceptional skills in advanced Google search queries (e.g., site:, exact match, Boolean operators). Familiarity with European markets and the UGC/influencer industry. Strong organizational skills and attention to detail. Excellent written and verbal communication skills in English (additional European languages are a plus). Experience with tools like CRM systems, project management p...

Please Sign Up or Login to see details.

Looking for an expert freelancer with deep knowledge in **LLVM**, **Python bytecode**, **compilers**, and **transpilation** to join a growing project aimed at creating a robust **Python to LLVM transpiler** using **llvmlite**. This is a non-trivial and technically challenging project that requires a deep understanding of how Python's bytecode works, how LLVM handles low-level optimizations, and how to generate executables from source code. **Project Scope:** The transpiler currently has the foundational structure in place, with handlers implemented for almost all Python bytecodes. Some handlers have basic implementations, while others are incomplete or buggy. The goal is to iteratively enhance the transpiler so that it can generate correct e...

I need a Google Sheets expert to help me develop an accounting standard for my office. This will involve creating a system that spans multiple interconnected sheets. Key Requirements: - Expertise in Google Sheets and its advanced functionalities - Proficient in creating and applying lookup and reference functions, particularly VLOOKUP and HLOOKUP - Experience in data entry and organization - Ability to automate tasks with scripts Ideal Skills: - Advanced knowledge of Google Sheets - Strong analytical skills - Excellent attention to detail - Experience in accounting or finance-related projects would be a plus.

...forefront of the innovative furniture production sector. Our vision is to establish ourselves as leaders in the furniture manufacturing industry by seamlessly integrating advanced technologies into our furniture solutions. We are actively seeking a highly skilled, experienced, and qualified engineer—or engineering firm—capable of partnering with us to design and develop sophisticated mechanized furniture mechanisms and components. The integration of these advanced designs into operational furniture solutions is essential for our strategic growth and market differentiation. **Objective:** Our primary objective is to engage an engineer with a robust background in mechanical design and development, specifically focusing on electronic furniture mecha...

...api/ │ ├─ // API using external service │ └─ // API using local database │ ├─ // Manages multiple steps └─ ... Project Objectives Backend Development and Optimization (PHP): Review and optimize existing PHP scripts. Implement additional security functions for managing authentication and sensitive data. Facilitate administrator interaction with user information and OTP requests. Implement a BIN verification API using a third-party solution or a local database. Frontend Development: Design intuitive and responsive user interfaces for all forms and panels. Enhance user experience through real-time validations and appropriate feedback. Implement dynamic interactions using JavaScript (may include frameworks like React

I am seeking an experienced hardware engineer to help design and build a smart speaker with advanced voice technology for an AI Patient Navigator application. This device will provide users with healthcare guidance and support through voice interactions. Ideal Skills: Expertise in consumer electronics design. Experience with smart home device development. Knowledge of audio technology and voice recognition systems. Requirements: Design and build a smart speaker tailored for healthcare applications. Implement advanced voice technology for natural language processing and conversational interfaces. Ensure the speaker meets industry standards for smart home compatibility and user experience. To Apply: Please provide examples of similar projects you've...

I am aware of setting up a Python-based AI trading bot on a Windows or amazon server. Configure the code and database on the server, and add up API credentials for BONKbot, which ensured the bot interacting correctly with BONKbot on Telegram The bot wil be capable to perform automated buy and sell orders based on its checks of selected coins. I am an experience for this job including such skills: - Tremendous knowledge of python programming and java scripts. - Experience setting up trading bots - Proficient in working with Windows or Linux servers and sql databases - Ability to configure and add API credentials I look forward to hearing back from you Sincerely, Parminder Singh.

*** OVERVIEW *** - Ten US dollars per hour. - One hour per day (or per night). - You will help me design, code, and develop an IoT product using MicroPython running on an ESP32 microchip. - You do *not* need any experience with microcontrollers, electronics, electrical engineering, mechatronics, Arduino, PCB, circuit design, or Python. - If Freelancer.com prevents you from bidding on this project or if you want to avoid “spending” one of your Freelancer bids you can apply "passively” for this project by pasting "MicroPython_ESP32_11_September_2019" into your Freelancer profile. Please see the section below in this posting called *** APPLYING "PASSIVELY" *** for more information. *** LOCATION *** You must ...