Web scraping python scrapy jobs
I'm seeking a seasoned Senior Full Stack Deve...be on Front-end development of a critical application pivotal to our core business operations. - Your responsibilities will include back-end and front-end development, specifically the migration of a Node.js/Python codebase to .NET/C#. - You will implement industry best practices, ensuring our tech stack evolves in tandem with our business growth. - A key part of your role will be guaranteeing smooth integration with contemporary tools and architectures. Ideal candidates should possess: - Extensive experience with Front-end development - Proficiency in .NET/C# and Node.js/Python - Strong background in both back-end and front-end development - Ability to apply industry best practices - Skill in integrating with modern to...
I'm looking for a skilled Python developer with a strong background in data analysis, specifically in the realm of Sales and Marketing. Key responsibilities include: - Data Cleaning and Preprocessing: You will be tasked with cleaning our sales and marketing data to ensure its quality and reliability for analysis. - Generating Reports and Dashboards: You will create comprehensive reports and user-friendly dashboards to present the findings in an understandable way. - Predictive Analytics: Your expertise will be used to forecast future sales trends and customer behavior based on historical data. Ideal candidates should be proficient in Python and have experience working with sales and marketing data. Strong skills in data visualization and predictive modeling are highly...
I need a Telegram bot functioning as a simple accounting system for my small OTC crypto exchange. The bot should enable full functionality without an external interface. It should be capable of tracking transactions, handling various cryptocurrencies...- Custom date range reports along with daily, weekly, monthly, and yearly reports Ideal skills and experience: - Proficient in Telegram bot development - Understanding of basic accounting principles - Knowledge of cryptocurrencies and crypto exchanges - Experience in creating financial tracking software - Strong programming skills, particularly in languages suitable for bot development such as Python or Node.js Please note, I don't require a complicated accounting system—just a straightforward tool to help me track transa...
...application progress, payment history, etc. FAQ Page: Information about visa processes, documents, fees, etc. Contact Page: Address, phone number, email, and possibly a contact form. Terms & Conditions and Privacy Policy: Legal pages. Travel Resources/Blog: Articles and tips related to travel. Payment Page: For processing payments (e.g., for visas, bookings). c) Frontend Technologies HTML5/CSS3: Standard web design technologies for structure and styling. JavaScript (React.js, Vue.js, or Angular): To create dynamic and interactive user interfaces. CSS Frameworks: Bootstrap, TailwindCSS, etc., for faster layout and styling. Animations: Subtle animations using libraries like GSAP or CSS animations. Third-Party Integrations: Maps, payment systems (Stripe, PayPal), flight data AP...
...engagement purposes. Enable bulk commenting with different accounts for scalability. 4. Bump It Automate user engagement and visibility: Custom Bump It: Create bump actions to increase a coin or user's visibility on trading platforms. Allow users to set their username for personalized bump activities. Technical Stack and Requirements 1. Backend: Use a robust backend framework such as Node.js, Python (Flask/Django), or Go. Integrate Bundler for wallet management and multi-address generation. API support for blockchain operations (e.g., Etherscan, Solscan). 2. Frontend: Interactive UI using React.js, Angular, or Vue.js. Real-time trading dashboards for monitoring volume, wallet activities, and market analytics. 3. Blockchain Integration: Support for multiple bl...
Overview Seeking a highly experienced Full Stack Python Developer with DevOps expertise who excels in fast coding, high-performance deployments, and scalable solutions. The ideal candidate is proficient in backend and frontend development, automation, CI/CD pipelines, cloud infrastructure, and containerization. Job Description Develop, deploy, optimize scalable applications using Python, Django, or Flask. Design, implement CI/CD pipelines for automated deployments. Manage cloud infrastructure (AWS, GCP, Azure) using Terraform, Kubernetes. Ensure high availability, security, and performance of applications. Work with Docker, Kubernetes, Helm, Ansible, Jenkins, GitOps. Develop RESTful APIs, microservices, GraphQL. Write efficient, high-performance code with best practice...
My workload has increased tremendously and I need an intermediate Python developer to assist me with tasks related to data analysis and visualization and Django - Primary Focus: You will be primarily working on data analysis and visualization tasks. And i don't want high level data analysis only know the basic of data analysis - Skills Required: Proficiency in Django, MySQL, and common Python libraries such as Pandas, Matplotlib, NumPy, and Pillow is essential. This is not an expert-level position as I am an expert in Python and can provide guidance. I plan to hire two developers, so competitive pricing and quality work are crucial for selection.
More details: What is the main source of the data you want to scrape? API Which website do you need to scrape data from? E-commerce site Which specific data do you need to scrape from the e-commerce site? Product details, Pricing information
I need a Python script that can extract hotel names and their corresponding page links from various travel and hotel booking websites. The specific websites to target include: - Marriott - Booking - Agoda - - Ctrip - IHG - Hilton Ideal skills and experience for this project include: - Proficiency in Python, particularly in web scraping libraries such as BeautifulSoup or Scrapy, selenium. - Knowledge of data extraction techniques and tools. - Experience with manipulating and structuring data for easy interpretation and usage. Please note that the format for the extracted data has not been specified yet, so flexibility in your coding to allow for various output formats (CSV, JSON, Excel) would be beneficial. Additionally, while the primary focus is ...
I am looking for a professional who can build a custom search engine for various content creator profiles, sourced from multiple platforms beyond just YouTube, TikTok, and Instagram. Ideal Skills: - Web Development - Search Engine Development - Data Scraping Key Requirements: - Ability to source content creator profiles from various platforms - Experience in building custom search engines - Skills in data scraping
I need contact information of all principals email adresses and school email adresses non-English speaking high school and elementary schools across Europe, Asia, and South America. Also, I would like the various boards/district contact information also.
I am looking for a skilled Python developer to create a tool that automates the process of copying specific content from one Word document (Document A) to another (Document B). Key Features: - The tool should identify and copy tables and text paragraphs from Document A to Document B based on specific keywords or phrases. - The content needs to be inserted at specific locations within Document B, rather than appending to the end or overwriting existing content. Ideal Candidate: - Proficient in Python with experience in automating tasks with Word documents. - Familiar with the handling of tables and text paragraphs in Word documents using Python. - Able to implement content identification based on keywords or phrases. - Detail-oriented to ensure content is inserted at...
...: commentaires, likes, partages. Optimiser les codes pour garantir la rapidité et la fluidité, en particulier pour les vidéos. Assurer la sécurité des données des utilisateurs et la conformité (ex. RGPD). Collaborer avec l’équipe pour innover et ajuster les fonctionnalités. --- Compétences Requises : Solide expérience en intégration et personnalisation de codes (HTML, CSS, JavaScript, Python, PHP). Maîtrise des frameworks front-end : React.js, Vue.js ou Angular. Expertise back-end : Node.js, Django, Flask, ou Laravel. Gestion des bases de données : PostgreSQL, MySQL, ou MongoDB. Connaissance des outils de streaming vidéo : FFmpeg, AWS Media Services, ou &eacu...
I'm looking for a skilled programmer who can help me convert my Perl code into Python. Key Requirements: - Expertise in both Perl and Python programming languages - Strong understanding of data processing, specifically with text data - Ability to translate algorithms and logic from Perl to Python - Experience in ensuring that the Python code replicates the functionality of the Perl code accurately. The current Perl code is used for processing text data. The source of the data is varied and can come from multiple formats. Your job will be to ensure that the new Python code can handle this with the same efficiency and accuracy as the existing Perl code. A keen attention to detail and a methodical approach to coding will be key to the success of th...
Real-Time Data Retrieval: The Python system will connect to the Binomo API to retrieve real-time data for candles (candlesticks) and available assets, with special focus on Crypto IDX assets. This system will extract relevant data such as opening price, closing price, high, low, and volume for each candle, and store it in a .json file for later analysis. Data should be continuously collected and stored in real-time to feed other processes or analyses. The system must handle multiple assets simultaneously. Automated Trading Bot: The automated trading bot will execute trades based on external signals indicating whether the market is bullish or bearish. The bot will read these signals (e.g., Fecha....., alcista,....) and execute the corresponding trades on the Binomo platform. Additio...
...containing all certificates if batch processing is used. Technical Specifications: Must run on Windows 11 as a standalone EXE program (not web-based). Should have a simple graphical user interface (GUI) for entering names manually or uploading a .csv file. The final PDF design must preserve formatting and fonts from the template. To prevent unauthorized modifications, PDFs must be encrypted with editing restrictions (128-bit or 256-bit AES encryption). The program should efficiently process batch files with multiple names or allow single-entry mode for individual certificates. Preferred Skills: Experience developing Windows desktop applications using Python (PyQt/Tkinter), C#, or another Windows-compatible language. Experience with PDF generation and encryption libraries...
I'm looking for a proficient app developer to create a job tracking application for large format printers. The app should ideally be built in Python or Laravel. Key Features: - Job Tracking: The app should be able to track all print jobs on the printer. - Error Alerts: The app should notify the user in case of any issues during the printing process. - Usage Statistics: The app should provide data on printer usage over time. User Authentication: The app must have a secure login system for user authentication. Ideal Skills: - Proficiency in Python or Laravel - Experience in app development - Knowledge of printer job tracking systems - Understanding of error alert systems - Familiarity with user authentication systems.
I'm looking for a skilled Python developer who can help automate tasks with various measuring instruments based on time, magnetic field, and voltage. Key Responsibilities: - Joining development Python code for automating tasks with multimeters, oscilloscopes, spectrum analyzers, and magnetic field power supplies - Ensure the code is efficient, reliable, and easy to understand Ideal Skills: - Proficiency in Python programming - Experience with automation of measuring instruments - Understanding of data handling in real time as function of other instruments (magnetic fields, and voltage) - Familiarity with multimeters, oscilloscopes, and spectrum analyzers - Experience with web interfaces
I'm looking to develop a Telegram-based bot that can perform engagement raids on Twitter posts. The bot will need to interact with posts by liking, retweeting, sharing, and replying based on predefined rules. Key features: - Interact with Twitter posts by liking, retweeting, bookmarking and replying - Follow predefined rules for these interactions Ideal skills and experi...features: - Interact with Twitter posts by liking, retweeting, bookmarking and replying - Follow predefined rules for these interactions Ideal skills and experience: - Proficiency in bot development, particularly for Telegram - Understanding of Twitter's engagement mechanisms - Experience with setting up automated interaction protocols - Knowledge of programming languages suitable for this task (Python...
...container Requirements: - The resulting tables should be exactly the same as when you run the original import script. - The import time should be significantly reduced compared to the import time of the original import script using the same hardware requirements. - It should be easy to run everything: clearly document how to run it How you achieve this is completely up to you (Bash + SQL, pure SQL, Python, …)....
I'm looking for a freelancer who can scrape product data from various websites and compile it into a CSV file. Specific Requirements: - Website Selection: I have not specified whi...compile it into a CSV file. Specific Requirements: - Website Selection: I have not specified which websites to scrape yet. - Data Points: The freelancer should be proficient in extracting the following pieces of information: Price, Product Description, and Stock Availability. - Data Format: The final product should be a well-structured CSV file. Skills and Experience: - Proven experience in web scraping - Proficiency in data extraction and manipulation - Familiarity with major e-commerce platforms - Ability to deliver clean, well-structured data Please reach out if you have the necessary ...
I'm seeking a skilled Python developer to create an online script. This script needs to extract readable data from Twine 2 / Sugarcube saved files. (more info about Twine: ) Key Requirements: - The script should be able to decode saved games to read data. - The script should check if the given saved game is a valid Twine 2 saved game. - The primary data to be extracted includes basic information, mainly the Title. If the initial project is successful, there's potential for expansion to create an editor for saved games. You will be provided with sample Twine 2 saved files for testing. The extracted data needs to be outputted in plain text. Ideal Skills: - Proficiency in Python - Experience with data extraction and decoding Attached is an example saved game ...
Scope of Project: Multi-Tenant NFC-Based Authentication System Project Overview We are seeking a developer to build a secure, multi-tenant NFC-based authentication system. This platform will allow businesses to encode NFC tags onto products, enabling end users to scan the tags and verify authenticity via a web-based interface. Each business (tenant) will have its own dashboard, branded verification page, and isolated data storage. Key Requirements 1. Multi-Tenant Functionality • Ability to register multiple businesses/organizations as tenants. • Each tenant has its own admin dashboard to manage NFC-authenticated items. • Data isolation: Tenants can only access their own records. • Role-based access control (e.g., Tenant Admin, Staff Users). • Custom...
...application (source code and executable). - A script or program to automate the performance measurements (e.g., running the application multiple times and clearing the cache). A detailed report (PDF) with: - Methodology and tools used. - Quantitative results (graphs, tables, etc.). - Analysis and conclusions. Technologies Required: - Operating System: Ubuntu (VirtualBox). - Programming Languages: Python or C++. - Libraries/Tools: OpenCV, Linux commands (dd, fio, time, etc.). Performance Monitoring: Tools like vmstat or free to monitor memory usage and cache behaviour. Timeline: The project should be completed within 2-3 weeks. Skills Required: - Knowledge of Linux operating systems and OS-level caching mechanisms. - Familiarity with performance measurement tools and Linux co...
I'm looking for a talented developer to help me create an algorithmic trading system in Python. This will integrate with the Arham Share Pvt Ltd broker's API and have both front-end and back-end components. The front-end will include: - A dashboard which provides real-time updates and performance analysis - A trade history component The ideal candidate for this project should: - Have extensive experience with Python and algorithmic trading - Be familiar with the Arham Share Pvt Ltd broker's API - Have strong skills in front-end development, particularly in creating interactive, real-time dashboards I am located in Mumbai - Malad and would prefer to work with someone local for ease of communication and collaboration.
I'm urgently seeking a senior Python developer for a full-time position. The developer should have extensive experience with both Django and Flask frameworks. The main responsibility will be leading a team of developers. Key Responsibilities: - Building new features - Maintaining existing code Ideal Skills: - Expertise in Python, Django, Flask - Leadership and team management skills Budget: $400/month, negotiable based on experience.
I need a bot that scrapes text content from selected medtech and regulatory news websites and social media platforms. The bot should compile the scraped data into comprehensive reports in Word format. Ideal Skills: - Proficiency in web scraping tools and programming languages (Python, Java, etc.) - Experience with data analysis and report generation - Familiarity with medtech and regulatory content preferred Please provide your previous work samples related to web scraping and data report generation.
I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data colle...
Seeking Web Developer for Knowledge-Sharing Website Description: We are looking for a skilled web developer to create a dynamic and user-friendly website focused on knowledge sharing and information dissemination. The platform will serve as a hub for users to access well-organized and insightful content across various topics. Requirements: Experience in developing responsive and interactive websites Proficiency in front-end and back-end technologies (HTML, CSS, JavaScript, PHP, Python, or other relevant languages) Knowledge of content management systems (WordPress, Drupal, or custom CMS solutions) Database management expertise (MySQL, MongoDB, or similar) SEO optimization and performance enhancement skills Strong UI/UX design principles for a smooth user experi...
...Friends can view messages, offer advice, and help craft responses, making the dating experience more collaborative and less stressful. Multi-Platform Accessibility: The app will be developed using React Native for the frontend, ensuring a seamless experience across web, Android, and iOS platforms. Python will be used for the backend, providing robust and scalable server-side functionality. Cloud Hosting: The backend will be hosted on a reliable cloud service such as Google Cloud Platform (GCP), Alibaba Cloud, or Amazon Web Services (AWS). This ensures high availability, scalability, and security for user data and app performance. User Profiles and Matching: Detailed user profiles with photos, bios, and interests. Advanced matching algorithms to suggest pote...
...activity and performance. Content Management System (CMS): Ability to manage website content (pages, articles, blog posts, etc.). Internationalization and Localization: Support for multiple languages and currencies. II. Technology Stack (Example - Adapt as needed): Frontend: HTML, CSS, JavaScript (essential for any website) Frameworks like React, Angular, or Vue.js (for complex UIs) Backend: Python (Django/Flask), Node.js, Ruby on Rails, or other suitable server-side language/framework. Database: PostgreSQL, MySQL (relational databases for structured data). Cloud Hosting: AWS, Google Cloud Platform, Azure (scalable and reliable hosting). Search (Optional but Recommended): Elasticsearch, Solr (for robust search functionality). Payment Gateway: Stripe, PayPal (secure payment pro...
I'm looking for a seasoned full-stack developer to help me rebuild our website. The old version was built using Python, but we're aiming for a fresh start with the new, cutting-edge web technology stacks and a complete redesign. Key Requirements: - Extensive experience with WordPress Elementor, as this is the platform we've chosen for the rebuild. - Proficiency in Python, as our previous site was built on this language. - Familiarity with modern web technologies like and various JavaScript CMS platforms. - Ability to migrate all content from our old site to the new one seamlessly. While I haven't specified particular design changes, your insights on modernizing the look and feel, enhancing user-friendliness, and improving mobile responsiv...
Proje...agreed upon) 2 Core Functionality Receive text messages from Telegram users Send messages to OpenAI Assistant Retrieve responses and forward them back to the user Log incoming/outgoing requests 3 Administrative Interface Web interface for configuring API keys Support for multiple OpenAI assistants (assistant ID selection) Message log User restriction by Telegram ID (whitelist) Technology Stack Requirements Language: Python (FastAPI / Flask) or Node.js () Database: SQLite / PostgreSQL (for storing logs and settings) Hosting: VPS / Docker container Telegram API: python-telegram-bot / aiogram (or alternatives) OpenAI API: openai library Security Requirements Store API keys in a .env file Token-based access restriction (admin interface) Flood protection (request ...
Project Overview This project involves modifying Python widgets and adapting them a bit Candidates will have the opportunity for weekly collaborations over the coming months, with contact ranging from 0 to 4 hours per week. Pleese apply to this job with a direct message to me explaining me your experience with python Thank you
...Skill Set: • Signal Processing: Expertise in high-frequency sampling, peak detection, and waveform analysis. • Labjack T4 Integration: Experience with the Labjack T4 hardware and interfacing with software for data collection. • Database Design and Management: Experience in structuring and managing data, preferably time-series data. • Software Development: Proficiency in programming languages like Python, C++, or similar (any language that suits the LJM library of Labjack). Familiarity with GUI frameworks for visualization. • Pattern Recognition: Knowledge of signal comparison techniques or machine learning methods for pattern matching. Deliverables: 1. Signal Processing Algorithm: A working algorithm that captures, processes, and identifies signal peaks. ...
I'm looking for a Python expert to help me resize multiple images to specific dimensions. Ideal skills for the job: - Proficiency in Python - Experience with image manipulation libraries (e.g. PIL, OpenCV) - Ability to write efficient code for bulk processing Please ensure you can work with multiple images and can resize to precise dimensions.
I'm seeking a Python developer to assist with a school project. The project involves working with a dataset related to banking. Key Responsibilities: - Develop Python scripts for data analysis - Assist in interpreting the results in a meaningful way for the project Ideal Skills: - Proficient in Python with a focus on data analysis - Excellent problem-solving skills - Able to work with datasets and draw conclusions - Experience with banking data is a plus. Please contact me if you have the relevant skills and experience.
I'm looking for a developer to create a scraper for dexscreener.com. Initially, it's about scraping a single coin's subpage, for example: and downloading the TopTraders for 30d and 7d, and Holders, at least the first 100 positions, preferably 250. Most likely we will be expanding the number of endpoints later. Please keep cloudflare in mind. I need your program to act as a local API endpoint, meaning I provide the address in the request and get a JSON with the data in response. I don't need to read data every second - let's say 1 coin per minute is enough for me (if that makes any difference).
I'm looking for a skilled AI developer to create an AI agent specifically for the South African legal industry. This agent's primary role will be conducting legal research and retrieving case law. Key Responsibilities: - The AI agent will need to communicate back to lawyers. - It should be capable of scraping all legitimate South African law from various sources. - These sources include the South African Legal Information Institute (SAFLII), Journals and Law Reviews, and government-owned legal databases. Security is a critical aspect of this project. The AI agent must incorporate the following security measures: - Data encryption to protect sensitive information. - User authentication to ensure that only authorized personnel can access the system. - Regular security aud...
I need a freelancer to scrape the names and cell phone contacts of real estate agents from the website Ideal Skills and Experience: - Proficiency in web scraping - Familiarity with real estate industry - Attention to detail
I want to setup rffmpeg/ffmpegof for 2+ servers to be able to perform transcoding actions with FFmpeg on a remote machine(s) which can better handle transcoding, PlayTube is PHP Video Sharing script rffmpeg is a remote FFmpeg wrapper used to execute FFmpeg commands on a remote server via SSH I Want to setup & give me a guide on how to setup PlayTube with rffmpeg or ffmpegof rffmpeg Python rffmpeg Go
I'm seeking someone to help me create a data web scraping from different car-selling websites. I need to get the prices of the cars during the time (create a timeline) of prices and characteristics of the vehicles. Getting the data from those websites, for example: You can export the data to Excel or PDF format if you like. I need the prices of the cars and their characteristics. Ideal skills for this job would include: - Proficiency in web scraping tools and programming languages like Python, BeautifulSoup or Scrapy - Experience with data extraction from eCommerce or product websites - Ability to deliver clean, structured data Please ensure you can commit to delivering this project promptly and efficiently
I'm on the lookout for a talented logo designer for my company, Infi Web Solutions. We're a forward-thinking tech company specializing in Python, AI, JavaScript, and No-Code solutions. Key Requirements: - Design a modern, tech-focused logo that encapsulates our expertise in cutting-edge IT solutions. - Incorporating elements such as tech gadgets, code snippets, and AI-related imagery. Ideal Skills: - Experience in logo design. - Strong branding sense. - Proficiency in Adobe Illustrator and Photoshop. Deliverables: - Multiple logo concepts. - Revisions based on feedback. - Final files delivered in both vector and standard formats.
I require a professional data miner who can secure a comprehensive list of newly incorporated companies in India, including their directors' contact details. The focus is on all sect...retail, and finance, encompassing both LLP and private limited companies. Key Requirements: - Data of companies registered within the last month, although slightly older data may be considered - Information on director names and their contact details - Utilization of reliable sources for data collection - Delivery of the data in an Excel file The ideal candidate should have experience in data scraping and knowledge of reliable databases. Please include in your proposal your planned approach for this task, and if possible, provide a sample of your work. Accuracy and thoroughness are paramount t...
Hello, I'm Zahra, a skilled Python programmer eager to embark on new freelance projects in the programming and tech field. Ideal Skills and Experience: - Proficiency in Python is a must - Experience in other programming languages (JavaScript, Java) is a plus - Strong problem-solving skills - Ability to work independently and meet deadlines I am ready to take on challenging tasks and contribute to exciting projects. Looking forward to connecting with potential clients.
I'm looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to extract data from the website and i...
Создание модуля "Оптимизация карточек Ozon" Техническое задание для разработчиков 1. Общие требования: • Язык программирования: Python (Django, FastAPI) или Node.js. • Интерфейс: Веб-платформа с удобной админ-панелью (React, Vue.js или Angular). • СУБД: PostgreSQL или MySQL. • Интеграции: Ozon API для управления карточками. • Хостинг: Облачное решение (AWS, Google Cloud, Azure). 2. Модули системы: 1. Модуль сбора данных: o Получение информации о карточках товаров с помощью Ozon API. o Сохранение данных в локальной базе. 2. Модуль анализа: o Обработка текста: библиотека NLP (например, SpaCy, Transformers). o SEO-анализ: анализ ключевых слов, текстовых характеристик. o Анализ изображений: OpenCV или аналог для проверки качества. 3. Модуль рекоменда...
