Web crawling and scraping using pythondela

I'm looking for a Python expert with extensive experience in live streaming. Key Requirements: - Proven expertise in Python programming. - Deep understanding and hands-on experience in live streaming. - Ability to develop and implement automation scripts for smooth streaming. - Experience in data visualization and machine learning is a plus.

...experience in JavaScript and Python, adept in both frontend and backend development with a focus on backend at this stage of the project. This project requires someone who can meet with me physically in Pune and assist with the project. Key responsibilities include: - Leveraging your backend development expertise to address immediate project needs. - Integrating and managing third-party APIs with a focus on data retrieval and synchronization. - Implementing and optimizing JavaScript and Python across the project. Ideal candidate should: - Possess strong full stack development skills with extensive experience in JavaScript and Python. - Have a proven track record in backend development. - Be proficient in int...

...need a seasoned Python developer who can modify an existing script for me. The script currently updates a MySQL database and needs to be changed to update a Microsoft SQL Server (MSSQL) database instead. The challenge is that the column names in these two databases are different, so the freelancer will need to implement data transformation as part of this task. Key Requirements: - Update the database connection in the script to point to an MSSQL server - Implement necessary data transformations to accommodate different column names - Ensure that the script can handle potential errors during the data transfer process - fix one or 2 existing updating error Ideal Skills: - Proficiency in Python - Strong understanding of MySQL and MSSQL - Experience with data t...

I'm looking for an expert in Convolutional Neural Networks (CNN) who can help create a project aimed at detecting shoplifting through the analysis of recorded video footage. Key Requirements: - The CNN w...recorded video footage. Key Requirements: - The CNN will be processing video footage from in-store surveillance cameras to identify instances of potential theft. - It should be capable of distinguishing between normal shopper behavior and suspicious activity indicative of shoplifting. -Tutoring on basic concept of OpenCV and deep learning. -3 project related to anomaly detection and using UCF dataset/Shanghai crime dataset Ideal Skills: - Proficiency in CNN and video analysis. - Experience in developing theft detection systems. - Strong backgrou...

I urgently need expert support for my AWS Cloud Platform Engineer role. Ideal Skills: - Deep expertise in AWS Control Tower - Proficient in AWS Organization and AWS Backup Service - Skilled in ECS Fargate and writing Lambda functions using Python - Experienced in Cloud Formation, Stacks, and Stack Sets - Proficient in CDK TypeScript - Knowledgeable in CFCT customization for Control Tower - Familiar with serverless architectures (SNS, SQS, SES, API Gateway, Event Bridge, Step Functions) - Extensive experience in GitLab CI/CD Please note, this role requires working in Australian time zones. This is an urgent requirement.

I'm in need of a professional who can extract video links from a streaming service and enable me to embed these on my website. The essential requirement is for the videos to be playable directly on my site. Ideal skills and experience for the job include: - Knowledge of web scraping and link extraction - Experience with embedding video links on a website - Proficiency in web development - Familiarity with streaming services - Demonstrable integrity and respect for copyright laws

I need Power Automate Desktop developer to help me capture a certain data filed on a web page.

... Conversion, and Optimize Website for High Performance I’m seeking a highly skilled and efficient full-stack developer to modernize my existing website and complete an ongoing migration. The project involves upgrading our legacy tech stack, completing the frontend conversion from AngularJS to Vue.js, and optimizing the platform for high performance to support many concurrent users. The ideal candidate should: Be proficient in Symfony, Vue.js, PHP, and MySQL. Have experience working with legacy systems and migrating/upgrading older frameworks. You must be heavily using AI tools like ChatGPT o1 and sonnet 3.5 to accelerate development and ensure quality output (I will provide access to best LLMs if you need) Be able ...

Super easy task ...developer!! I'm looking for a small tweak on my existing automated calendar Python script. The current script attempts to make a booking four times, regardless of whether a previous attempt was successful. It makes bookings from a spreadsheet with the data. I need it to stop all retries once a booking is succesfully executed. At the moment it tries 4 times [Reply&includesecretpasscode 'BeastM0de'] The ideal freelancer for this project should have strong experience with Python and familiarity with automated scripts. I've already had 2 developers work on this and we are literally 98% there, just need a few final tweaks and it should be good to go! I need this done fairly quickly so bid early and if you&...

...multi-platform appointment booking and management application. This application will streamline scheduling and provide a seamless experience for our users across various devices. Responsibilities: * Design and develop robust and scalable backend systems using Django Python. * Integrate Google Cloud Platform (GCP) services, including Vertex AI for machine learning capabilities (if applicable - specify use case, e.g., appointment recommendations, demand forecasting) and BigQuery for efficient data management. * Implement Telnyx integration for SMS communication, including appointment reminders, notifications, and updates. * Build RESTful APIs to facilitate communication between the backend and frontend applications. * Ens...

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and...

Looking for a Python developer to create a cross-platform desktop app (Windows, Linux, macOS) that embeds a web application. Must include a setting for autostart on PC boot and allow future feature enhancements.

...experienced developer to build a fast, multithreaded, and lightweight application for automating HTTP requests or similar methods to retrieve responses from a specified source. The application must be designed to run on a Linux environment and should be implemented using Python or similar languages. Requirements: Platform: Linux (Ubuntu or similar distribution). Language: Python or another lightweight language (please specify). Core Features: The application should accept input data (e.g., list of items, URLs, or identifiers). Automate the process of sending HTTP requests or using similar methods to retrieve responses from the target service or website. The application must be multithreaded to handle multiple requests concurrently, ensuring ...

I'm seeking a Python expert to help me prepare for an upcoming interview focused on Python API Development. The primary purpose of the API I'm working with is for data retrieval, but I also need to understand data submission and third-party integration. Key Areas of Focus: - **Technical Skills**: I need to enhance my technical skills, particularly in understanding and working with Python APIs. - **Programming Languages**: A significant part of the interview will focus on my knowledge of various programming languages, with a primary emphasis on Python. Ideal Skills: - Extensive experience in Python and API development. - Strong understanding of various programming languages. - Proven track record of interview coaching or t...

I'm looking for a Python professional with AWS Lambda expertise. The primary task involves processing documents saved in an S3 bucket. Key Responsibilities: - Utilize AWS Lambda to handle document attachments stored in S3. - Write/Upload documents to the S3 bucket as needed. Ideal Skills and Experience: -Should be expert in handling complex python projects (Enterprise level) - Proficient in Python -Should be proficient in creating same attachment which is in internal bucket to DM bucket . - Extensive experience with AWS Lambda - Familiarity with S3 bucket operations - Able to handle document processing tasks efficiently -Should be able to work on a remote machine . -Should be available in CST timezone for atleast 3-4 hours (9am -2 pm cst ) -***Please do...

...(empresas). 8. Pantalla de notificaciones: Notificaciones para empresas y conductores. 9. Pantalla de integración con redes sociales: Opciones para compartir anuncios en redes sociales (empresas y conductores). 10. Pantalla de mapa de cobertura: Mapa de la zona de cobertura de los anuncios (empresas). *Tecnologías y herramientas:* 1. Desarrollo móvil: React Native o Flutter 2. Backend: Node.js o Python con framework Express o Django 3. Base de datos: MongoDB o PostgreSQL 4. Mapas: Google Maps o Mapbox 5. Pago y procesamiento de transacciones: Stripe o PayPal 6. Autenticación de dos factores: Google Authenticator o Authy 7. Cifrado de datos: SSL/TLS 8. Análisis de datos: Google Analytics o Mixpanel *Modelo de negocio:* 1. Comisiones: la aplic...

...capable of recognizing and identifying characters displayed in a YouTube livestream screen. The project involves analyzing live video content and extracting text or character information in real time. Key Responsibilities: Develop a tool to capture and process frames from a YouTube livestream. Implement Optical Character Recognition (OCR) or similar technologies to detect and recognize text or characters within the video feed. Ensure high accuracy in text recognition, even with varying fonts, sizes, and colors. Optimize the system for real-time processing with minimal delay. Provide a solution that can handle dynamic changes in the screen layout or content. Deliver clean, well-documented, and maintainable code. Requirements: Proficiency in pr...

I own an E-commerce site and I need to know what tech stack it's using. Key Requirements: - Access to full codebase to analyze. - Understand and identify all technologies used in the site. Ideal Skills: - Proficiency in analyzing website codebases. - Strong understanding of various tech stacks, especially for E-commerce sites. - Experience with JavaScript, Python, PHP, and ability to identify other languages.

...communication and project management, we've identified the need to integrate WhatsApp as a primary tool. We aim to establish a structured system that allows for streamlined messaging, task coordination, and project tracking. - Objective: Implement a WhatsApp-based communication system to improve daily interactions and project workflows within our team. - Scope of Work: * Set up WhatsApp Business API or appropriate version for business communication. * Create guidelines for internal messaging, including response times, message formatting, and usage protocols. * Develop a task coordination process that leverages WhatsApp features, ensuring all team members are aligned and accountable. * Integrate a project management approach using...

PLEASE READ THE DETAILED DESCRIPTION BELOW AND PROVIDE A QUOTE FOR DAYS AND DOLLARS My social media-style app built on and Python is 95% complete and requires a skilled developer to address some final issues and deliver it ASAP. The budget is $500 and the timeline is ASAP. Please include with your proposal the number of days required. I would prefer someone who can assign several people to the different parts of the job in order to speed this up. Key Areas of Focus: - Frontend Issues: The app's user interface needs to be polished and made user-friendly. - Backend Issues: There are some server-side concerns that need to be resolved. - Integration Problems: - Login/Signup: The user registration and login process nee...

Build a Website with Booking System, Marketing Integration, and Customer Data Management Description: We are Kids Cafe - a family-friendly business offering fun activities, party packages, and events for kids. We are looking for an experienced developer to create a website that integrates a robust booking system, customer data management, and marketing tools. Key Features Needed: 1. Website Creation: Design a clean, responsive, and mobile-friendly website. Include sections for: About Us Activities Offered Birthday/Event Booking Activity Pricing and Booking Contact Information 2. Booking System for Activities and Events: Activity Booking: Allow customers to book activity time slots once they arrive at the venue. Include real-time availability up...

...a dynamic and innovative software development company seeking a Senior Full-Stack Developer to join our team. As a senior member of our development team, you will play a pivotal role in building cutting-edge web and mobile applications. This is a full-time, remote position requiring an expert in React, Flutter, and other technologies, with a focus on delivering exceptional front-end and back-end solutions. Experience in both React & Flutter are mandatory. Non negotiable. Good English is non negotiable. Responsibilities: Develop and maintain web and mobile applications using React and Flutter. Work on both front-end and back-end development, delivering robust, scalable, and efficient solutions....

I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).

I'm in need of a skilled programmer with expertise in 5M stack, specifically for feature development on both the frontend and backend. The frontend will primarily involve C++ and the backend will be utilizing Python. Key Responsibilities: - Developing new features on the 5M stack - Engaging in both frontend (C++) and backend (Python) development Ideal Skills: - Extensive knowledge of 5M stack programming - Proficiency in C++ for frontend development - Strong Python skills for backend development - Experience in feature development - Ability to work on complex programming tasks

I am looking for a skilled Django Python developer to integrate the WhatsApp API into a customer support system. This system will manage customer queries with preset responses based on the type of user inquiries. Key Features: - Handle diverse queries: The system should be capable of addressing services inquiries, technical support questions, and general information requests pertaining to the service - Automatic Query Categorization: I require the system to automatically categorize incoming queries for efficient response managemen and generate relevant response. - Multi-Platform Synchronization: Besides WhatsApp, the system responses should be synchronized with Email, SMS, and Web chat. Ideal Skills: - Proficiency in Django and Python - E...

I'm seeking an experienced NLP professional to develop a text classification model for social media posts. The posts will be sourced from Twitter, Facebook, and Instagram. Key Responsibilities: - Design and implement a robust NLP model to classify text from various social media platforms. - Ensure the model is able to handle the unique characteristics and challenges of each platform's posts. Ideal Skills: - Proficient in NLP techniques, particularly in text classification. - Experience working with data from Twitter, Facebook, and Instagram. - Strong programming skills, preferably in Python or R. I look forward to your proposals.

I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.

...account separation and subscription-based access. Payment Gateway Integration: The system must include integration with popular payment gateways (e.g., Stripe, PayPal) to handle user subscriptions, renewals, and cancellations securely. Future Mobile App Compatibility: The platform should be designed to allow seamless future development of a native mobile app for iOS and Android. Ensure APIs and backend architecture are scalable for this purpose. ------------------------------------------------------------------- Project Overview I am looking for a developer (or development team) to create a responsive web-based system that enables real estate agents to design professional graphics for property listings on social media platforms. The system should be...

I am in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance the efficiency of my data...

I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.

have a open ai python code that explicitly says statements in a search return and offers related topic suggestions, so basic functionality works great but needs to be improved. want to develop so if you search this bar () with the word Monetary Policy, the prompt that is expressed currently says Results presented for "1. **Monetary Policy**: The actions of central banks to control the money supply and interest rates in an economy." to the left. then it says Certainly! here are related topics that might interest you: and then these weir lists with gaps and ** and numbers, i want that to become more appealing/conversational ..... and be replaced with Ive presented results to the left on Monetary Policy which are <def>The ...

I'm seeking a machine learning e...learning expert with extensive experience in computer vision and image processing. The project involves developing a multi-modal attention framework integrated with a Vision Transformer for enhanced copy-move forgery detection. Key Responsibilities: - Use publicly available benchmark forgery detection datasets to train and evaluate the model. - Focus on achieving high detection accuracy through the implementation of effective machine learning strategies. Ideal Skills: - Proficient in Python and relevant machine learning libraries (TensorFlow, PyTorch). - Strong understanding of Vision Transformers, CNNs and attention mechanisms. - Experience in developing and testing models on benchmark datasets. - Excelle...

...experienced in Shopify and the PageFly app to design and build a 2-page sales funnel for our brand. The funnel will be designed to align seamlessly with our website’s design aesthetics and overall branding. The project will involve the creation of two essential pages: 1 - Lead Capture Page 2 - Upsell Page Project Goals: 1 - Create a visually appealing and conversion-optimized Lead Capture Page where visitors will exchange their email addresses for a freebie. 2 - Design an engaging Upsell Page to offer a complementary product to the lead. Both pages should: 1 - Reflect our brand’s design and tone. 2 - Be responsive and user-friendly across all devices. 3 - Utilize proven design principles to maximize conversions. 4 - Be fully f...

Se busca desarrollador de Python con amplia experiencia en: • Scrapy. • Django. • Manejo de servidores Linux. • Pandas. Aparte de esos conocimientos debe cumplir estos requisitos: • Debe de dominar el castellano. • Incorporación inmediata. • Disponibilidad mínima diaria de 6 horas. • Dispuesto a cumplir un horario fijo. • Dispuesto a mantener reuniones telemáticas diarias. • Diariamente debe remitir al final de su jornada las horas empleadas, un resumen del trabajo realizado así como subir commits de su trabajo. • El control de las horas de trabajo se realizará por la aplicación de freelancer. • El precio de la hora de trabajo debe ser inferior a 8 €uros.

Description over freelancer and Video Call

We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximi...

Prosimo, vpišite se ali se prijavite za več podrobnosti.

I need a skilled Python developer to help me with some data processing and scrapping tasks. The data is primarily text and numerical, and the code needs to handle various functionalities like data transformation and processing. Key Responsibilities: - Develop (and/or replicate existing) Python code for data processing - Implement data transformation techniques - Use data filtering methods to refine the data Ideal Skills and Experience: - Proficiency in Python - Experience with data processing and transformation - Familiarity with data filtering techniques - Ability to handle text and numerical data - Google API Personality : - No Toxic - Collaborative - Responsive, agile and fast work delivery Budget: $...

...software developer to create a simple and efficient desktop application for recording and organizing messages. The application should allow users to manually input messages through data entry fields, as well as support uploading PDF files for messages, with automatic organization into local folders. The focus is on ease of use, security, and flexibility in managing data and files. Core Requirements: 1. User Interface: - A simple and user-friendly design utilizing tabs, where each tab represents a specific type of message with dedicated input fields and tables. - Support for searching messages based on entered data (e.g., sender's name, job title, message date, etc.) for easy browsing. - Two separate drag-and-drop windows for addin...

Transform Excel Sheet Data to Charts and Stats using Power BI, we need interpretation for each chart.

I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated

I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.

...or team to create a comprehensive sports app and website. The project includes key features such as live match updates, AI predictions, fan engagement tools, match highlights, and a tiered subscription model. Key Features: - Real-time match updates sourced from APIs like Opta Sports or Sportradar. - AI-driven predictions concerning matches, player performance, and betting tips. - Interactive fan engagement tools including polls, quizzes, and forums. - Exclusive content comprising match highlights and in-depth analysis. - A structured subscription model with Free, Starter, Premium, and Elite tiers. Tech Stack: - Frontend development using React Native. - Backend built on either Python or Node.js. - AI and machine learning i...

...a professional who can scrape a Telegram group for content without crossing the platform's limits. The goal is to create a 24/7 with near realtime data and create either an application dashboard or simple csv with pivot/histogram for an easy visualization. Someone who already worked on similar request is preferred to avoid number being blocked so scheduled breaks are required in the code. Request is only to get the content and put in the easy readable format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless fo...

My web application working fine in local host and when I deployed it in amazon lightsail some functions stop working... sometime getting 404 type error and sometime missing links. Website developed in Python Language. I need it run properly in aws. Experts only please. Skills and Experience: - Proficient in AWS services, particularly EC2, S3, and RDS - Experienced in deploying web applications on AWS - Knowledgeable in scaling infrastructure and data management on AWS - Familiar with best practices for application deployment on AWS

...developer to create a modern, clean, and minimalist e-learning platform using the Lifter LMS plugin. Project 1: A new e-learning website: Menu: Home. About us. Blog. Search function. Shopping cart. Login. Requirements: Book appointments for a consultation call on the website with immediate confirmation. Book and pay for individual seminars and seminar series from a catalog on the website (credit card, Klarna, and PayPal) with immediate confirmation. Automatic reminder emails. Course completion certificates: The system must automatically generate certificates and send them to the course participants by email once the course is completed. The participant must be able to publish these on their social media channels (Facebook, Link...

...equalizer designed and implemented, with thorough testing as the top priority. The equalizer should have a minimum of 3 frequency bands: bass, midrange, and treble. This system will enable users to adjust the frequency response of an audio signal by either boosting or reducing specific frequency bands using finite impulse response (FIR) filters. Key aspects of the project: - The equalizer should be capable of processing MP3 audio format. - The design should be clear and comprehensible, with the focus on robustness and accuracy in the implementation. - The interface can be either a Graphical User Interface (GUI) or a Command Line Interface (CLI), although I have no specific preference for one over the other. Ideal skills for this project: - Proficienc...

A need a content writer to write content for DATA SCIENCE COURSE using R programming and Python programming. Reference websites 1. Acte 2. Besant technologies 3. Simpli learn 4. I need to know the budget and timeframe. It should be pragarism free. No chatgpt no ai tools. Proper content writers alone with technical knowledge apply.

I need a skilled web scraper to assist with my real estate business. This involves scraping a real estate website that updates daily with 2,000–3,000 listings. The goal is to extract and match the data with realtor needs from my internal database. Requirements: - Daily scraping of 2,000–3,000 listings. - Extract relevant data such as price, property type, location, realtor name, contact info, and more. - Basic matching for a specific region. Budget: I’m ready to pay $40/month for this service. Ideal Skills: - Proficient in web scraping techniques and tools. - Experience in data extraction and analysis. - Familiarity with real estate data is a plus. - Able to perform basic data matching. Note: Please be aw...

... We are seeking a skilled and experienced data analyst to help us process, analyze, and visualize our business data to derive actionable insights. The project involves moderate-level complexity, requiring expertise in data manipulation, statistical analysis, and visualization tools. Key Deliverables: 1. Data Cleaning and Preparation: - Handle missing values, outliers, and inconsistencies in the dataset. - Ensure data integrity and prepare a clean dataset for analysis. 2. Data Analysis: - Perform descriptive and inferential statistical analysis. - Identify trends, patterns, and correlations in the data. - Generate summary reports highlighting key findings. 3. Visualization and Reporting: ...