Web crawling and scraping using python jobs

I own an E-commerce site and I need to know what tech stack it's using. Key Requirements: - Access to full codebase to analyze. - Understand and identify all technologies used in the site. Ideal Skills: - Proficiency in analyzing website codebases. - Strong understanding of various tech stacks, especially for E-commerce sites. - Experience with JavaScript, Python, PHP, and ability to identify other languages.

...communication and project management, we've identified the need to integrate WhatsApp as a primary tool. We aim to establish a structured system that allows for streamlined messaging, task coordination, and project tracking. - Objective: Implement a WhatsApp-based communication system to improve daily interactions and project workflows within our team. - Scope of Work: * Set up WhatsApp Business API or appropriate version for business communication. * Create guidelines for internal messaging, including response times, message formatting, and usage protocols. * Develop a task coordination process that leverages WhatsApp features, ensuring all team members are aligned and accountable. * Integrate a project management approach using...

PLEASE READ THE DETAILED DESCRIPTION BELOW AND PROVIDE A QUOTE FOR DAYS AND DOLLARS My social media-style app built on and Python is 95% complete and requires a skilled developer to address some final issues and deliver it ASAP. The budget is $500 and the timeline is ASAP. Please include with your proposal the number of days required. I would prefer someone who can assign several people to the different parts of the job in order to speed this up. Key Areas of Focus: - Frontend Issues: The app's user interface needs to be polished and made user-friendly. - Backend Issues: There are some server-side concerns that need to be resolved. - Integration Problems: - Login/Signup: The user registration and login process nee...

Build a Website with Booking System, Marketing Integration, and Customer Data Management Description: We are Kids Cafe - a family-friendly business offering fun activities, party packages, and events for kids. We are looking for an experienced developer to create a website that integrates a robust booking system, customer data management, and marketing tools. Key Features Needed: 1. Website Creation: Design a clean, responsive, and mobile-friendly website. Include sections for: About Us Activities Offered Birthday/Event Booking Activity Pricing and Booking Contact Information 2. Booking System for Activities and Events: Activity Booking: Allow customers to book activity time slots once they arrive at the venue. Include real-time availability up...

...a dynamic and innovative software development company seeking a Senior Full-Stack Developer to join our team. As a senior member of our development team, you will play a pivotal role in building cutting-edge web and mobile applications. This is a full-time, remote position requiring an expert in React, Flutter, and other technologies, with a focus on delivering exceptional front-end and back-end solutions. Experience in both React & Flutter are mandatory. Non negotiable. Good English is non negotiable. Responsibilities: Develop and maintain web and mobile applications using React and Flutter. Work on both front-end and back-end development, delivering robust, scalable, and efficient solutions....

I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).

I'm in need of a skilled programmer with expertise in 5M stack, specifically for feature development on both the frontend and backend. The frontend will primarily involve C++ and the backend will be utilizing Python. Key Responsibilities: - Developing new features on the 5M stack - Engaging in both frontend (C++) and backend (Python) development Ideal Skills: - Extensive knowledge of 5M stack programming - Proficiency in C++ for frontend development - Strong Python skills for backend development - Experience in feature development - Ability to work on complex programming tasks

I am looking for a skilled Django Python developer to integrate the WhatsApp API into a customer support system. This system will manage customer queries with preset responses based on the type of user inquiries. Key Features: - Handle diverse queries: The system should be capable of addressing services inquiries, technical support questions, and general information requests pertaining to the service - Automatic Query Categorization: I require the system to automatically categorize incoming queries for efficient response managemen and generate relevant response. - Multi-Platform Synchronization: Besides WhatsApp, the system responses should be synchronized with Email, SMS, and Web chat. Ideal Skills: - Proficiency in Django and Python - E...

I'm seeking an experienced NLP professional to develop a text classification model for social media posts. The posts will be sourced from Twitter, Facebook, and Instagram. Key Responsibilities: - Design and implement a robust NLP model to classify text from various social media platforms. - Ensure the model is able to handle the unique characteristics and challenges of each platform's posts. Ideal Skills: - Proficient in NLP techniques, particularly in text classification. - Experience working with data from Twitter, Facebook, and Instagram. - Strong programming skills, preferably in Python or R. I look forward to your proposals.

I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.

...account separation and subscription-based access. Payment Gateway Integration: The system must include integration with popular payment gateways (e.g., Stripe, PayPal) to handle user subscriptions, renewals, and cancellations securely. Future Mobile App Compatibility: The platform should be designed to allow seamless future development of a native mobile app for iOS and Android. Ensure APIs and backend architecture are scalable for this purpose. ------------------------------------------------------------------- Project Overview I am looking for a developer (or development team) to create a responsive web-based system that enables real estate agents to design professional graphics for property listings on social media platforms. The system should be...

I am in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance the efficiency of my data...

I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.

have a open ai python code that explicitly says statements in a search return and offers related topic suggestions, so basic functionality works great but needs to be improved. want to develop so if you search this bar () with the word Monetary Policy, the prompt that is expressed currently says Results presented for "1. **Monetary Policy**: The actions of central banks to control the money supply and interest rates in an economy." to the left. then it says Certainly! here are related topics that might interest you: and then these weir lists with gaps and ** and numbers, i want that to become more appealing/conversational ..... and be replaced with Ive presented results to the left on Monetary Policy which are <def>The ...

I'm seeking a machine learning e...learning expert with extensive experience in computer vision and image processing. The project involves developing a multi-modal attention framework integrated with a Vision Transformer for enhanced copy-move forgery detection. Key Responsibilities: - Use publicly available benchmark forgery detection datasets to train and evaluate the model. - Focus on achieving high detection accuracy through the implementation of effective machine learning strategies. Ideal Skills: - Proficient in Python and relevant machine learning libraries (TensorFlow, PyTorch). - Strong understanding of Vision Transformers, CNNs and attention mechanisms. - Experience in developing and testing models on benchmark datasets. - Excelle...

...experienced in Shopify and the PageFly app to design and build a 2-page sales funnel for our brand. The funnel will be designed to align seamlessly with our website’s design aesthetics and overall branding. The project will involve the creation of two essential pages: 1 - Lead Capture Page 2 - Upsell Page Project Goals: 1 - Create a visually appealing and conversion-optimized Lead Capture Page where visitors will exchange their email addresses for a freebie. 2 - Design an engaging Upsell Page to offer a complementary product to the lead. Both pages should: 1 - Reflect our brand’s design and tone. 2 - Be responsive and user-friendly across all devices. 3 - Utilize proven design principles to maximize conversions. 4 - Be fully f...

Description over freelancer and Video Call

We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximi...

Please Sign Up or Login to see details.

I need a skilled Python developer to help me with some data processing and scrapping tasks. The data is primarily text and numerical, and the code needs to handle various functionalities like data transformation and processing. Key Responsibilities: - Develop (and/or replicate existing) Python code for data processing - Implement data transformation techniques - Use data filtering methods to refine the data Ideal Skills and Experience: - Proficiency in Python - Experience with data processing and transformation - Familiarity with data filtering techniques - Ability to handle text and numerical data - Google API Personality : - No Toxic - Collaborative - Responsive, agile and fast work delivery Budget: $...

...software developer to create a simple and efficient desktop application for recording and organizing messages. The application should allow users to manually input messages through data entry fields, as well as support uploading PDF files for messages, with automatic organization into local folders. The focus is on ease of use, security, and flexibility in managing data and files. Core Requirements: 1. User Interface: - A simple and user-friendly design utilizing tabs, where each tab represents a specific type of message with dedicated input fields and tables. - Support for searching messages based on entered data (e.g., sender's name, job title, message date, etc.) for easy browsing. - Two separate drag-and-drop windows for addin...

Transform Excel Sheet Data to Charts and Stats using Power BI, we need interpretation for each chart.

I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated

I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.

...or team to create a comprehensive sports app and website. The project includes key features such as live match updates, AI predictions, fan engagement tools, match highlights, and a tiered subscription model. Key Features: - Real-time match updates sourced from APIs like Opta Sports or Sportradar. - AI-driven predictions concerning matches, player performance, and betting tips. - Interactive fan engagement tools including polls, quizzes, and forums. - Exclusive content comprising match highlights and in-depth analysis. - A structured subscription model with Free, Starter, Premium, and Elite tiers. Tech Stack: - Frontend development using React Native. - Backend built on either Python or Node.js. - AI and machine learning i...

...a professional who can scrape a Telegram group for content without crossing the platform's limits. The goal is to create a 24/7 with near realtime data and create either an application dashboard or simple csv with pivot/histogram for an easy visualization. Someone who already worked on similar request is preferred to avoid number being blocked so scheduled breaks are required in the code. Request is only to get the content and put in the easy readable format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless fo...

My web application working fine in local host and when I deployed it in amazon lightsail some functions stop working... sometime getting 404 type error and sometime missing links. Website developed in Python Language. I need it run properly in aws. Experts only please. Skills and Experience: - Proficient in AWS services, particularly EC2, S3, and RDS - Experienced in deploying web applications on AWS - Knowledgeable in scaling infrastructure and data management on AWS - Familiar with best practices for application deployment on AWS

...equalizer designed and implemented, with thorough testing as the top priority. The equalizer should have a minimum of 3 frequency bands: bass, midrange, and treble. This system will enable users to adjust the frequency response of an audio signal by either boosting or reducing specific frequency bands using finite impulse response (FIR) filters. Key aspects of the project: - The equalizer should be capable of processing MP3 audio format. - The design should be clear and comprehensible, with the focus on robustness and accuracy in the implementation. - The interface can be either a Graphical User Interface (GUI) or a Command Line Interface (CLI), although I have no specific preference for one over the other. Ideal skills for this project: - Proficienc...

A need a content writer to write content for DATA SCIENCE COURSE using R programming and Python programming. Reference websites 1. Acte 2. Besant technologies 3. Simpli learn 4. I need to know the budget and timeframe. It should be pragarism free. No chatgpt no ai tools. Proper content writers alone with technical knowledge apply.

I need a skilled web scraper to assist with my real estate business. This involves scraping a real estate website that updates daily with 2,000–3,000 listings. The goal is to extract and match the data with realtor needs from my internal database. Requirements: - Daily scraping of 2,000–3,000 listings. - Extract relevant data such as price, property type, location, realtor name, contact info, and more. - Basic matching for a specific region. Budget: I’m ready to pay $40/month for this service. Ideal Skills: - Proficient in web scraping techniques and tools. - Experience in data extraction and analysis. - Familiarity with real estate data is a plus. - Able to perform basic data matching. Note: Please be aw...

... We are seeking a skilled and experienced data analyst to help us process, analyze, and visualize our business data to derive actionable insights. The project involves moderate-level complexity, requiring expertise in data manipulation, statistical analysis, and visualization tools. Key Deliverables: 1. Data Cleaning and Preparation: - Handle missing values, outliers, and inconsistencies in the dataset. - Ensure data integrity and prepare a clean dataset for analysis. 2. Data Analysis: - Perform descriptive and inferential statistical analysis. - Identify trends, patterns, and correlations in the data. - Generate summary reports highlighting key findings. 3. Visualization and Reporting: ...

writing python script for client

...Overview Weare looking for a highly skilled and motivated Data Engineer with 4-8 years of experience to join our dynamic team. This role is ideal for individuals with advanced technical expertise in Python programming and relational databases, a strong background in data modeling and transformation, and the ability to process structured and unstructured data. The ideal candidate will thrive in a fast-paced, agile environment, collaborating effectively to develop features and solve complex problems. Key Responsibilities ● Design, develop, and maintain scalable data pipelines and systems. ● Process and transform large datasets from various sources while ensuring data integrity and quality. ● Build a...

I'm looking for a data scraping expert to help me gather product information from three websites. The specific data I need includes product names and prices as well as product descriptions and specifications. The task is a one-time requirement, so I don't need ongoing updates. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience in extracting product information from e-commerce websites - Strong attention to detail to ensure accurate data collection

...assist me in learning and improving my skills in specific areas of DevOps and AWS. I am currently working on projects involving AWS and DevOps tools, but there are a few gaps in my knowledge that I would like to address through guided learning sessions and practical examples. AWS Services: - EC2 instances (advanced management, troubleshooting, automation) - AWS Systems Manager (SSM) advanced usage - RDS management and backups - S3 lifecycle policies and configurations - Elastic Load Balancer (ELB) and Auto Scaling configurations - CloudWatch advanced monitoring and custom metrics - IAM roles, policies, and permissions DevOps Tools: - CI/CD pipelines (AWS CodePipeline, Jenkins, or GitLab CI/CD) - Infrastructure as Code (IaC...

...their businesses using innovative technologies. We specialize in creating IoT, Embedded systems, PCB boards, mobile applications, websites, web solutions, products from scratch, CRM and ERP systems, as well as custom corporate solutions. We’re looking for a skilled engineer who excels in communication and has a confident command of spoken English at B2 level or higher. Responsibilities: PCB Design: -Design schematics and PCB layouts for Raspberry Pi-compatible peripherals. -Select components, including power management ICs, MOSFETs, relays, and ADCs. -Generate BOM and Gerber files for manufacturing. Embedded Firmware Development: -Write and debug firmware for STM32 microcontrollers (or equivalent). -Develop drivers for ...

I'm seeking a freelancer who can develop a connector that facilitates bidirectional communication between my Python-based chatbot and Twitter. Key Requirements: - The connector should support both sending messages from the chatbot to Twitter and receiving messages from Twitter to the chatbot. - The connector must implement Basic API key authentication for security purposes. Ideal Skills and Experience: - Proficiency in Python is essential. - Previous experience in developing API connectors, particularly with Twitter, would be highly advantageous. - Strong understanding of Basic API key authentication and its implementation in Python.

...Odoo Developer to create a robust, user-friendly application that meets my business requirements and provides a seamless experience across both mobile and desktop platforms. Key Responsibilities: Customize and develop modules in Odoo to meet specific business needs. Ensure compatibility and responsiveness across mobile (iOS and Android) and desktop platforms. Build APIs and integrations with third-party systems as needed. Optimize the user interface and workflows for a smooth user experience. Implement security protocols and ensure data integrity. Test the application to identify and fix bugs or performance issues. Requirements: Proven experience with Odoo development. Strong knowledge of Python and Odo...

...craft 6 PowerPoint slides for a business pitch. The slides should embody an innovative tone and effectively utilize images and icons, as opposed to graphs and charts or diagrams and flowcharts using the provided inspiration images Key Responsibilities: - Design 6 engaging PowerPoint slides that act as a template 1 x opening page with logo and title 1 x image on the right, text on the left 1 x image on the left, text on the right 1 x full scape image with text image 1 x 8 tile images 1 x closing slide - Black background with the space (stars background as per image) - Incorporate provided design elements including Logo and ancient greek symbols - Use of images and icons for visuals Ideal Skills and Experience: - Proficien...

...trading code tailored to my specific needs. My trading environment is Python Jupyter, which requires Python scripting skills. The code should be able to implement multiple trading indicators and strategies. Specifically: - Moving Average Crossover - Bollinger Bands - RSI Divergence - Trend Reverse Trigger In addition, the frequency of trading signals from the code should be on a weekly basis, thus, requiring expertise in timing and frequency algorithms. Ideal freelancers for this project would have experience in Python scripting, familiarity with Python Jupyter environments, and an understanding of trading indicators, strategies, and timing algorithms. I look forward to further discussing the requirements of the project ...

I am in need of a seasoned API developer, with a proven track record of delivering projects related to the CoinGlass and CoinMarketCap APIs. The task involves developing a script in Python on an AWS server. Specific features required from the CoinGlass API include: - Market data retrieval - Trading history - Price alerts From the CoinMarketCap API, I need: - Cryptocurrency listings - Market data retrieval - Latest news The preferred Python framework for this project is FastAPI, django or flask Ideal candidates will have: - Extensive experience with Python and API integration - Prior work with CoinGlass and CoinMarketCap APIs - Proficiency in using FastAPI framework - AWS server management skills. Looking forward to discussing the proj...

...trading code tailored to my specific needs. My trading environment is Python Jupyter, which requires Python scripting skills. The code should be able to implement multiple trading indicators and strategies. Specifically: - Moving Average Crossover - Bollinger Bands - RSI Divergence - Trend Reverse Trigger In addition, the frequency of trading signals from the code should be on a weekly basis, thus, requiring expertise in timing and frequency algorithms. Ideal freelancers for this project would have experience in Python scripting, familiarity with Python Jupyter environments, and an understanding of trading indicators, strategies, and timing algorithms. I look forward to further discussing the requirements of the project ...

I'm looking for a skilled developer who can help me with the backend of my N9K platform. The backend should be built using Python/Django, Lunux and C Lnaguage and it should cater to both web and mobile applications. Key Requirements: - Proficient in Python and Django - Proficient in C and Linux - Experience in developing backends for both web and mobile applications - Capability to implement user authentication and management, data storage and retrieval, and API integration Please note, the specific functionalities for the backend have not yet been finalized, but the aforementioned points will be key aspects of the project. The ideal candidate would be flexible and able to adap...

I'm looking for a Python expert who can conduct research on harmonic patterns, particularly the Gartley pattern, using historical daily stock prices from the last 5 years of 10 companies listed on the Malaysian stock market. The research should be conducted on Google Colab and should provide clear entry levels, stop-loss and take-profit levels. Ideal Skills and Experience: - Proficiency in Python and Google Colab - Experience with stock market analysis - Understanding of harmonic patterns, particularly the Gartley pattern - Ability to present data in a clear, concise manner Please note, the analysis should solely use historical stock prices.

I'm looking for a skilled software developer to create a desktop application tailored for productivity. This application will primarily target Windows users. Key Requirements: - Experti...tailored for productivity. This application will primarily target Windows users. Key Requirements: - Expertise in Windows desktop application development. - Strong background in creating productivity tools. - Ability to design intuitive and user-friendly interfaces. - Experience with software testing and debugging. Ideal Skills: - Proficiency in languages like C#, Java, or Python. - Familiarity with UI/UX design principles. - Knowledge of productivity software trends. Your role will be crucial in delivering a high-quality product that meets user needs and stands out ...

I have an existing scraper built in python for the website (CWH). It scrapes the following information: - product description, price, images - SEO metadata - Additional metadata Currently, all the scraped data is stored in a CSV file. I am looking for a developer who has expertise in python / scraping and postgres to do the following: [Phase / Milestone 1] 1. Convert the existing scraper (code attached - /site-packages removed for space) to load the data in a postgres database. 2. Scrape reviews of products from the (CWH) website and store them in the database. 3. Look up the availability of the product in specific stores and write the boolean value in the postgres database. (code attached - ) [Phase

I'm in need of a Python script that can download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from a public website every hour. - Upload the report to a specific portal folder without any modifications. Ideal Skills: - Proficient in Python programming. - Prior experience with web scraping and automating tasks. - Familiarity with working with Excel files in Python. - Knowledge of file upload protocols and processes.

My existing Python script requires a skilled developer to optimize its performance, particularly its user interface response time. Key Requirements: - Expertise in Python programming - Experience with performance optimization - Proficient in enhancing command-line interface scripts The script is currently running with a command-line interface and the primary performance issues are noticeable in the user interface response time. The goal of this project is to improve the overall efficiency of the script, ensuring a smoother user experience.

Summary: Need to migrate an existing website and add proper structure, access control, admin section. Basically need a proper skeleton created to be able to add additional functionality later. # Software Requirements Specification for Online Worksheet Practice Website Structure ## 1. Overview This document outlines the software requirements for an online worksheet practice website to be developed using CodeIgniter 4. The website will provide educational resources in the form of worksheets, categorized by grade level and subject, similar to and education.com. It will include features for various user access levels, content organization, and administration. A simple working version of this website is already available (). The developer

I'm seeking a proficient mobile app developer or a dedicated team to create a uniqu...MetaHuman integration for real-time lip-syncing responses The ideal candidate or team should possess an impressive portfolio and experience in: - Cross-platform app development, with a strong focus on Flutter or React Native - Leveraging Speech recognition (STT) and Text-to-Speech (TTS) solutions - Integrating with Unreal Engine and MetaHuman - Backend development, proficient in Python (Flask/Django) or Node.js The project demands flawless synchronization between user voice inputs, NLP processing, and animated responses from the MetaHuman. If your background includes creating interactive or AI-driven applications, I would be eager to collaborate. Please provide yo...