Web scraping using pandas jobs

I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.

I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.

...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data's from the stated Site in to o...

I'm in need of a modern e-commerce website designed to sell mobile devices, laptops, tablets, and consoles. The site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site :

I'm seeking a skilled data scraper to extract stock prices from Yahoo Finance. The data should cover both the NYSE and NASDAQ. Key Responsibilities: - Scrape real-time and historical stock prices from Yahoo Finance. - Implement data scraping in a way that it can be run periodically. - Store the scraped data into a MySQL database using "INSERT ON DUPLICATE KEY UPDATE" to handle potential duplicates. Ideal Skills: - Proven experience in web scraping, particularly finance data. - Strong knowledge in MySQL and data management. - Familiarity with Yahoo Finance and stock market data. Please bid if you can provide a prototype and have experience in similar projects.

I'm seeking an experienced researcher to compile a detailed list of private drum instructors across the entire East Coast of the US and ...aimed at enhancing outreach and potential engagement. Key Responsibilities: - Research and document private drum teachers who possess personal websites showcasing their drumming and teaching services. - Gather and verify essential contact details: First Name, Second Name, Email, Web URL, City. - This project requires search engine research and music teacher directories, NOT LinkedIn scraping. Deliverable: - The final list should be delivered in a Google Sheets or excel document. Ideal Skills: - Proficient in web research and data collection. - Familiarity with music teacher directories preferred. - Previous experience in lea...

I am seeking an experienced and skilled developer to create a feature-rich web application for controlling smart lighting devices via the Tuya API. The application should leverage the capabilities of the Tuya API library to offer seamless control over various aspects of smart lighting systems. Pre-designed templates and assets for the web app interface, as well as a pre-built backend library for API interactions, will be provided to accelerate development. Core Features: - On/Off Control: Allow users to power smart lights on and off individually or as a group. - Dimmer Control: Enable users to adjust light brightness with a slider or percentage input. - Color Adjustment: Provide a color picker or similar interface for changing the light colors, including support for RGB and ...

I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and provide updates on their progress. Thank you for considering my project.

I'm in need of a seasoned sales professional with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note, this project requir...

I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.

I'm facing a compatibility issue with my React Native app on iOS devices which is using NativeEventEmitter. The error is either `new NativeEventEmitter()` requires a non-null argument or listener not found I need an expert in React Native with Objective C skills to fix this problem as soon as possible. TASK TO BE DONE ON ANYDESK....

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I need assistance with extracting data from a PDF and placing it into an Excel format I will provide. Key Requirements: - Data extraction from the PDF should be done according to specific column headers in the provided Excel format. - Minor data cleaning is needed during the extraction process. Ideal Skills: - Experience in data scraping. - Proficient in Excel. - Attention to detail for data cleaning.

We are looking for an experienced Android developer to create an APK similar, with features like real-time audio communication, text messaging, and a user-friendly interface. The project involves using NIO (Non-blocking I/O) and WebRTC libraries for high-performance, low-latency communication.

...Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The tool must be capable of accurately identifying and extracting the names of companies and their decision-makers. Ideal Skills: - Proficiency in AI and machine learning. - Experience in web scraping and data extraction....

I'm looking for a skilled professional who can suggest a reliable, low-latency proxy service for my web scraping project. The script currently targets public APIs and without a proxy, it's taking around 200ms to hit the endpoints. With a proxy, I need the latency to be between 300-500ms max. Key Requirements: - The proxy service should be located in Australia - The IP rotation level should be low, with only a few changes per day - The service should not require any specific authentication methods, as the APIs I am using do not require authentication I've previously tested several proxy services but most of them resulted in latency around 750ms, which is not suitable for my needs. Please only bid if you have experience with a proxy service that has a la...

Another scraping project - Need cover art based on ISBN and Author Name

I'm seeking a skilled professional who can create an educational brain model using Meta Sam and a MRI dataset. This model is intended for undergraduate students, so it needs to be detailed yet comprehensible. Key Requirements: - Model should include: - Detailed anatomical structures - Functional areas of the brain - 3D interactive elements - Proficiency in using Meta Sam - Experience with MRI datasets - Ability to create educational content

i will do the designing of the PCB in altium

I need someone to scrape data from a service guide website into a Google Sheets document. The data includes Company Name, address, Name, email, phone, mobile, website etc etc from 9632 entries across 20 categories. Ideal candidates for this project should have: - Proficient data scraping skills - Experience with Google Sheets - Attention to detail to ensure all data is accurately captured from all 20 categories.

...content (photos/videos) through direct messages (DMs). A unique aspect of is that media is sold as if it is being sent "live" in real-time, even though the content is pre-uploaded and organized in sequences called scripts. However, does not currently offer an API. This means the AI will need to interact with the platform through alternative methods, such as browser automation or scraping techniques, to send messages, manage media, and perform other tasks READ REQUIREMENTS IN DOCUMENT BELOW...

I'm in need of a diver location application for Android, using OpenCPN. The app's primary function is to help locate divers using a radio beacon attached to each diver. Key Features: - Real-time location tracking of divers using radio beacons - List of Divers associated with the vessel to be managed - Each diver will be displayed on the screen and Divers not currently transmissing will be displayed to ensue they are accounted for. - A radio reciever to bluetooth serial adapter has been developed and the location information is sent as LAT/LON and radio ID using the NEMA AIS format - Ability to save detailed dive notes with each location. the project is anticipated to be based on OPENCPN for android Ideal Skills and Experience: - Proficient in

I meed a website built using a template. I will purchase. It needa to have a booking and payment added ao people can book tours each day. Need within 5 days. Examples must be provided.

I'm looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone num...looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone numbers, from various sources. Key Requirements: - Proficiency in data scraping from company websites, business directories, and social media platforms. - Experience in lead generation. - Expertise in logistics, warehousing, and ecommerce sectors is a plus. Ideal Skills: - Data mining - Web scraping - Lead generation - Knowledge of eco...

I have a WordPress account and an Envato-Codecanyon account and have need to build a website using the platforms mentioned to do it. I am looking for a website builder to use the above to develop the site.

Job Overview: I’m looking for an experienced front-end developer to design a professional invoice template using HTML and CSS. This template will be integrated into my CRM, which uses a built-in Chrome engine to generate PDF files. Requirements: Clean, responsive, and professional invoice design. Compatibility with the Chrome PDF engine. Well-structured HTML and CSS code optimized for print. Customizable fields, including: Logo, Client Name, Products/Services, Amounts, Taxes, Totals, etc. Deliverables: A complete HTML/CSS file ready for use. Instructions for integration into the CRM (if needed). Notes: I can provide an example of the desired style for reference. Ideal Candidate: Proficient in HTML/CSS. Familiar with how PDF rendering engines like Chrome work. Detail-orien...

I'm seeking a detailed list of restaurants in the Australian Capital Territory for a new food delivery app....all types of eateries – from fine dining to fast food. Key Requirements: - Data Points: The list must include the restaurant's email addresses, phone numbers, website URLs, full addresses, as well as their Facebook pages, Instagram handles, X profiles, TikTok accounts, and YouTube channels. - Type of Restaurants: All types, not limited to a specific category. Ideal Skills: - Data mining and web scraping - Market research - Familiarity with the Australian restaurant scene is a plus Please note, the main purpose of this data will be to support the launch and growth of a new food delivery app. Your expertise and attention to detail will be crucial in ...

...system must scrape stock recommendations from a designated website, which only provides BUY signals, up until 3:30 PM. - Trades should be automatically executed in MTF (Margin Trading Facility) options. - The system needs to ensure seamless, real-time order placement without any manual intervention. The system should check for new stock recommendations every minute. Ideal Skills: - Proficient in Web Scraping, particularly with tools like BeautifulSoup, Selenium, and API integration. - Experienced in working with Trading APIs, specifically Angel One. - Skilled in Python or Node.js for automation. - Previous experience in algorithmic trading and order execution is a plus. This is a freelance project, not a full-time job. Please provide examples of similar projects you'...

Start your reply with SCRAPER. Won't read any other post. I need a script that can scrape text and articles from a specific site and similar ones. The data should be delivered in a CSV file. The script only needs to run once. Ideal skills and experience for this job include: - Proficiency in web scraping tools and programming languages such as Python, Beautiful Soup, Scrapy, or similar. - Experience with data formatting and export to CSV. - Knowledge of how to make the script compatible with similar sites. Please include examples of previous similar projects in your bid. We have a tight budget as we know this is an easy job. We don't need the outcome. We need the script. Starting point: Data to be scraped on the next page of an item on image attached. T...

Title: Web Scraper Needed to Extract Data from UAE Websites: - "Mango" - "Marks & Spencer" - "H&M" Description: I am looking for an experienced web scraper to build a script that can reliably scrape product data from the "Mango", "Marks & Spencer" and "H&M" UAE websites. The end goal is to produce a CSV file for each brand containing all relevant product information as well as provide the code used for the scraping process. Project Requirements: Websites: "Mango" UAE (), "Marks & Spencer" UAE (), "H&M" UAE () Data Points Needed: Product name Product category Price Product description Product images (URLs) Shop Address Shop working hours Any available produ...

I'm in need of a professional who can extract video links from a streaming service and enable me to embed these on my website. The essential requirement is for the videos to be playable directly on my site. Ideal skills and experience for the job include: - Knowledge of web scraping and link extraction - Experience with embedding video links on a website - Proficiency in web development - Familiarity with streaming services - Demonstrable integrity and respect for copyright laws

I need Power Automate Desktop developer to help me capture a certain data filed on a web page.

...and optimizing the platform for high performance to support many concurrent users. The ideal candidate should: Be proficient in Symfony, Vue.js, PHP, and MySQL. Have experience working with legacy systems and migrating/upgrading older frameworks. You must be heavily using AI tools like ChatGPT o1 and sonnet 3.5 to accelerate development and ensure quality output (I will provide access to best LLMs if you need) Be able to work independently and provide regular updates. Provide clear documentation for all changes, work using my github repo, including migration steps, setup instructions, and code comments. Proven track record of optimizing high-traffic websites. Familiarity with database optimization techniques (indexes, partitioning, query optimization). Current Stack: B...

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.

...team. - Scope of Work: * Set up WhatsApp Business API or appropriate version for business communication. * Create guidelines for internal messaging, including response times, message formatting, and usage protocols. * Develop a task coordination process that leverages WhatsApp features, ensuring all team members are aligned and accountable. * Integrate a project management approach using WhatsApp capabilities to monitor progress and share updates efficiently. - Ideal Candidate: * Experience with WhatsApp Business API or other communication tools integration. * Strong understanding of internal communication strategies. * Proficient in project management and coordination. * Ability to provide training to team members on new systems and protocols. This pro...

I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).

I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.

I am in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance the efficiency of my data collection process. ...

I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.

Description over freelancer and Video Call

We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximity to transport, schools, pa...

Transform Excel Sheet Data to Charts and Stats using Power BI, we need interpretation for each chart.

I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated

I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.

...format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless for real-time or near realtime data viewing Key Data to be Scraped: - Content: The main focus will be on text messages. - Timestamp: I need to know when each message was sent. - Message Content: The actual text of the messages. Please note, I do not require data on user profiles or media files, just the text messages and their timestamps. Freelancer for this project should have: - Experience with web scraping, particularly on Telegram. - Knowledge of data extracti...

A need a content writer to write content for DATA SCIENCE COURSE using R programming and Python programming. Reference websites 1. Acte 2. Besant technologies 3. Simpli learn 4. I need to know the budget and timeframe. It should be pragarism free. No chatgpt no ai tools. Proper content writers alone with technical knowledge apply.

I need a skilled web scraper to assist with my real estate business. This involves scraping a real estate website that updates daily with 2,000–3,000 listings. The goal is to extract and match the data with realtor needs from my internal database. Requirements: - Daily scraping of 2,000–3,000 listings. - Extract relevant data such as price, property type, location, realtor name, contact info, and more. - Basic matching for a specific region. Budget: I’m ready to pay $40/month for this service. Ideal Skills: - Proficient in web scraping techniques and tools. - Experience in data extraction and analysis. - Familiarity with real estate data is a plus. - Able to perform basic data matching. Note: Please be aware that the listings will n...

...requirements and deliver tailored solutions. ● Implement robust data models and structures to support business intelligence and analytics. ● Apply advanced Python programming techniques and leverage libraries like Pandas and NumPy to solve complex data challenges. ● Utilize relational databases and ORMs (e.g., SQLAlchemy) effectively for data management. Technical Skills Must-Have Skills ● Python Programming (Advanced): ○ Comprehensive knowledge of syntax, semantics, multi-threading, multi-processing, regular expressions, and exception handling. ○ Expertise in libraries such as Pandas and NumPy. ● ETLPipelines: ○ Proficiency in designing and implementing ETL pipelines for large-scale data projects. ● Object-Oriented Programming (OOP) (Intermediate): ○ Unde...