Perl web data scrapingроботи
... "XLM/USDT","STX/USDT", "ICP/USDT", "EGLD/USDT", "ZRX/USDT", "LUNA/USDT", "MANA/USDT", "TWT/USDT", "CHZ/USDT", "HNT/USDT", "KSM/USDT", "NEAR/USDT", "BTT/USDT", "PEPE/USDT", "GRT/USDT", "APT/USDT", "QKC/USDT","RUNE/USDT", "WBTC/USDT", "FLOW/USDT", "ONE/USDT", "BAT/USDT", "RGT/USDT", "REN/USDT", "MITH/USDT", "TOMO/USDT", "NANO/USDT", "LOOM/USDT", "JOE/USDT", "DODO/USDT", "TLM/USDT", "CELR/USDT", "PERL/USDT","KNC/USDT", "CTXC/USDT", "...
I'm seeking a proficient Python developer with substantial experience in web scraping, specifically in image extraction. - Data Type: The primary focus of this project is scraping images from various online sources. - Sources: The specific sites for scraping can be discussed and will be determined based on your expertise and suggestions. - Output Format: The images will need to be stored in a manner that can be discussed further, depending on the scale of the project. Ideal freelancer should have: - Proficiency in Python and web scraping libraries such as BeautifulSoup and Scrapy. - Previous experience in image scraping. - Ability to suggest optimal sources for image scraping. - Good communication skills for discussing ...
I'm looking for a Python developer who can create a script for me. The script should: - Take a Wayback Machine page url as input - For each feature listed on , determine if the feature is implemented on the Wayback Machine page by analyzing the page's HTML and CSS stru...Support all versions of all major browsers. - Output the feature compatibility list as a CSV file with four columns: wayback machine page root url, browser name, browser version, feature implemented yes/no. The freelancer should also provide a short document (1-3 pages) detailing how the script works. The ideal freelancer for this project should have extensive experience in Python scripting and web scraping, and they should understand CSS and HTML. Familiarity with the Wayback Machine and is a ...
...for a skilled Python or JS developer with expertise in web scraping, Selenium, and HTML parsing to enhance and complete a job scraping tool for the Adzuna job portal. Project Goals: code must fetch all job listings from Adzuna for a given search query URL (e.g., ). Handle cases where JSON-LD data is missing by falling back to HTML parsing to extract all relevant details. Current Issues: my code scrapes some job data (titles, descriptions, company names, etc.), but many fields remain blank. Not all job listings are fetched; the script currently stops at ~157 jobs out of ~410 listed. Fallback HTML parsing is insufficient, leaving many fields incomplete. Requirements: Comprehensive Data Extraction: Fetch all job listings from Adzuna for the
I am seeking a seasoned Selenium and Python professional who can assist me with automating the scraping of data from various e-commerce sites. Ideal Skills and Experience: - Proficient in Python and Selenium - Strong experience in web scraping - Familiarity with e-commerce websites - Understanding of data extraction and processing - Knowledge of legality and ethics in web scraping Please note, while the primary focus is on scraping product information, the scope may extend to other types of data as needed.
I'm in need of a Python expert who can assist me with a web scraping project. The primary focus of this project is to scrape user data from various websites. Skills & Experience Required: - Extensive knowledge and experience with Python, particularly in web scraping libraries such as BeautifulSoup, Scrapy, etc. - Familiarity with handling and parsing user data. - Prior experience with web scraping projects. - Understanding of ethical considerations and legal restrictions related to web scraping. - Ability to deliver clean, well-documented code. Please note that the exact websites from which data needs to be scraped will be determined later, so flexibility and adaptability are key.
I'm looking for a skilled web scraper to help me extract data from HTML tables on a website and input it into a Google Sheet. Key details: - The data is updated every 30 minutes, so I need someone who can set up a server that handles this automated process - The tables contain mixed text and numbers. Attention to detail is crucial as the data will need to be accurately transcribed. Ideal skills for the job include: - Proficiency in web scraping tools and techniques preferably selenium - Experience with Google Sheets API. - Strong attention to detail and ability to handle mixed data types. I look forward to your bids.
I'm in need of a Python Selenium expert for a project. While the specific details are still being finalized, the ideal candidate would be someone with: - Proficiency in Python and Selenium - Experience in web scraping, automated testing, and browser automation - Flexibility to adapt to different types of web applications - Capability to support automation across multiple browsers Please reach out if you have the necessary skills and experience.
...educational materials, such as full-length lectures and PDFs, into concise and easily digestible formats like video snippets, infographics, and text summaries. The goal is to enhance learning efficiency by transforming complex information into byte-sized content. Key requirements: - The system should be able to process a variety of sources for content generation, including full-length lectures, PDFs, and web articles. - It should also be capable of incorporating interactive elements into the summarized content, such as quizzes, clickable links, and interactive diagrams. Ideal skills and experience for the job: - Proficiency in developing systems powered by Large Language Models. - Experience with content summarization and transformation. - Ability to create interactive elements...
An AI-powered data extraction tool for marketing sector. The tool would be designed to scrape data from multiple sources, including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The ...
Instructions for Data Scraping Task Your task is to extract specific information from job posting links. Below are the detailed requirements: Data Points to Scrape: 1. Company Information: - Company Name - Company Details: Brief about the industry or type of work they do. - Company Website - LinkedIn Page: URL to the company’s official LinkedIn page. 2. Email IDs (3 Required): - Find 3 individuals' email IDs from the following departments: - Admin - Human Resources - Head of Sales/Top Leadership (CXO level in Sales) - Marketing Head/Top Leadership (CXO level in Marketing) - Founders/CEOs/Co-founders/Owners 3. Email Requirement: - The email IDs must be professional (e.g., `name at `). - Avoid generic emails...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and Yo...Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I e...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I need to extract data from and update my Shopify store. The existing products in my store must be updated with the following parameters: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Inventory by Variant - Variants (color, size, etc.) - SKU If the products on the supplier's site are not in my store, they should be created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I un...
I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.
I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.
...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data's from the state...
...site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site : Check the above websites and need something similar ASAP
I'm seeking a skilled data scraper to extract stock prices from Yahoo Finance. The data should cover both the NYSE and NASDAQ. Key Responsibilities: - Scrape real-time and historical stock prices from Yahoo Finance. - Implement data scraping in a way that it can be run periodically. - Store the scraped data into a MySQL database using "INSERT ON DUPLICATE KEY UPDATE" to handle potential duplicates. Ideal Skills: - Proven experience in web scraping, particularly finance data. - Strong knowledge in MySQL and data management. - Familiarity with Yahoo Finance and stock market data. Please bid if you can provide a prototype and have experience in similar projects.
I'm seeking an experienced researcher to compile a detailed list of private drum instructors across the entire East Coast of the US and Canada. T...enhancing outreach and potential engagement. Key Responsibilities: - Research and document private drum teachers who possess personal websites showcasing their drumming and teaching services. - Gather and verify essential contact details: First Name, Second Name, Email, Web URL, City. - This project requires search engine research and music teacher directories, NOT LinkedIn scraping. Deliverable: - The final list should be delivered in a Google Sheets or excel document. Ideal Skills: - Proficient in web research and data collection. - Familiarity with music teacher directories preferred. - Previous experience...
I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and provide updates on their progress. Thank you for considering my project.
I'm in need of a seasoned sales professional with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note...
I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.
Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.
I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters
I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters
I need assistance with extracting data from a PDF and placing it into an Excel format I will provide. Key Requirements: - Data extraction from the PDF should be done according to specific column headers in the provided Excel format. - Minor data cleaning is needed during the extraction process. Ideal Skills: - Experience in data scraping. - Proficient in Excel. - Attention to detail for data cleaning.
An AI-powered data extraction tool for marketing sector. The tool would be designed to scrape data from multiple sources, including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The ...
I'm looking for a skilled professional who can suggest a reliable, low-latency proxy service for my web scraping project. The script currently targets public APIs and without a proxy, it's taking around 200ms to hit the endpoints. With a proxy, I need the latency to be between 300-500ms max. Key Requirements: - The proxy service should be located in Australia - The IP rotation level should be low, with only a few changes per day - The service should not require any specific authentication methods, as the APIs I am using do not require authentication I've previously tested several proxy services but most of them resulted in latency around 750ms, which is not suitable for my needs. Please only bid if you have experience with a proxy service that has a latency u...
Another scraping project - Need cover art based on ISBN and Author Name
I need someone to scrape data from a service guide website into a Google Sheets document. The data includes Company Name, address, Name, email, phone, mobile, website etc etc from 9632 entries across 20 categories. Ideal candidates for this project should have: - Proficient data scraping skills - Experience with Google Sheets - Attention to detail to ensure all data is accurately captured from all 20 categories.
...content (photos/videos) through direct messages (DMs). A unique aspect of is that media is sold as if it is being sent "live" in real-time, even though the content is pre-uploaded and organized in sequences called scripts. However, does not currently offer an API. This means the AI will need to interact with the platform through alternative methods, such as browser automation or scraping techniques, to send messages, manage media, and perform other tasks READ REQUIREMENTS IN DOCUMENT BELOW...
I'm looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone numbers, from various sources. Key Requirements: - Proficiency in data scraping from company websites, business directories, and social media platforms. - Experience in lead generation. - Expertise in logistics, warehousing, and ecommerce sectors is a plus. Ideal Skills: - Data mining - Web scraping - Lead generation - Knowledge of ecommerce and logistics industry
I'm ...restaurants in the Australian Capital Territory for a new food delivery app. The list should encompass all types of eateries – from fine dining to fast food. Key Requirements: - Data Points: The list must include the restaurant's email addresses, phone numbers, website URLs, full addresses, as well as their Facebook pages, Instagram handles, X profiles, TikTok accounts, and YouTube channels. - Type of Restaurants: All types, not limited to a specific category. Ideal Skills: - Data mining and web scraping - Market research - Familiarity with the Australian restaurant scene is a plus Please note, the main purpose of this data will be to support the launch and growth of a new food delivery app. Your expertise and attention to detai...
...system must scrape stock recommendations from a designated website, which only provides BUY signals, up until 3:30 PM. - Trades should be automatically executed in MTF (Margin Trading Facility) options. - The system needs to ensure seamless, real-time order placement without any manual intervention. The system should check for new stock recommendations every minute. Ideal Skills: - Proficient in Web Scraping, particularly with tools like BeautifulSoup, Selenium, and API integration. - Experienced in working with Trading APIs, specifically Angel One. - Skilled in Python or Node.js for automation. - Previous experience in algorithmic trading and order execution is a plus. This is a freelance project, not a full-time job. Please provide examples of similar projects you'...
Start your reply with SCRAPER. Won't r...any other post. I need a script that can scrape text and articles from a specific site and similar ones. The data should be delivered in a CSV file. The script only needs to run once. Ideal skills and experience for this job include: - Proficiency in web scraping tools and programming languages such as Python, Beautiful Soup, Scrapy, or similar. - Experience with data formatting and export to CSV. - Knowledge of how to make the script compatible with similar sites. Please include examples of previous similar projects in your bid. We have a tight budget as we know this is an easy job. We don't need the outcome. We need the script. Starting point: Data to be scraped on the next page of an item o...
Title: Web Scraper Needed to Extract Data from UAE Websites: - "Mango" - "Marks & Spencer" - "H&M" Description: I am looking for an experienced web scraper to build a script that can reliably scrape product data from the "Mango", "Marks & Spencer" and "H&M" UAE websites. The end goal is to produce a CSV file for each brand containing all relevant product information as well as provide the code used for the scraping process. Project Requirements: Websites: "Mango" UAE (), "Marks & Spencer" UAE (), "H&M" UAE () Data Points Needed: Product name Product category Price Product description Product images (URLs) Shop Address Shop working hour...
I'm in need of a professional who can extract video links from a streaming service and enable me to embed these on my website. The essential requirement is for the videos to be playable directly on my site. Ideal skills and experience for the job include: - Knowledge of web scraping and link extraction - Experience with embedding video links on a website - Proficiency in web development - Familiarity with streaming services - Demonstrable integrity and respect for copyright laws
I need Power Automate Desktop developer to help me capture a certain data filed on a web page.
Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.
I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).
I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.
...in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance...
I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.
Description over freelancer and Video Call
We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximity to transport, scho...
I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated
I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.
...platform's limits. The goal is to create a 24/7 with near realtime data and create either an application dashboard or simple csv with pivot/histogram for an easy visualization. Someone who already worked on similar request is preferred to avoid number being blocked so scheduled breaks are required in the code. Request is only to get the content and put in the easy readable format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless for real-time or near realtime data viewing Key Data to be Scraped: - Conte...
