Веб-скрапінг Jobs

Hello, i have scrap python script, but i am wondering if it is possible to get better result of it. As example scrap url attached. Output result is like ~130000 products, but they have over 200 000 active products, i know why this lot is missing, because pigu shows 150 pages of specific category items, one page only has 60 items, so if the category has more than 9000 products, other is missing, my question if there are any possibility to scrap the rest products which is missing?

I'm in need of a Python expert who can assist me with a web scraping script. This script will fetch data from a financial website and extract specific content from PDF files. Key tasks: - Daily data fetching from a specified website - Text and financial figures extraction from PDF files - Sending alerts through WhatsApp Business API Future support may be required for further development or troubleshooting. The ideal freelancer for this task would be someone with extensive experience in Python and web scraping, as well as the ability to interface with WhatsApp and manage PDF file reading.

Desarrollar herramientas para el dia a dia de los medicos

I'm looking for an automation expert proficient in UiPath to help me automate a task on my PC. The task involves taking screenshots of the center area of my screen whenever the image displayed changes. Key Requirements: - Setting up UiPath to capture screenshots from the center area of the screen - Implementing a periodic interval check to trigger the screenshot - Ensuring the screenshots are sent to ChatGPT The entire process should be handled by the RPA tool (UiPath) to ensure it runs automatically whenever the screen content updates. You should have experience with: - UiPath - RPA (Robotic Process Automation) - Integrating with APIs (specifically ChatGPT) Set the periodic interval check to trigger every 77 seconds.

I need a simple website with a backend addon to store user data. Django python bootstrap

I'm looking for an experienced Python developer to create a bot for me. This bot will sends requests and gets responses. Key Requirements: - Proficiency in Python - Experience in creating automation bots Ideal Skills: - Knowledge in handling requests and responses - Familiarity with Python's libraries for bot development explain more via anydesk

i have a list of 12k person names, their university name and their title. i need their email addresses. check the attach file. my price is final and i need in 25 days ,

I'm looking for an automation expert proficient in UiPath to help me automate a task on my PC. The task involves taking screenshots of the center area of my screen whenever the image displayed changes. Key Requirements: - Setting up UiPath to capture screenshots from the center area of the screen - Implementing a periodic interval check to trigger the screenshot - Ensuring the screenshots are sent to ChatGPT The entire process should be handled by the RPA tool (UiPath) to ensure it runs automatically whenever the screen content updates. You should have experience with: - UiPath - RPA (Robotic Process Automation) - Integrating with APIs (specifically ChatGPT) Set the periodic interval check to trigger every 77 seconds.

I'm seeking a skilled data engineer to help me finalize my web scraping scripts. I have 5 scripts for 5 betting websites in python, that are saving data in sqlite3 db. I need someone to merge the scripts into one, and to format the data and saving process so that comparing odds is easy. Ideal Skills: - Proficient in Python and libraries such as requests, selenium and sqlite3. - Experience with web scraping and data extraction. - Understanding of online betting platforms is a plus. Since majority of the scripts are finished, this shouldn't be a long task for knowledgeable person. Our maximum budget for this project is $17.

I am in need of a skilled data scraper with experience in extracting social media statistics. The project entails scraping data from TikTok creators and inputting it into a Google Sheet. Key Requirements: - Data Points: I need the follower count, total views, likes, and Affiliate GMV (past 30 days) for each TikTok creator. - Frequency: The data needs to be updated in real-time, reflecting any changes as they occur. - Google Sheet Format: All data should be compiled in a single Google Sheet, tracking all creators. Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiar with TikTok's platform and its creators - Experience with Google Sheets, including data organization and management - Ability to set up real-time data tracking and updating.

I'm seeking a skilled data scraper with extensive experience in handling large datasets to compile a comprehensive spreadsheet of WordPress plugins from the official directory. Key Responsibilities: - Extract and compile data for over 58,000 WordPress plugins. - Data points to include: plugin name, release date, last update date, number of ratings, rating, and link to the plugin. - Prepare the final output in Excel (.xlsx) format. Future Potential: - A possibility exists for future projects requiring additional data fields. Ideal Candidate: - Proven experience in data scraping, particularly at a similar scale. - Proficiency in Excel and data management. - Strong attention to detail for accurate data collection. - Ability to potentially handle future projects with more complex data ...

I'm seeking an expert web scraper to collect both text and video content from a specific website in real-time. The videos need to be in m3u8 format. Key Requirements: - Proficient in web scraping techniques - Able to handle both text and video - Can deliver video in m3u8 format - Able to scrape data constantly in real-time Ideal Skills: - Web scraping tools like Python, BeautifulSoup, Scrapy etc. - Experience with live API data collection - Video format conversion knowledge - Ability to implement a robust, reliable scraping solution Updates should be provided every 300ms.

Necesito recopilar la totalidad de las direcciones de email contenidas en un registro de agencias de viajes (cerca de 5000 correos). Estas son de acceso público pero hacerlo manualmente me llevaría una eternidad. Seguramente alguien con conocimiento en IA pueda recopilarla de manera automatica

I'm looking for a data analyst/programmer who can create a program that scrapes and analyses data from multiple social media platforms over time. The primary goal of this project is to gather insights from social media posts on Twitter, Facebook, and Instagram. Key Requirements: - The program should be capable of collecting various data points, including: - User metadata (e.g., usernames, follower counts) - Post content and timestamps - Engagement metrics (e.g., likes, shares, comments) - The data should be analysed over a specified timeframe, allowing for the identification of trends and patterns. Ideal Skills: - Proficiency in data scraping tools and programming languages (e.g., Python, R) - Experience with social media data analysis - Strong understanding of user metadat...

We are seeking a professional data scraper to assist in scraping product information from various B2B portals and synchronising this data with our Shopify store and hundreds of more stores, as we run the biggest e-commerce network in Sweden. Key Responsibilities: - Scrape data from distributor and supplier portals, under credentials. - Match product details including stock levels, pricing details, and product descriptions to our Shopify store. - Perform this data sync at least three times a day for approximately 100 stores x 20 portals, with more stores being added will not be 100 from the start, but as many as you can manage. Context: - We are a retailer running the largest e-commerce network in Sweden, selling other brands' products. - Each client we cater to has at least 30 po...

I'm looking for a professional data scraper to help me with a one-time download of product images, videos, and descriptions from various e-commerce sites. Ideal Skills: - Proficient in web scraping techniques - Familiar with e-commerce platforms - Able to deliver high-quality, organized data Experience: - Prior experience with data extraction from e-commerce sites will be highly valued.

I'm in need of a Python developer capable of creating a real-time soccer goal alert system. The main function of the system will be to notify as soon as a goal is scored. It should faster than Key Features: - The system should be able to deliver alerts instantly, with priority given to speed and reliability. - Alerts need to include the scorer's name and the time of the goal. Data Sources: - The system should utilize third-party sports data providers or custom web scraping solutions for real-time soccer updates. Alerts: - The system should simply send information when a goal is scored. Further processing will be handled on my end. Ideal Freelancer: - You should have relevant experience in handling real-time soccer data and building alert systems in Python. - If you can prov...

I'm looking for a skilled web scraping developer to refine and complete my monitoring tool for E-commerce sites. The UI has already been developed using customtkinter, and the source code is attached. The tool needs to scrape real-time updates from various E-commerce sites. I would appreciate it if you could also enhance my existing codebase for better performance and reliability. Key Requirements: - Proficient in web scraping - Expertise in Python and customtkinter - Ability to optimize existing code - Experience with E-commerce sites Please apply if you have the relevant skills and experience.

I need someone to build a web-scraping script in Python to extract data from a website and export as a csv. The data are organized in table format and the key logic is just to loop the pages. The HTML for the website is relatively neat. The freelancer should be a Singaporean citizen or permanent resident because the website is accessible via NLB portal. There are several modules to the project and the smooth cooperation for the 1st module could lead to the next. Scope and price of the project is subject to further private discussion. The script should be written in Python using Selenium Chrome driver.

I'm looking for a skilled web scraping expert, particularly with experience using Phantom Buster and similar tools. The primary goal of this project is to extract product information from various retail brand sites for analysis. Key Requirements: - Proficient in web scraping, specifically using Phantom Buster. - Experience with data extraction for analysis. - Ability to scrape data from retail brand sites and other sites. Ideal Skills: - Knowledge of e-commerce and retail brand sites. - Strong analytical skills to process the extracted data. - Previous experience with web scraping tools and techniques.

I'm looking for a freelancer to assist with data entry, specifically inputting financial data into a spreadsheet. This is a part-time, work-from-home opportunity that could be a great fit for those looking for flexible, remote work. Ideal Skills: - Proficiency in Excel or similar spreadsheet software - Attention to detail - Experience with data entry, specifically financial data Please note that this role requires a high level of accuracy and confidentiality due to the sensitive nature of financial data. Data will need to be updated on a daily basis. The freelancer will also be responsible for data validation.

I'm looking for an expert proficient in developing web scraping applications. My project requires regularly scanning around 100 websites to monitor newly posted news (press releases from PR departments) and collecting them in one place. The updates (monitoring) should occur every 30 minutes. Whenever a new press release appears, the program should download the article or the link to the article along with an image. Next, AI will automatically modify the article by generating a new title, introduction, and main body text, and resize the image to the required dimensions. The article will then be posted in the admin system of an already functioning website, along with a notification (via SMS or email) about the new update. My task will be to review the news item for accuracy and either p...

I'm looking for an expert proficient in developing web scraping applications. My project requires regularly scanning up to 100 websites (that I will provide) to monitor newly posted news (press releases from PR departments) and collecting them in one place. The updates (monitoring) should occur every 30 minutes. Whenever a new press release appears, the program should download the article or the link to the article along with an image. Next, AI should automatically modify the article by generating a new title, introduction, and main body text, and resize the image to the required dimensions. The article will then be posted in the admin system of an already functioning website, along with a notification (via SMS or email) about the new update. My task will be to review the news item fo...

I'm seeking help with my scrap projects. The final product will be for personal use... Ideal Skills and Experience: - scrap work is to be export in excel - small project - either use c# language or python..... -

I'm seeking a data scraping expert capable of generating 2400 leads of specialist doctors from across the nation every month. These leads should be sourced primarily from Google My Business and include the doctor's name, their email, their professional website, and their phone number. Key Requirements: - Data scraping expert with a proven track record in lead generation - Consistent monthly delivery of 2400 leads - Nationwide coverage, specifically targeting specialist doctors Ideal Skills: - Proficient in using web scraping tools - A good understanding of e-commerce, real estate, and technology startups - Strong attention to detail to ensure lead accuracy and completeness

I'm in need of a skilled webscraper to gather residential contact information in Mary Esther, FL, Fort Walton Beach, FL, and Navarre, FL. I require the full name and phone number as well as the full name and email address of each residential contact. The information will be used for marketing purposes. Ideal skills and experience for this job include: - Proven experience with web scraping - Familiarity with data handling and privacy regulations - Ability to deliver accurate and clean data in a timely manner.

I need someone who have access to LinkedIn and YouTube APIs for testing . I need it for testing if anyone have do apply on this project

I need a web crawler to extract contact details from various websites. Initially, the focus will be on company websites and possibly other platforms, but specific platforms will be determined in the course of the project. The crawler should be adaptable and able to handle a variety of different site structures and types. Ideal Skills and Experience: - Proficient in Python or similar programming language - Experience with web scraping - Familiarity with data extraction tools - Can work with structured and unstructured data - Understands compliance and ethical considerations in data extraction. Please provide examples of previous web crawling projects you have completed.

I need a freelancer with advanced knowledge of scraping and API requests. automate some pages and get information from them in python or another language The data will be stored in Python for analysis.

I need a Python script that utilizes SMTP or API call to verify a variety of email addresses (corporate and personal) and return whether they are valid or bounced. The script should be open-source and can optionally store results in a database. Ideal Skills: - Proficient in Python - Experience with SMTP - Knowledge in email verification techniques - Familiarity with open-source software - Database management skills (optional) Please include in your bid examples of similar projects you have completed.

I need a skilled web scraping expert with API experience to create a website that extracts and displays real-time mutual fund performance data from Morningstar. Key Requirements: - Designing a user-friendly website for real-time data display - Implementing web scraping techniques to gather fund performance data from Morningstar - Ensuring the website is able to handle and accurately display large amounts of data Ideal Skills and Experience: - Proficiency in web development - Extensive experience in web scraping and API integration - Familiarity with mutual fund performance data - Prior work with Morningstar is a plus.

I'm in need of a professional who can help me with a daily data scraping task. The specifics of the project are as follows: - Data Type: Fetch and track number of tickets sold for a specific movie from multiple portals like bookmyshow, paytm, fandango,etc across the world. - Scraping Frequency: The data needs to be scraped on a hourly and daily basis. This project requires a freelancer with experience in data scraping, particularly from public sources. Skills in Python, web scraping libraries (like BeautifulSoup, Scrapy, Selenium) and data handling are crucial. Different programming languages are also welcomed. Please note that the flexibility and adaptability are key. References will be provided for interested freelancers

I'm seeking assistance to enhance a web scraping tool I've developed over the past year. The tool scrapes jobs from various job boards, filters them through a Python script, utilizes OpenAI for improved filtering, and finally compiles the results into a Google Spreadsheet. Key Project Parts: - Python Script: Your primary focus will be enhancing the filtering criteria and improving UI. - UI Development: You will also be responsible for maintain and improving a small React/Flask app that displays the filtered jobs. This UI should provide job and company information. It's very small and simple right now. It takes info from a spreadsheet and displays it more attractively. Ideal Skills and Experience: - Proficiency in Python, React, and Flask - Experience with web scraping an...

I'm seeking an organized and detail-oriented freelancer to help me gather comprehensive data on all Acroyoga festivals worldwide. The goal is to eventually create a centralized and structured database that can replace existing platforms. Your initial tasks will include: - Collecting data from various sources, with a primary focus on festival organizer websites. - Gathering a wide range of details about each festival, including names, dates, locations, contact details, descriptions, accommodation types, food services, and relevant links etc.. - Organizing this information in a Google spreadsheet in a structured and easy-to-update format. This project requires: - Excellent research skills - Proficiency in Google spreadsheets - Attention to detail - Ability to synthesize and organize l...

I'm looking to automate the validation process on two URLs we currently use manually. The primary goal of this project is to reduce manual effort. Specific tasks: - Currently, we use these URLs for validation. The kind of validation needed: - URL validation. The ideal freelancer for this project should have: - Strong automation skills. - Experience with web URL validation. - Knowledge of data validation and process automation.

daily Stocks data with trading indicatives by python python code to get NYSE stocks all tickers historical data download for free downloading acceptance criteria I can YOUR PYTHON CODE by myself on my WINDOWS computer each day new indicators for last 5 years data saved to csv file all indicators for all nyse tickers from attached file will be downloaded by provided python file without lost days and without lost indicators list of all NYSE current tickers will be provided and used in code *** 1 indicators for Order flow or trade data *** **** 2 indicators ***** VWAP DPO CMF Elliot waves Fibonacci numbers *3 Technical Indicators:* 1. Moving Averages (MA, EMA, SMA) 2. Relative Strength Index (RSI) 3. Bollinger Bands 4. Stochastic Oscillator 5. MACD (Moving Average Conve...

I'm looking for a Python expert who is able to automate the trading process for me. This script must be capable of placing trades automatically and executing it smoothly. I have code for login trading accound and fetch token data. I need to update code to my system. I need to collect live data from the web and candle stick, Mins Intervals are in Dropdown box, I can choose any minutes interval, I need you to collect Last 10 candle data from the Excel in the web and other details for each token, I will give token name in the excel, It will automatically display the rows of data. If i chanage time interval it will display those data only. i need it like application Broker: Note: I dont know about coding, If you install the code and run successfully at my system thereafter I will hire ...

As I don't have time to create the automation, I'm looking for someone with automation skills to help click an answer on a form. The form could be from a website like Strawpoll, and could also be through Facebook and Instagram. It can be automated to repeat clicking on the same answer every 15-30 mins, and from different IP addresses. Key Requirements: - Proficiency in automation tools - Understanding of social media platforms, specifically Facebook and Instagram - Experience in managing multiple IP addresses, proxy, vpn, etc Your should reflect your expertise and experience in these areas.

I'm looking for an experienced data scraper who can collect comprehensive real estate data for all types of properties. The primary goal is to gather latitude and longitude information from various sources, excluding brokers. Key Responsibilities: - Scrape real estate data from credible online platforms, focusing on all types of properties. - Collect and organize data, particularly latitude and longitude coordinates, for easy analysis. Ideal Skills: - Proven experience in data scraping, preferably in the real estate sector. - Proficiency in using data scraping tools and software. - Ability to work independently and deliver quality work within the specified time frame. please find attachement we have required this type of Xlxs sheet of whole website data from NO Broker

I am seeking a data scraping expert to extract customer reviews from various e-commerce platforms, specifically Walmart, Uber Eats, Google, and DoorDash. The data will need to be stored in a structured database for easy access and analysis. Key Requirements: - Scraping customer reviews from specified platforms on a weekly basis - Storing the scraped data in a structured database - Experience with data scraping and database management - Familiarity with e-commerce platforms is a plus Ideal Skills: - Proficiency in data scraping software/tools - Database management skills - Attention to detail and ability to follow instructions This project is perfect for someone who is experienced in data scraping and has a keen interest in e-commerce. I look forward to your proposals.

I'm seeking a detailed list of CEOs and CFOs from all industries. The data should include: - Full names and contact details - Company names and tenures The final dataset needs to be delivered in a Spreadsheet format (Excel/CSV). Ideal candidates should be proficient in data mining and have experience in executive contact list generation. The ability to ensure data accuracy and confidentiality is paramount.

I'm looking for someone to assist me with a project involving a data set of different food types. The data set is in a spreadsheet format and includes mixed types of foods, from packaged to fresh produce. Key Responsibilities: - Analyze the provided food data set - Research and append the appropriate caloric values to each food item using MyFitnessPal as the primary source Ideal Skills and Experience: - Proficient in data entry and analysis - Familiarity with MyFitnessPal - Previous experience with food data sets is a plus - Attention to detail to ensure accuracy in calorie information I need it within a week. The accuracy of the calories added is crucial for this project.

I am looking for a skilled data scraper with experience in integrating with Shopify. The objective is to scrape various business-to-business portals and distributor websites for product details, stock levels, and pricing information. The scraped data should be formatted for API use. Key Responsibilities: - Scrape multiple B2B portals and distributor sites for relevant data. - Directly upload scraped product details to Shopify. - Update stock levels on Shopify in almost real-time to match the distributor sites. - Ensure pricing information is consistently updated and accurate. Ideal Skills & Experience: - Proficient in web scraping tools and techniques. - Prior experience with Shopify integration is a must. - Familiarity with B2B portals and distributor websites. - Strong attention t...

I am seeking a data scraping expert to extract customer reviews from various e-commerce platforms, specifically Walmart, Uber Eats, Google, and DoorDash. The data will need to be stored in a structured database for easy access and analysis. Key Requirements: - Scraping customer reviews from specified platforms on a weekly basis - Storing the scraped data in a structured database - Experience with data scraping and database management - Familiarity with e-commerce platforms is a plus Ideal Skills: - Proficiency in data scraping software/tools - Database management skills - Attention to detail and ability to follow instructions This project is perfect for someone who is experienced in data scraping and has a keen interest in e-commerce. I look forward to your proposals.

I require a Python program that will pull live, tick-by-tick data of Nifty 500 stocks. This data will include the Last Traded Price (LTP), Open, High, Low, Previous Close, and Volume. The program will feed this data into an Excel file (specifically, an XLSX format) using the Dhan HQ 2 API. This data needs to be updated every second. Ideal skills for this project include: - Proficiency in Python, particularly with handling APIs and data processing - Experience with leveraging Excel through Python (specifically creating XLSX files) - Familiarity with financial data and stock market terminology - Understanding of the Dhan HQ 2 API Your bid should reflect your experience with similar projects and your ability to deliver a program that meets these specific requirements.

I'm looking for a web scraper built in Javascript to extract data from vehicle ads on leboncoin.fr. The scraper will need to: - Walk through each vehicle ad - Send an email if the prospect allows being contacted by email - Send a mobile text message if the prospect allows being contacted on his mobile The ideal freelancer for this project should have experience with web scraping. The job will involve working closely with me as I build the user interface for my users. The scraper can either be built with Python or Javascript, however, I prefer the latter for this project so that I can have the whole code in a nextjs app with no need of an api. Your task will primarily involve extracting data from the ad itself and send messages to the contact. The triggering condition for sending a...

I am looking for an expert who can proivde Python code to run on our PC everyday. This website may need proxies and I want someone who is good at writing a nice code.

I'm looking for a script that can scrape websites like Amazon and Noon for various product information. The required data includes Product Name, Price, and Seller. The ideal solution is a Google Sheets or Excel based one, where I can simply feed the URL and get the data scraped. Key Requirements: - The script should be capable of scraping information from a list of URLs provided in a file. - The output data should be formatted in Google Sheets. - The script should be able to handle large data sets and URLs efficiently. Ideal Skills: - Experience in web scraping and data extraction. - Proficiency in Python or similar programming languages. - Familiarity with Google Sheets and Excel. - Ability to create user-friendly scripts.

I'm looking for an expert in data mining who can extract transactional data from both Email and Mobile Number sources. This data should be compiled and exported in JSON format. Key Requirements: - Data mining experience from both Email and Mobile Number sources. - Ability to extract various types of transactional data. - Proficiency in working with different data formats including Database, CSV and other unknown sources. - Skilled in exporting data in JSON format. Ideal Skills: - Data Analysis - Data Mining - JSON Formatting - Proficiency in Database and CSV manipulation - Strong attention to detail Please note, the data we're looking to extract is not limited to purchase history, bank transactions or subscription details. The scope is broader and includes all a...

Description: We are seeking an experienced automation specialist to develop a comprehensive workflow using (formerly Integromat) that automates our content creation and distribution process for our entertainment blog. The automation will involve sourcing articles, rewriting content, generating images, uploading drafts for review, publishing articles, and sending out newsletters with the most popular content. Project Scope and Objectives: Content Retrieval and Rewriting: Source Articles: For this example, automatically fetch the latest articles from (ensure compliance with their Terms of Service). Use their RSS feed, API (if available), or web scraping techniques. Content Rewriting: Integrate with OpenAI's GPT-4 or similar AI...