Aspnet web data scraping jobs

I'm looking for a fast Waze scraper that covers all of Australia. The scraper should not rely on Georss. It needs to collect data on traffic incidents and submit it to a provided API endpoint in real-time. Ideal Skills: - Data scraping - API integration - Python or similar programming language expertise Experience: - Previous work with Waze data is a plus - Demonstrated ability to build real-time data scrapers - Experience with large scale data collection

I need a Telegram scraper that will collect user data from specific groups on Telegram. This data will be used to create a contact list. Key Responsibilities: - Scraping data from members of designated Telegram groups - Compiling this data into a usable contact list Ideal Skills: - Proficient in data scraping - Experienced with Telegram's platform - Able to respect privacy and ethical guidelines in data collection

I'm running a furniture store on Shopify and need assistance with parsing data from my vendor's webpage. The main focus is to keep track of the inventory status. Key Requirements: - Monitor inventory status from vendor's webpage - Integrate this data directly into my Shopify store's database Skills and Experience: - Proficiency with Shopify platform - Experience in web scraping and data parsing - Knowledge of database management and integration This project is crucial to ensure my store is always up-to-date with the vendor's inventory. Looking forward to your proposals. The inventory data should be updated daily.

...process by: Fetching company data (milestones, benchmarks, achievements) to personalize emails dynamically. Integrating FluentCRM to automate email sending and tracking. Project Scope: 1. Automate Company Research & Data Extraction Use APIs (Google Custom Search, LinkedIn, Crunchbase, Clearbit, etc.) to pull relevant company insights. Extract key milestones, funding rounds, partnerships, product launches, and notable achievements. Format extracted data cleanly (JSON or text) to inject into AI-generated emails. 2. Enhance AI Email Generation in Flowise Ensure company insights are seamlessly integrated into OpenAI-generated email prompts. Optimize prompt structure for concise, personalized, and compelling messaging. Implement quality filtering to prevent irreleva...

...are looking for an experienced freelancer or team to extract data from a large volume of PDF files. Due to the scale of this task, we prefer candidates who can develop automated scripts for efficient data extraction or those with a team capable of handling bulk processing. Requirements: • Expertise in Python or other relevant programming languages for PDF parsing • Experience with libraries such as PyPDF2, PDFMiner, or similar tools • Ability to extract structured data accurately (tables, text, etc.) • Handling of different PDF formats and layouts • Data output must be in Excel (.xlsx) format per template provided. Preferred Qualifications: • Prior experience with large-scale data extraction • Strong attention to de...

I'm in need of a proficient data scraper who can extract the staff list from a specified university website. The data fields I require are: - Name - Email - Phone number - Department - Designation The scraped data needs to be delivered in CSV format. This is a one-time project, so I won't need recurring updates. Ideal skills and experience include: - Proficiency in data scraping tools and software - Experience with web scraping from .edu websites - Strong attention to detail for data accuracy - Ability to deliver data in specified format (CSV) Looking forward to your proposals.

I'm looking for a skilled developer to create a Windows application that scrapes data from e-commerce websites and updates it in a CSV file. Key Responsibilities: - The app should monitor and record product prices, stock levels, and sale prices. - Data should be sourced from various e-commerce websites. - Updated data should be formatted and saved in a CSV file. Ideal Skills: - Proficiency in Windows application development. - Experience with web scraping tools and techniques. - Familiarity with data formatting and file handling, particularly CSV files.

I'm seeking a web scraping and automation expert who can help me collect product details and pricing information from Amazon on a daily basis. Key Responsibilities: - Scrape product details and pricing information from Amazon. - Automate the process for daily hourly base data collection. Purpose of Data: - The scraped data will be used for market analysis and Price Competition. Ideal Skills: - Proficiency in web scraping tools and programming languages (e.g., PHP, C#, Javascript). - Experience with Amazon data collection. - Knowledge in data analysis and market research. - Automation skills to streamline the daily scraping process. - Bypass Captcha ... Please provide examples of similar projects you have compl...

I'm looking for an expert in web scraping to gather comprehensive data from and zoopla on properties that meet specific criteria. The data collection should include: - Property Details: Price, Location, Bedroom count, Rental Yield, BMV (Below Market Value), proximity to a station (within 2 miles), and Serviced Accommodation Rates. - Filters: Properties should be filtered based on a specific price range, their proximity to a station, and the number of bedrooms. - Add the type of property (e.g., apartment, house, townhouse) to distinguish different kinds of listings. Ideal candidates for this project should have vast experience in web scraping, preferably with real estate websites, and should be able to deliver a well-structured data s...

We are looking to create a database of contacts from four specific websites. We require as much information from each person in the database of these websites as they have publicly displayed. Data can be scraped and provided by excel or csv spreadsheets. This website is broken down by states across the United States. You have to click on each state to see all of the members in that state, and then open each profile individually. Under each country or state, you have to pen each company profile. We only care about contact information (phone, email, website, name, etc.). We don't care about listings. Here we can just collect the website information from each of the members. If possible

...trading system for me. This system should monitor live stock exchange data and take decisions based on some rules defined by me. Subsequently will place buy or sell orders for me.  There is NO API integration possibility! Key Features - Monitor live data and odds via web scraping methods. - Detect changes in real-time and take decisions. - Automate order placement based on rules. Order Placement Mechanics - One single click prepares an order with the correct amount. - A second click places the order instantly. The system should run on a cloud VPS for optimal speed and performance. Ideal Skills and Experience - Proficiency in Python, specifically with libraries such as Selenium, BeautifulSoup, and Requests for scraping and autom...

I'm seeking a programmer skilled in utilizing Sheetmajic AI for web scraping in Google Sheets. The purpose of this project is to scrape daily data from our local municipality page. The specifics of this project include: - Data Source: The local municipality page. - Data Type: Event schedules. Ideal candidates for this job should have: - Proven experience with web scraping. - Proficiency in Google Sheets and Sheetmajic AI. - Ability to deliver accurate and timely data.

I'm looking for a script that can import both automatically and manually products from Aosom to my Opencart store. Key Requirements: - The script...product imports from Aosom to my Opencart store. - Essential product details to be imported include: Product description, Product images, Product prices, Category, SKU, Weight, Dimensions, Color, Material, Age, Meta Description, Meta Title. - The script should transfer any tags associated with the products. Ideal Skills: - Proficiency in Opencart and its architecture is a must. - Experience with web scraping or automation scripts. - Knowledge of Aosom's product structure. - Ability to ensure the script can handle product variations and updates seamlessly. Please ensure your bid reflects your experience and understan...

...pull data from multiple sources, including different projects, documents, cloud storage services (Dropbox, S3), URLs, and media content (YouTube videos). The agent will process, clean, and store the extracted data for further analysis, search, and retrieval. 2. Objectives Develop an AI-driven system to aggregate data from various sources. Enable automated extraction, transformation, and loading (ETL) processes. Ensure seamless integration with cloud storage, document repositories, and media platforms. Implement Natural Language Processing (NLP) for document comprehension and YouTube transcription. Provide an API interface for querying and accessing the processed data. Support integration with various Large Language Models (LLMs), allowing flexibility i...

I'm looking for a skilled professional who can help me scrap a static site and migrate it to WordPress. The site primarily consists of blog posts, and new content is added on a monthly basis. - Ideal skills for this project: Web scraping, WordPress development, Data migration, PHP, HTML, CSS. - Experience: Previous projects involving static site migration to WordPress will be highly regarded. Please note: This project does not require the addition of any specific features to the WordPress site.

I'm looking fo...students to access college details, class schedules, and receive live notifications from a website. Here are the key aspects of the project: - The chatbot will primarily interact with a website. - It should provide information on admission requirements, course descriptions, and faculty information. - Live notifications should be sent via SMS. - We will use gemini LLM in back end for query - Web scraping a whole website I need the back end and Vector database Embedding I have a basic understanding of the tech stack, so please keep the explanations simple. We will approach this project through video calls where I will learn in real-time. Ideal skills for this project include chatbot development, familiarity with the mentioned tech stack, and excellent...

I need a Windows desktop application that can automatically book travel tickets from a public travel website like Expedia. The app should interface with a specific embassy website to perform these bookings. This app will save a lot of time and effort, and it should be user-friendly...and effort, and it should be user-friendly and efficient. Ideal skills for this project include: - Strong experience with Windows desktop app development - Proficiency in interfacing with public websites and APIs - Knowledge of travel booking systems - Expertise in creating user-friendly interfaces - Experience with automation scripting - Skilled in web scraping techniques for extracting data - Proficiency in ensuring API security and data integrity The application should provi...

I'm in need of a skilled data engineer to develop an automation scraper for me. The primary source for this project will be various websites, with the specific task of extracting the raw response from the API endpoint network response in JSON format. Key Requirements: - Development of a real-time data scraping tool - Experience and proficiency with web scraping - Ability to extract and process API network responses - Knowledge of working with JSON data - Familiarity with using Datadoom for data protection The ideal candidate for this project should have a strong background in data engineering, web scraping, and API interaction. If you are capable of creating a scraper that works in real-time and can handle the com...

...importing using excel or CSV or, if you're a true expert: you may even use XML. You will need to maintain these files. If we find out that an attribute was not defined, we want to make sure it will be easy for you to add the attribute and reimport the products adequately. Note: in some cases, product assets/attributes are contained in 3 files: PIES - ACES - Digital asset. You may need to merge that data to succesfully import a brand of products. - You will need develop a comprehensive understanding of our product. We will be there to support you; we understand that our products are not your typical t-shirt. - Import and/or Create products on our Magento 2 website, including configurable products and other types of special products. - Manage and maintain products in Quic...

... - MySQL - Python (FastAPI & Web Scraping) - Azure - Chrome extension development - Amazon SP-API - Shopify app development Key Responsibilities: - Design, develop, and maintain complex web applications using for server-side rendering and static site generation. - Architect database solutions using MySQL, ensuring performance, scalability, and data integrity. - Develop robust backend services and APIs using Python and FastAPI for high-performance API development. - Build and maintain Python scrapers to automate data extraction from various sources. - Design and implement Chrome extensions to enhance web functionalities. - Integrate with the Amazon Selling Partner API (SP-API) for e-commerce automation and dat...

I need a web crawler that can help me find local service providers in certain suburbs in Brisbane Australia. The crawler should be able to traverse the web and gather information on various service providers such as name, web address, email, phone number, contact name. The businesses i want to scrape are providers in: - Yoga - Physiotherapy - Personal Training - Chiropractor An example of the regions are Redcliffe, Kippa-Ring and Clontaf in Brisbane. Ideal Skills: - Proficiency in web crawling and data scraping. - Experience with Apify or similar web crawling platforms. - Ability to understand and implement data filtering based on potential future criteria.

...for an expert in UiPath studio who can help automate the application process for multiple grants and funding opportunities available online for my startup. Key Tasks: - Automate filling of every new funding application form with the data of my startup - Use UiPath studio on Windows (or any other such tool) - Take as inputs: my startup info and link of the application form - Utilize ChatGPT API to answer questions not covered in my startup info What I will provide: - Information about my startup: company description and history; employee and team details - Web URLs of application forms Please note that the application forms we will be targeting include both grants and funding opportunities. The ideal candidate should have experience with UiPath, knowledge of automation ...

I'm in need of a freelancer with robust data scraping skills to compile a comprehensive list of strata managers from Sydney CBD and its surrounding areas. This list should include: - Business Name - Phone Number - Generic Company Email - Direct Contact Email (if available) Your task is to collect as many accurate and up-to-date contacts as possible. Key Skills & Experience Required: - Proven experience in data scraping. - Ability to deliver clean and well-organised data. - Prior experience in similar projects will be an advantage. Please include in your proposal a brief outline of your intended approach for this task, as well as any relevant past experience.

...price-tracking - Integrate web-scraping capabilities for real-time data - Set up and manage the back-end database - Integrate payment gateways for in-app purchases - Implement push notifications for app users - Develop comprehensive search and filter functionality - Design an intuitive and user-friendly interface - Implement user authentication and authorization mechanisms - Integrate customer support chat or ticketing system - Optimize site and app performance for faster load times - Implement SEO best practices for better search engine ranking - Incorporate analytics tools to monitor user behavior Ideal Candidate: - Proficient in coding for both websites and mobile applications - Experienced in E-commerce site and app development - Knowledgeable in web ...

...professional Python developer with extensive experience in web scraping using Scrapy, data manipulation via MongoDB Aggregation Pipeline, JavaScript, and API development. The project encompasses all aspects of data extraction, processing, and integrating different technologies. Key Responsibilities: - Web scraping with Scrapy to extract data from various websites - Manipulating and processing the extracted data using MongoDB Aggregation Pipeline - Developing APIs by using FastAPI and Django for seamless integration of different technologies - Utilizing JavaScript where necessary for backend and frontend Ideal Skills and Experience: - Proficiency in Python, Scrapy, MongoDB, and JavaScript, Django, FastAPI - Extensive experience i...

...comprehensive data from various platforms including e-commerce websites, business directories, and social media profiles. The data should pertain to local businesses in specific regions, and only one specific industry. The data can be scrapped from catagories in a business directory but then Linked In will need to be scraped to find correct contact person. Data Needed: - Business Name - Type of Business - Contact Email - Contact Phone - Contact Person - Physical Address (divided into Street Number, Street Name, Town or City, State or County, Zip or Postal Code, Country) Regions to Target: - USA - Canada - UK - Australia - New Zealand The data should be neatly organized and delivered in a CSV Spreadsheet. Ideal Skills: - Proficient in data ...

...Saturday at my home in Santiago." Bot: "Here’s a summary. Does everything look good?" Client: "Yes, it’s perfect!" Bot: "Great! I’ll notify the specialist now." The specialist receives the request and reviews the details. Specialist: "I need a few more details before confirming the price. What’s the current wall condition? Any old paint that needs removal?" Client: "Yes, some areas need scraping." The specialist finalizes the quote. Scene 5: Payment & Final Steps (1:46 - 2:30) Visuals: The client receives the price, accepts, and makes an initial payment. Text on screen: Bot: "The specialist has sent their quote: $200,000 CLP. Do you accept?" Client: "Yes." Bot: &quo...

Necesito extraccion de datos de algunas webs con el objetivo de obtener leads para gestion de marketing

...requirement is simple. Visit the link You could see the hidden api

We are looking for an expert in scraping, APIs, and ERP integration to automate stock management and product substitution in case of shortages. Main Tasks: - Automate the consultation of internal and supplier stock levels. - Develop an alert system for stock shortages. - Integrate an intelligent substitution solution and update quotes in Sage. Preferred Technologies: Python, Web Scraping (BeautifulSoup, Scrapy), REST API, Sage. Estimated Duration: 2 weeks Work Mode: Remote freelance

I'm in need of a Python program that can scrape text content from 2 pages of one website. The primary goal of this project is to extract specific data for analysis. I want this program to have an desktop icon with a date range and output information to a csv file. I will need help setting up my computer with all the files necessary to run the program. Key Requirements: - Proficiency in Python and web scraping libraries (such as BeautifulSoup, Scrapy, or Selenium) - Ability to handle and parse text content from various web sources - Experience in data extraction and manipulation - Knowledge of best practices for ethical and efficient web scraping - Comment code so if the site changes, changes can be made easily - Will need help instal...

I need a skilled data scraper to extract specific text content from a website. The data I need is the "Video Uploader URL". The challenge is that this information is only visible on the page, not in the HTML. Ideal Skills and Experience: - Proficient in web scraping techniques and tools - Experience with scraping data from websites that block data from showing in the HTML - Knowledge of programming languages such as Python, with libraries like BeautifulSoup and Scrapy - Attention to detail and ability to deliver clean, structured data The data extraction is a one-time process, with no need for future updates. Please deliver the scraped data in a CSV file format. Please ensure that anti-scraping measur...

I'm seekin...videos from various sources: specific channels, keyword-based searches, and trending content. - Share these videos on my site with their respective descriptions, titles, and keywords. - Incorporate an automatic site map system, clearly defined sections, and ad placements. - Adhere to all necessary SEO requirements. The ideal candidate for this project should have: - Extensive experience with web scraping and API integration, particularly with YouTube. - Strong understanding of SEO and ad placement strategies. - Skills in creating user-friendly site sections and a seamless site map. Please note that the specifications for the types of videos, site sections, and SEO requirements are flexible and can be discussed further. Your expertise and suggestions will ...

...of performance to prevent site slowdowns. 2 – Match Sheet Configuration • Automatic linking between match sheets and player profiles. • Verification of the correct recording of statistics in player profiles. • Automatic synchronization of match data (goals, assists, cards, minutes played, etc.). 3 – Creation and Management of Player Profiles Information to be displayed on the player profile Each player profile must contain the following information: • Name • First Name • Date of birth and age • Height and weight (displayed only if data is available) • Nationality • Jersey number • Position • Club and national team career (detailed below) • Transfer history (only for Moroccan or Moroccan...

I'm seeking a web scraping expert to extract data from the Accredia database and organize the results in an Excel file. Key tasks: - Scrape data on all Italian companies certified UNI/PdR 125:2022, categorized by region. - For each company, extract the following information: - Company name - VAT number - Region - Address - Number of employees, divided by gender if available - Certification date - Certifying body - The data needs to be sourced from: - The final Excel (XLSX) file should have a separate sheet for each region, with companies organized by number of employees. Requirements: - Proficiency in using Selenium for web scraping. - Ability to ensure data accuracy and quality through

I'm looking for a freelancer to extract specific information from two websites: AICI and GlamHive. The data needs to be compiled in a CSV format. Key Responsibilities: - Extracting the specialties and Instagram contacts from the profiles on the websites. - Compiling additional information such as Location, Experience level, and Pricing details. Ideal skills and experience: - Proficiency in data extraction and web scraping. - Experience with compiling data in CSV format. - Attention to detail and ability to accurately capture and report information.

I'm looking for a web scraping expert to help me compare prices on various e-commerce websites. The main data to be collected is product pricing. Ideal Skills: - Proficient in web scraping tools and software - Experience with data analysis and price comparison - Familiarity with e-commerce websites

I'm looking for a professional who can scrape text content from a website. The final output should be delivered as a CSV file. I also want to feed this into an AI writing site so I need the format to be suitable for that. There are about 120 pages. The website to scrape is a simple information site. It is not an ecommerce website and there are not many products. If possible, I would like pdf documents on the website to be scraped. Let me know how long this will take and your fee (what you bid will be the price we pay).

...experience in direct marketing to sell a revolutionary veterinary medicine that restores damaged heart tissue in dogs. This proven bio innovation has already saved over 2,800 dogs suffering from heart failure, and there are thousands more who urgently need it. Your Role: Develop and execute a direct sales strategy to connect with dog owners globally. Find and reach potential customers through email scraping, group moderators, and targeted profiles. Build a system to communicate directly with dog owners in need. Work independently to generate and close sales. Why This Opportunity is Unique: The product is available and highly effective. The target audience is easy to find (dog owners united in communities). There is a huge market demand with thousands of dog owners actively...

...importing using excel or CSV or, if you're a true expert: you may even use XML. You will need to maintain these files. If we find out that an attribute was not defined, we want to make sure it will be easy for you to add the attribute and reimport the products adequately. Note: in some cases, product assets/attributes are contained in 3 files: PIES - ACES - Digital asset. You may need to merge that data to succesfully import a brand of products. - You will need develop a comprehensive understanding of our product. We will be there to support you; we understand that our products are not your typical t-shirt. - Import and/or Create products on our Magento 2 website, including configurable products and other types of special products. - Manage and maintain products in Quic...

I'm seeking a high-skilled fullstack developer with robust experience in machine learning and web application development. The primary objective of this project is to integrate an existing machine learning model into a web platform. Key Responsibilities: - Fullstack Development: Build and maintain the web application - AI Integration: Seamlessly incorporate the machine learning model into the platform - Testing: Ensure the AI model functions as intended within the web application The ideal candidate should: - Have extensive knowledge and experience in fullstack development - Be proficient in integrating machine learning models - Possess skills in training, automating, scraping, and developing AI agents Please only apply if you can demonstrate rel...

...phone number and email, current container supplier if known, and potential container needs such as hire, sales, or modifications. Data Format: Preferably in Excel. Data Sources: Online research using Google, LinkedIn, and business directories, as well as industry databases if accessible. Ideal Freelancer: Experience in lead generation, data scraping, or business research. Strong attention to detail and ability to verify accurate contact information. Ability to organize data clearly and logically. This will be an ongoing project, so there is potential for continued work based on performance. Budget: Open to fair offers based on experience and volume of data collected. Please note I have used Freelancer many times in the past for this purpose...

I'm looking for a skilled web scraper who can extract historical data (pre-2024) from specific Twitter, Reddit, and Facebook accounts and forums. The task also includes scraping popular posts containing specific keywords on these platforms, as well as data from certain independent blogs. Key Requirements: - historical (pre-2024) social media platform content & engagement by specific accounts, pages, groups, or keywords Additional Information: - All the specific accounts, forums, and keywords, have been identified. - Summary of how data was scraped will be required for - Need both raw and basic cleaned copies of data. - Employer is an SME in topic that data is being collected about, and is available for consultation during scr...

I'm seeking a professional web/API scraper with expertise in AI. The goal is to collect detailed information on business association conferences located in Sydney and the Gold Coast. You will need to find all the Australian Business associations first. Key Requirements: - Scrape conference dates and venue details - Deliver the data in a well-structured CSV file Ideal Skills: - Proficiency in web scraping tools and programming languages - Experience with AI development - Attention to detail and data accuracy Please only apply if you can demonstrate relevant experience in your proposal.

I'm looking for a developer who can create a website with a built-in screen scraping solution to gather data from existing sources. The website should have a ranking and searching function. Key Requirements: - Implement a screen scraping solution to target data from an existing site. - Mirror the gathered ranking on the new website. - Create a user-friendly website with powerful search functionality. Other functions: gallery blog section login for members paywall for extra services (optional)

Detailed Analysis for Creating a Comprehensive Automation Scenario in to Import Products from Other Stores to WooCommerce Using AI --- Objectives of the Scenario 1. Import products from other stores into WooCommerce. 2. Automatically add products to the store with optimized data and images. 3. Translate product descriptions into Arabic using AI (ChatGPT). 4. Periodically update products to sync prices, stock levels, and discounts. 5. Automatically create and organize categories for products. 6. Manage synchronization, monitor performance, and handle errors. 7. Compare prices across different stores to select the cheapest option. 8. Enable manual control over product addition or approval before import. --- ? Methods for Inputting Product Sources Method 1: Ma...

I'm looking for a skilled data scraper and processor. The project involves scraping image data from a website, opening attachments, extracting information from scanned image PDFs, consolidating and cleaning textual data, and then copying this data along with a prompt onto a second website. Lastly, you will need to capture the conclusion from this website and paste it onto Notepad. Ideal skills and experience for this job include: - Proficient in web data scraping - Experienced in data extraction from scanned image PDFs - Skilled in data cleaning and consolidation - Capable of accurately copying and pasting data - Familiar with Notepad for data entry Please apply if you are detail-oriented, efficient,...

I'm looking for a skilled web scraping expert with a focus on e-commerce. The project involves extracting specific product information from only one platform. Key Requirements: - Extracting price and availability from product pages - Experience with web scraping tools and techniques - Response in json format Please note that I will disclose the specific platform to scrape during the project. Maybe using Puppeteer? because website seems very protected. I have a shared server so this ideally would have to be done with php. For starting now please.

I'm looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to extract data fro...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data colle...