Project Overview Develop and deploy a Python-based web scraping system to collect NBA player and team statistics from Basketball Reference, updating pre-configured Airtable sheets daily. The system will be hosted on AWS Lambda for automated execution. Fixed Budget: $100 Project Scope Data Collection Requirements Scrape statistics for ~550 players (90 fields per player) Scrape statistics for 30 teams (90 fields per team) Data sources span 4-5 specific URLs from Basketball Reference Update existing Airtable sheets with collected data Match data to pre-defined columns in Airtable Technical Requirements Python Web Scraping Implement robust scraping scripts using BeautifulSoup/Requests Handle rate limiting and site restrictions Inclu...
...contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the website for every muni...
Estamos buscando un profesional experto en Web Scraping para realizar la extracción completa de datos del sitio web con el objetivo de construir un sitio web propio con funcionalidades similares. Los datos extraídos deben incluir toda la información relevante para cada pieza de equipo disponible en el sitio, con especial atención a los siguientes atributos: Título: Nombre de la pieza o repuesto. Nombre y Descripción: Información detallada de la pieza. Especificaciones Técnicas: Características clave. Imágenes: Alta calidad asociadas a cada pieza. Cantidad y Ubicación: Información sobre disponibilidad y localización. Cualquier otro dato relevante: Etiquetas, categorías, referencias, et...
...news website. The project involves: - Scraping text content from early 2022 to before 2024-11-22. - Specifically extracting author names from the posts. - Saving the source code of each post in separate folders named by the post’s date. - Creating a second Python program to generate an Excel file based on the downloaded HTML. You do not need to know how to extract Korean texts from images, as the texts are available. However, if you have experience in that area, feel free to include it in your bid. Ideal skills and experience for the job include: - Proficiency in Python, particularly for web scraping. - Experience with data processing and Excel generation. - Understanding of how to minimize server load while scraping. Please note that the aim...
...include comprehensive API scraping capabilities. Key Features: - Token Generation: The application should be able to generate tokens for API requests. - Captcha Bypass: This is a critical feature. The application must be able to bypass captcha prompts seamlessly. - API Scraping: The application should have the ability to scrape data from public APIs. - CODE DECODE: Implement a feature that can encode and decode data. Ideal Skills: - Proficient in C# and .NET framework - Experience with httpclient requests - Proven track record in API scraping - Familiarity with captcha bypass techniques - Able to implement encoding and decoding features. Please note, this project does not require development for Android or Web, its focus is solely on a Desktop appl...
Create an automated system for booking clients on website with minimal delay using a simple algorithm. Requirements: Automatically check for new orders Quickly accept available orders. Interact with the website through web scraping. Technical Requirements: The program should operate 24/7 in real-time. Budget: Maximum budget: $200. Includes development, testing, and basic support. Workflow Algorithm: Order Monitoring: Continuously check for available orders. Filtering and Prioritization: Evaluate available orders based on filter criteria. Order Acceptance: Automatically click the "Accept" button. Support: 7 days of free support after launch.
...system for booking clients on a taxi website with minimal delay using a simple algorithm. Requirements: Core Functionality: Automatically check for new orders on the taxi website. Quickly accept available orders. Interact with the website through web scraping. Technical Requirements: The program should operate 24/7 in real-time. Ability to set filters based on criteria (distance, price, direction). Compatibility with Windows/Mac/Linux. Data security (protection of logins and passwords). Interface: Simple web interface for managing settings and monitoring performance. Logs with a history of accepted orders. Budget: Maximum budget: $200. Includes development, testing, and basic support. Workflow Algorithm: Authorization: Log int...
I'm look...Features: - Price alert notifications: Users should be able to set alerts for specific products when their prices drop. - User reviews: Integration of user reviews for products is necessary. - Real time data: The app should be able to provide real time data via public APIs or web scraping. Data Sourcing: - The product data will primarily be sourced from public APIs or Scrapping Ideal Skills: - Proficiency in cross-platform mobile app development - Experience in implementing notifications and user review features - Knowledge of working with public APIs and web scraping - Understanding of real-time data integration. The aim is to create a user-friendly, efficient and informative price comparison app. Please include examples...
I need a professional data scraper to help me collect company email addresses from e-commerce websites. This project involves: - Finding and scraping email addresses from various e-commerce sites. - Ensuring the data is accurate and up-to-date. - Delivering the data in a structured format. Ideal candidates for this project should have: - Proven experience in data scraping, particularly from e-commerce websites. - Skills in data cleansing and structuring. - A strong attention to detail to ensure data accuracy. The data to be collected is highly targeted and niche, so there won't be a lot of information out there.
I need a web scraping expert who can efficiently extract product details and descriptions from certain e-commerce sites and download relevant PDF files. Ideal skills for the job: - Proficiency in web scraping tools and languages (e.g. Python, Beautiful Soup, Scrapy) - Experience with e-commerce site data extraction - Knowledge of how to download files programmatically - Attention to detail and ability to work independently
I'm seeking an expert in web scraping to gather data from my competitor's stock on their website, specifically Data Requirements: - Make - Model - Registration - Mileage - Cash Price Delivery Format: The scraped data should be delivered in a CSV file. Filtering Criteria: I need the data to be filtered by price range. Please ensure you understand the price range criteria before bidding. Ideal Skills: - Proficient in web scraping - Experience in data filtering - Able to deliver data in CSV format Please note, this is a one-time project.
I am seeking an experienced data scientist to create a comprehensive knowledge graph by populating an ontology with instances extracted from multiple datasets. The primary goal of this knowledge graph is to facilitate advanced data analysis. Key Responsibilities: Process and extract instances from three CSV files and two JSON files (provided) to construct the knowledge graph. Enhance the knowledge graph by defining and applying SPARQL queries for meaningful insights. Define at least 5 SHACL node shapes, each with a minimum of 3 property shapes, to ensure the graph's structure and data integrity. Tools and Resources: The project will require the use of OpenRefine, RML, RML Mapper, and YARRRML for efficient data processing and ontology population. Deliverab...
We are seeking a skilled and creative WordPress GSAP Animator who specializes in using the “Animation Addons for Elementor” plugin to craft visually stunning and highly engaging web animations. This role is ideal for someone with a strong background in WordPress development, Elementor, and GSAP (GreenSock Animation Platform). You will play a key role in enhancing our web projects by adding dynamic and interactive animations that improve user experience and make our designs stand out. Key Responsibilities: – Design and implement custom animations using the Animation Addons for Elementor plugin within WordPress websites. – Collaborate with designers and developers to translate static designs into dynamic, animated web elements. – Optimize animatio...
I need a professional who can help me read Taobao's API and retrieve valuable informatio...product ID from the link. Key Requirements: - You're expected to retrieve product details (name, description, price), seller information, customer reviews, and image links. - Since I already have an API key, you will primarily focus on developing the functionality to fetch data. The data fetching will be on a real-time basis, as needed. Ideal Skills: - Proficiency in working with APIs, particularly Taobao's. - Strong programming skills, preferably in Python or similar languages. - Experience in data scraping and real-time data processing. Please, ensure you can deliver quality and accurate information in a timely manner. Your expertise will con...
I'm in need of a seasoned Flutter Developer to create an interactive mobile application(Android & IOS) using Flutter and Firebase. The application will incorporate several core features and systems. The project includes the following features: 1. Learning Management System(Dynamic) 2. Phonepe Payment Gateway Integration: Seamless and secure payment processing for premium content. 3. Hot Calls: Provide stock suggestions and recommendations for users. Dynamic data updates to reflect which stocks to buy. 4. Production Setup and uploading to Play Store & App Store Admin Panel:(Web Application) Manage content, users, stock calls, lms, and system settings dynamically. Real-time control and updates for the entire application. Requirements: Expertise in Flutter for f...
Scrapping chain stores: The project: obtain the addresses of the points of sale for each brand in my file (I have 3669,...retrieved, it might be interesting to add it, for example:- GPS coordinates to ensure that the mapping will be accurate - Date of creation of the unit (= of the sales outlet) - Referenced website - Google rating, etc. But not necessary. I suppose the best place to find all this information is Google Maps, which will be the most up-to-date source. But maybe URSSAF or would be better sources, you tell me. To put it simply, when we search for “Boulangeries Paul France” in Google Maps, we should get 408 results (that's the number of their outlets to date, cf their website). So by scrapping the data, we should be able to recreate the m...
Trimmomatic Phyloseq Normalization Biostatistics using R Visualization % shared ASV
I'm looking for an expert in embedded software development for a microcontroller-based system. STM32H series based Experience with EKF controller software is preferred Able to port drivers wherever required Follow the guidelines for C/C++ Prefer someone who can use AI tools to develop code rapidly
Job Title: Freelancer Needed to Build a Custom Chatbot Using Website Data Description: We are seeking an experienced freelancer to create a custom AI-powered chatbot that can engage users and answer queries based on content from our website. The chatbot should be intuitive, user-friendly, and capable of accurately retrieving and presenting information. Project Requirements: Data Training: Extract and utilize data/content from our website to train the chatbot. Ensure the chatbot provides precise answers based on the website’s existing information. Chatbot Features: Natural language understanding (NLU) for accurate interpretation of user queries. Context-aware responses to maintain conversational flow. Ability to handle FAQs, provid...
I'm seeking a data extraction expert to help me gather car details from Ideal Skills: - Data mining and web scraping - Proficiency in using and similar platforms - Experience in collecting automotive data Delivery Format: - The data should be compiled and delivered to me in an xls or csv or google sheets spreadsheet. Please ensure that your bid reflects your capability to fulfill these requirements. Thank you!
web development website according to our chat
...Proficient in Python - Has extensive experience with web scraping and 3commas API integration - Understanding of crypto trading and DCA bots and DCA bots orders. - Capable of delivering real-time tracking and performance analytics - If you don't know about web scraping let me know and I can include a specialist about in the team, for that specific function. First phase 1- I need monitoring my 3commas DCA bots via 3commas API, In-depth performance analytics to assess the bots' efficiency, performance and profitability. 2- I need a chart show me real-time data of all kind of orders in each cycle of each bot. (see SS) 3- The DCA bot cycles must be separated in columns inside each bot chart (see SS) 4 - The chart must show real-time data related with...
Project Name: Design, Programing and simulation of a 3-4 DOF robotic arm using simulink and arduino Software: Matlab Simscape Hardwares (I Have): 1) arduino mega 2560 r3 2) servor mg90s 3) 1.5v - 6v r300c mini dc motor rpm3500 4) sg90 micro servor motor 9g(360°) 5) dual channel motor driver modul L298N H-bridge 6) jumper wire cable 7) breadboard 8) robotic arm kit 6dof Deadline 2 days $20 nzd
...urgently need to extract data from an event site, there are 4200 events of which we need about 20 data and images, the same for each event. The data is spread over 13 different countries. The work is urgent, it has to be delivered on January 30, with no possibility of changing this date. - The delivery format is excel with column separation (not csv). - The extraction must have an id, so that in the future we can ask for it again and that the records correspond to update them. - The images and logos must be downloaded and numbered with the id of the corresponding event. Must be uploaded to a drive folder we will provide - The categories (4) must be extracted separated by commas. Verify that the resulting file does not contain non-English characters. Do not extra...
...include comprehensive API scraping capabilities. Key Features: - Token Generation: The application should be able to generate tokens for API requests. - Captcha Bypass: This is a critical feature. The application must be able to bypass captcha prompts seamlessly. - API Scraping: The application should have the ability to scrape data from public APIs. - CODE DECODE: Implement a feature that can encode and decode data. Ideal Skills: - Proficient in C# and .NET framework - Experience with httpclient requests - Proven track record in API scraping - Familiarity with captcha bypass techniques - Able to implement encoding and decoding features. Please note, this project does not require development for Android or Web, its focus is solely on a Desktop appl...
I'm seeking a data extraction expert to help me gather car details from Ideal Skills: - Data mining and web scraping - Proficiency in using and similar platforms - Experience in collecting automotive data Delivery Format: - The data should be compiled and delivered to me in an xls or csv or google sheets spreadsheet. Please ensure that your bid reflects your capability to fulfill these requirements. Thank you!
I'm seeking a data extraction expert to help me gather car details from Ideal Skills: - Data mining and web scraping - Proficiency in using and similar platforms - Experience in collecting real estate data Delivery Format: - The data should be compiled and delivered to me in an xls or csv or google sheets spreadsheet. Please ensure that your bid reflects your capability to fulfill these requirements. Thank you!
I'm seeking a data extraction expert to help me gather car details from Ideal Skills: - Data mining and web scraping - Proficiency in using and similar platforms - Experience in collecting automotive data Delivery Format: - The data should be compiled and delivered to me in an xls or csv or google sheets spreadsheet. Please ensure that your bid reflects your capability to fulfill these requirements. Thank you!
Option Explicit Type Authvalinterval Lower_Val As String * 40 Upper_Val As String * 40 End Type Type AUTHVALINTERVAL_TAB wert(1 To 10) As Authvalinterval End Type Type AUTHFIELD_VALS fieldname As String * 10 fieldvals As AUTHVALINTERVAL_TAB End Type Type AUTHORIZATION_TAB AUTHORIZATION(1 To 10) As AUTHFIELD_VALS End Type Type AUTHORIZATION_FOR_OBJECT xuobject As String * 10 AUTHORIZATIONS As AUTHORIZATION_TAB End Type Global IT_ROLE_AUTHS(1 To 100) As AUTHORIZATION_FOR_OBJECT Global sapSystem As Object Global sapFuBa As Object Global sapLogon As Object Global sapConn As Object Global sapReturn As Object Sub RolleAnlegen() Dim wert As Object Dim rolle As Object Dim sapObjekt As Object If InitConnection Then Se...
...business names, addresses) from a target website requiring login. The program will also compare newly extracted data with previously stored data to identify additions, updates, and deletions. It should handle dynamic content loading (e.g., infinite scrolling) and provide effective management and export of data. The user interface will primarily be in Korean. Key Features: Web Scraping: Automates login and data extraction from a specified website. Handles dynamic content loading (e.g., infinite scrolling). Extracts structured data: phone numbers, business names, and addresses. Data Management: Displays extracted data in a table format within the program. Saves data to CSV or Excel files. Data Comparis...
I'm looking for a web scraper who can scrape some sites for me on a daily basis using a script. The specific data to be scraped will be discussed further. Ideal candidates for this project should: - Have experience with web scraping, especially in selenium and python - work on ms sql server
...the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 2) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 3) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Finding the URL, writing script or using any other form of tools, platform, VPN, are your responsibilities. I will NOT provide anything. 6) Populate the Excel sheet, remove duplicate, clean it up with proper formatting, pos...
I'm looking for a freelancer who can assist in gathering emails from a website: The primary objective for collecting these emails is to build a user database of our existing clients who are listed on this website. Ideal skills and experience for the job include: - Proficiency in web scraping tools - Attention to detail - Experience with data collection and database creation - Understanding of privacy and ethical considerations in email collection Please note, this is a one-time project.
...an immediate larger job, for collecting millions of rows of data with a budget greater than $500.00 for you. 2) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 3) It is your job to think, be creative and figure out what website, sources of contact info you will use. Some sources are listed in the link below but you need to find your own sources. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Finding the URL, writing script or using...
...an immediate larger job, for collecting millions of rows of data with a budget greater than $500.00 for you. 2) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 3) It is your job to think, be creative and figure out what website, sources of contact info you will use. Some sources are listed in the link below but you need to find your own sources. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Finding the URL, writing script or using...
...millions of rows of data collection with a budget greater than $500.00 for you. 2) You will collect a total of 750,000 contact information from the following a) US and b) International university websites or from any of the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 3) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Fin...
Looking for a Freelancer to Create Articles Using a Pattern I am looking for a freelancer to help me create articles based on a single pattern. You can see an example on this page: [Shop by Print - Ramona LaRue](). ? **How it works**: On this website, you can click on a design, and the design appears on multiple articles, such as dresses, kimonos, scarves, and more. This is exactly what I want to do: provide a pattern, and you create articles using that pattern. ? **Articles to create include**: - Short dress - Long dress - Short kimono - Long kimono - Long cape - Scarf - Cushion - Bedspread - Wall art ? **Conditions**: - Rate: €0.50 per article. - More than 500 articles to create, but we will start with a small
...AI-driven video creation workflow: extracting structured data from Amazon product pages. Your primary task will be to develop a reliable system to scrape and organize product information, which will feed into a larger workflow for generating unique product videos. Overview of the Workflow: Our end goal is to provide an Ama zon product URL and automatically generate multiple unique, engaging videos for YouTube. These videos will highlight key product features, reviews, and benefits (e.g., "Top 5 reasons customers love this product"). The videos will use AI to generate original visuals, scripts, and voiceovers, ensuring 100% accuracy and originality. Your Task: You will focus on the data extraction and preprocessing phase. This involves: Scraping product ...
...Platform - 24/7 Operational Capability - Complete Autopilot Functionality - No Manual Processing Required #### Technical Architecture **Technology Stack** - Backend: Python (Flask) - Database: SQLite - AI Libraries: * scikit-learn * NLTK - Communication: * Twilio (SMS) * SendGrid (Email) - Hosting: #### Web Scraping Data Sources 1. to be added once hired #### Autopilot Automation Specifications - Continuous Data Acquisition - Automatic Data Processing - AI-Driven Communication - Self-Scheduling Mechanisms - Zero Human Intervention #### Lead Generation Modules 1. **Roof Restoration Module** - Location: Miami Gardens - Radius: 10-mile expansion - Zip Codes: * 33014, 33054, 33055, 33056 * 33167, 33168, 33169 - Criteria: ...
...freelancer to build an automated workflow that generates unique product videos based on Ama zon product pages. The workflow will include scraping product images, videos, and reviews from Ama zon URLs, using AI to generate custom visuals based on the product’s appearance, and generating scripts and voiceovers using Eleven Labs. The final step will be assembling the content into polished, YouTube-ready videos. The ideal candidate will have: - Proficiency in web scraping tools, particularly BeautifulSoup, Scrapy, or Apify. - Experience with AI tools such as YOLOv8, Stable Diffusion, and OpenAI APIs. - A strong background in video creation and editing using platforms like Runway ML, Descript or alternative. - Expertise in workflow automation with to...
I need a skilled web scraper to extract data for me. Key Information: - Data Type: The specific type of data to scrape has not been determined yet. The freelancer should be able to scrape various types of data, such as product information, user reviews, or contact details, depending on the client's requirements. - Frequency: This is a one-time project. The freelancer will need to complete the scraping task in one go. - Data Delivery: The scraped data should be delivered in Excel format. Ideal skills and experience for the job: - Proficient in web scraping tools and software. - Experienced in data extraction and data handling. - Excellent attention to detail to ensure data accuracy. - Able to deliver dat...
We want to place our Sofa Photos into cool nice 3d realistic rendering scenes using AI. We have thousands of photos which we want to turn into scenes. So the job would be like that. 1. Cut out the Sofa from the acctual white background photo. 2. Create with AI a nice scene (modern etc.) and place the Sofa into this scene so that it looks 100 % real. The finished photos as to be super realistic. Please contact us only if you are a Pro
I'm looking for a skilled data scraper to extract specific data from my website platform. On the platform there was some searches performed which gave us data. The goal is to collect Name, suburb, phone numbers, email address, Google Rating, Likelihood of conversion. The issue I am facing is that data is loaded from somewhere else, and has that virtual scrolling feature. Basically to see the full data, you need to scroll little by little and there is no way to export it normally. Ideal Skills: - Proficiency in web scraping tools and techniques - Experience in data mining and data extraction - Familiarity with data cleaning and organizing Please provide examples of similar projects you've completed in the p...
Start your reply with SCRAPER. Won't r...any other post. I need a script that can scrape text and articles from a specific site and similar ones. The data should be delivered in a CSV file. The script only needs to run once. Ideal skills and experience for this job include: - Proficiency in web scraping tools and programming languages such as Python, Beautiful Soup, Scrapy, or similar. - Experience with data formatting and export to CSV. - Knowledge of how to make the script compatible with similar sites. Please include examples of previous similar projects in your bid. We have a tight budget as we know this is an easy job. We don't need the outcome. We need the script. Starting point: Data to be scraped on the next page of an item on image...
I need a freelancer skilled in data scraping to help me gather contact details from various websites. The focus will be on collecting email addresses, phone numbers, and postal addresses. The data is located here: The ideal candidate should: - Knowledge of Excel API data mapping. - Have extensive experience in web scraping - Be proficient in Excel and data management - Understand how to extract and organize data efficiently Please see the attached file. The section in yellow is what needs to be filled out. The source data is available at NPI Database.
I need a skilled data scraper to extract product details from various e-commerce sites. This project involves: - Identifying and accessing relevant e-commerce sites - Efficiently gathering product details including descriptions, prices, specifications, and availability Ideal candidates should have extensive experience with web scraping, particularly on e-commerce platforms. Proficiency in using automated scraping tools while adhering to ethical guidelines and website terms of service is essential. Previous experience with data analysis and handling large datasets will be an added advantage.
Step to implement Infrastructure as a Service (IaaS) on AWS using Terraform. 1. Create AWS account 2. create IAM policy and assign policy role for required accesss. 3. Design terraform script for AWS setup Design a 3 Tier AWS VPC with NAT Gateways. Create s3 Bucket Create EC2 Key pair and save it Create AWS EC2 using terraform 4. Test and installation and handover
I am looking for skilled AWS DevOps Engineer to set up my infrastructure using Terraform. Requirements: Set up AWS infrastructure, including: EC2 instances ECR (Elastic Container Registry) EKS (Elastic Kubernetes Service) Load Balancer VPC and Subnets Ideal Qualifications: Extensive experience with AWS services Proficiency in Terraform Expertise in setting up CI/CD pipelines with GitHub Actions Prior experience with the listed AWS components and services Strong understanding of networking components and their configuration
...the scraper to filter data by brandname - Implementing a function that allows the scrape to resume from the last point - Adding an option for image download: yes or no Post these updates, I need my current Python scrapers to be either fully transformed or seamlessly incorporated into Winautomation. My objective is to have all scrapers consolidated within a single platform. The data I typically scrape includes: - Brand, SKU, price - Text data (HTML, descriptions, name, tags, etc.) - Image-URL - Download image: yes/no, etc. As part of the scraping process, I need to log in to the supplier sites in order to access the correct pricing. Ideal candidates will have: - Extensive experience with Winautomation - Proficiency in Python - Previous experience with web...
Description: I need a Python script to scrape the pages of up to page 20 and save the data into a CSV file. Requirements: Functionality: The script should automate data extraction from the specified pages. All visible information on a sample page (see attached screenshot) should be scraped. Attention: Not all fields are available/filled with data for rows. There might be also different description or time fields, etc. Please take care that all fields with data are scraped! Data Fields (final definition based on the screenshot): Deal title Deal link Description Price and original price Discount Temperature Creation date/time Vendor Shipping costs User/author Comments Image URLs File creation: The CSV file should be created anew each time the script r...
