Data scraping website usingроботи
Необхідно розробити веб-застосунок та описати його роботу. Опис має бути в форматі одного розділу бакалаврської дипломної роботи. Більш детальний опис наведений в закріплених файлах.
...the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 2) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 3) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Finding the URL, writing script or using any other form of tools, platform, VPN, are your responsibilities. I will NOT provide anything. 6) Populate the Excel sheet, remove duplicate, clean it up with proper formatting, pos...
I'm seeking an expert in battery state of charge (SOC) estimation, specifically utilizing the Kalman filtering method. The goal is to achieve an estimation accuracy within the 3-5% range. Key requirements: - Proficient in Kalman filtering - Experience with lithium-ion battery SOC estimation - Ability to work with voltage and current measurements The data available for this project consists of voltage and current measurements. If you have the right skills and experience, I look forward to your proposal.
I'm looking for a freelancer who can assist in gathering emails from a website: The primary objective for collecting these emails is to build a user database of our existing clients who are listed on this website. Ideal skills and experience for the job include: - Proficiency in web scraping tools - Attention to detail - Experience with data collection and database creation - Understanding of privacy and ethical considerations in email collection Please note, this is a one-time project.
...with my .NET stack. The scraper's main purpose is to perform content aggregation from several JavaScript-generated websites. The website are Saudi theatres and Streaming services in Saudi Arabia listed bellow. For streaming services: For Theatres: Key requirements: - Proficiency in C# and .NET framework - Previous experience in building web scrapers - Familiarity with scraping JavaScript-generated websites - Ability to create a reliable, daily-running scraper Skills in data handling for the extracted content would be beneficial. If you can deliver a robust solution that meets these requirements, I'd
...millions of rows of data collection with a budget greater than $500.00 for you. 2) You will collect a total of 750,000 contact information from the following a) US and b) International university websites or from any of the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 3) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Fin...
...millions of rows of data collection with a budget greater than $500.00 for you. 2) You will collect a total of 750,000 contact information from the following a) US and b) International university websites or from any of the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 3) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Fin...
...millions of rows of data collection with a budget greater than $500.00 for you. 2) You will collect a total of 750,000 contact information from the following a) US and b) International university websites or from any of the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 3) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Fin...
Looking for a Freelancer to Create Articles Using a Pattern I am looking for a freelancer to help me create articles based on a single pattern. You can see an example on this page: [Shop by Print - Ramona LaRue](). ? **How it works**: On this website, you can click on a design, and the design appears on multiple articles, such as dresses, kimonos, scarves, and more. This is exactly what I want to do: provide a pattern, and you create articles using that pattern. ? **Articles to create include**: - Short dress - Long dress - Short kimono - Long kimono - Long cape - Scarf - Cushion - Bedspread - Wall art ? **Conditions**: - Rate: €0.50 per article. - More than 500 articles to create, but we will start with a small
I'm looking for a data scientist with machine learning expertise to help predict movie success categories based on my dataset. The project will involve: - Extensive exploratory data analysis (EDA) to uncover key factors influencing success - Preprocessing and feature engineering to prepare the dataset - Experimenting with different classification algorithms to identify the most effective model I have a dataset ready for use. It includes: - Numeric data (e.g., ratings, budgets) - Categorical data (e.g., genres, actors) - Text data (e.g., movie summaries, reviews) The ideal candidate should have experience working with movie datasets and is highly proficient in machine learning. Machine learning skills are essential for preprocessing, feature engin...
...AI-driven video creation workflow: extracting structured data from Amazon product pages. Your primary task will be to develop a reliable system to scrape and organize product information, which will feed into a larger workflow for generating unique product videos. Overview of the Workflow: Our end goal is to provide an Ama zon product URL and automatically generate multiple unique, engaging videos for YouTube. These videos will highlight key product features, reviews, and benefits (e.g., "Top 5 reasons customers love this product"). The videos will use AI to generate original visuals, scripts, and voiceovers, ensuring 100% accuracy and originality. Your Task: You will focus on the data extraction and preprocessing phase. This involves: Scraping product ...
...Platform - 24/7 Operational Capability - Complete Autopilot Functionality - No Manual Processing Required #### Technical Architecture **Technology Stack** - Backend: Python (Flask) - Database: SQLite - AI Libraries: * scikit-learn * NLTK - Communication: * Twilio (SMS) * SendGrid (Email) - Hosting: #### Web Scraping Data Sources 1. to be added once hired #### Autopilot Automation Specifications - Continuous Data Acquisition - Automatic Data Processing - AI-Driven Communication - Self-Scheduling Mechanisms - Zero Human Intervention #### Lead Generation Modules 1. **Roof Restoration Module** - Location: Miami Gardens - Radius: 10-mile expansion - Zip Codes: * 33014, 33054, 33055, 33056 * 33167, 33168, 33169 - Criteria: ...
...freelancer to build an automated workflow that generates unique product videos based on Ama zon product pages. The workflow will include scraping product images, videos, and reviews from Ama zon URLs, using AI to generate custom visuals based on the product’s appearance, and generating scripts and voiceovers using Eleven Labs. The final step will be assembling the content into polished, YouTube-ready videos. The ideal candidate will have: - Proficiency in web scraping tools, particularly BeautifulSoup, Scrapy, or Apify. - Experience with AI tools such as YOLOv8, Stable Diffusion, and OpenAI APIs. - A strong background in video creation and editing using platforms like Runway ML, Descript or alternative. - Expertise in workflow automation with to...
I need a skilled web scraper to extract data for me. Key Information: - Data Type: The specific type of data to scrape has not been determined yet. The freelancer should be able to scrape various types of data, such as product information, user reviews, or contact details, depending on the client's requirements. - Frequency: This is a one-time project. The freelancer will need to complete the scraping task in one go. - Data Delivery: The scraped data should be delivered in Excel format. Ideal skills and experience for the job: - Proficient in web scraping tools and software. - Experienced in data extraction and data handling. - Excellent attention to detail to ensure data accuracy. - Able to deliver dat...
...with my .NET stack. The scraper's main purpose is to perform content aggregation from several JavaScript-generated websites. The website are Saudi theatres and Streaming services in Saudi Arabia listed bellow. For streaming services: For Theatres: Key requirements: - Proficiency in C# and .NET framework - Previous experience in building web scrapers - Familiarity with scraping JavaScript-generated websites - Ability to create a reliable, daily-running scraper Skills in data handling for the extracted content would be beneficial. If you can deliver a robust solution that meets these requirements, I'd
We want to place our Sofa Photos into cool nice 3d realistic rendering scenes using AI. We have thousands of photos which we want to turn into scenes. So the job would be like that. 1. Cut out the Sofa from the acctual white background photo. 2. Create with AI a nice scene (modern etc.) and place the Sofa into this scene so that it looks 100 % real. The finished photos as to be super realistic. Please contact us only if you are a Pro
I'm looking for a skilled data scraper to extract specific data from my website platform. On the platform there was some searches performed which gave us data. The goal is to collect Name, suburb, phone numbers, email address, Google Rating, Likelihood of conversion. The issue I am facing is that data is loaded from somewhere else, and has that virtual scrolling feature. Basically to see the full data, you need to scroll little by little and there is no way to export it normally. Ideal Skills: - Proficiency in web scraping tools and techniques - Experience in data mining and data extraction - Familiarity with data cleaning and organizing Please provide examples of similar projects you've completed in the p...
Start your reply with SCRAPER. Won't r...any other post. I need a script that can scrape text and articles from a specific site and similar ones. The data should be delivered in a CSV file. The script only needs to run once. Ideal skills and experience for this job include: - Proficiency in web scraping tools and programming languages such as Python, Beautiful Soup, Scrapy, or similar. - Experience with data formatting and export to CSV. - Knowledge of how to make the script compatible with similar sites. Please include examples of previous similar projects in your bid. We have a tight budget as we know this is an easy job. We don't need the outcome. We need the script. Starting point: Data to be scraped on the next page of an item on image...
I need a freelancer skilled in data scraping to help me gather contact details from various websites. The focus will be on collecting email addresses, phone numbers, and postal addresses. The data is located here: The ideal candidate should: - Knowledge of Excel API data mapping. - Have extensive experience in web scraping - Be proficient in Excel and data management - Understand how to extract and organize data efficiently Please see the attached file. The section in yellow is what needs to be filled out. The source data is available at NPI Database.
I need a skilled data scraper to extract product details from various e-commerce sites. This project involves: - Identifying and accessing relevant e-commerce sites - Efficiently gathering product details including descriptions, prices, specifications, and availability Ideal candidates should have extensive experience with web scraping, particularly on e-commerce platforms. Proficiency in using automated scraping tools while adhering to ethical guidelines and website terms of service is essential. Previous experience with data analysis and handling large datasets will be an added advantage.
Step to implement Infrastructure as a Service (IaaS) on AWS using Terraform. 1. Create AWS account 2. create IAM policy and assign policy role for required accesss. 3. Design terraform script for AWS setup Design a 3 Tier AWS VPC with NAT Gateways. Create s3 Bucket Create EC2 Key pair and save it Create AWS EC2 using terraform 4. Test and installation and handover
I need a web scraper built in C# that can seamlessly integrate with my .NET stack. The scraper's mai...need a web scraper built in C# that can seamlessly integrate with my .NET stack. The scraper's main purpose is to perform content aggregation from several JavaScript-generated websites. It should extract both text and image url. The project includes only the data scraping and formatting; it does not do any automation like cronjobs. Key requirements: - Proficiency in C# - Previous experience in building web scrapers - Familiarity with scraping JavaScript-generated websites - Ability to create a reliable, weekly-running scraper Skills in data handling for the extracted content would be beneficial. If you can deliver a robust solution that meets these...
I am looking for skilled AWS DevOps Engineer to set up my infrastructure using Terraform. Requirements: Set up AWS infrastructure, including: EC2 instances ECR (Elastic Container Registry) EKS (Elastic Kubernetes Service) Load Balancer VPC and Subnets Ideal Qualifications: Extensive experience with AWS services Proficiency in Terraform Expertise in setting up CI/CD pipelines with GitHub Actions Prior experience with the listed AWS components and services Strong understanding of networking components and their configuration
...the scraper to filter data by brandname - Implementing a function that allows the scrape to resume from the last point - Adding an option for image download: yes or no Post these updates, I need my current Python scrapers to be either fully transformed or seamlessly incorporated into Winautomation. My objective is to have all scrapers consolidated within a single platform. The data I typically scrape includes: - Brand, SKU, price - Text data (HTML, descriptions, name, tags, etc.) - Image-URL - Download image: yes/no, etc. As part of the scraping process, I need to log in to the supplier sites in order to access the correct pricing. Ideal candidates will have: - Extensive experience with Winautomation - Proficiency in Python - Previous experience with web...
Description: I need a Python script to scrape the pages of up to page 20 and save the data into a CSV file. Requirements: Functionality: The script should automate data extraction from the specified pages. All visible information on a sample page (see attached screenshot) should be scraped. Attention: Not all fields are available/filled with data for rows. There might be also different description or time fields, etc. Please take care that all fields with data are scraped! Data Fields (final definition based on the screenshot): Deal title Deal link Description Price and original price Discount Temperature Creation date/time Vendor Shipping costs User/author Comments Image URLs File creation: The CSV file should be created anew each time the script r...
I need a skilled developer to create a web scraping robot for me. This robot will: - Log into a specific site. - Navigate through the site. -find dat according share folder and use login as folder name - Extract both text and images, primarily from the sidebar or widgets. The ideal freelancer for this project should have extensive experience in web scraping and data extraction. They should be comfortable with creating automated robots that can interact with a website and perform tasks like logging in and navigating the site. A good understanding of data extraction from various site components is essential. Please provide proof of similar projects you've completed in the past.
Hi, I need help to get ZPL code printed on my Zebra printer using Php. I have printer installed on my local and its printing html or pdf code but not ZPL code as it runs only on linux so I need help so that my laptop can connect with Php script on my website and print ZPL bar code label without any third party software. Please apply only if you know this job. Budget is Rs. 1000 only as to experienced person this job require less than 1 hour. I just need to get one bar code label printed on my printer using ZPL command in core php without any third party script. Once this task is done selected developer will get big task of printing job in core Php on which we are working. Mention 'ZPL' on top of your bid so that I can understand you read the requirements...
I'm looking for a skilled data miner who can extract information about doctors from a multi-paged website. The information needs to be compiled into a CSV file with separate columns for each detail. Key Requirements: - Extract the following details: Name and specialty, Contact information - Deliver the data in a properly structured CSV file with separate columns for each detail Ideal Skills: - Proficiency in web scraping - Experience with data extraction and CSV formatting - Attention to detail
I'm looking to enhance the online shopping experience by creating a virtual styli...experience by creating a virtual styling room. This will not just be a typical online shopping interface, but one that allows users to try on clothing virtually via video. The room will also need to be connected to Amazon from there we can try the dress . using machine learning Ideal Skills: -machine learning - Proficiency in web development - Experience with video integration - Knowledge of e-commerce platforms, particularly Amazon - Skills in creating user-friendly interfaces Features: - A dual-platform availability: Both a website and a mobile app - A virtual fitting experience that uses video The goal is to create an engaging, interactive shopping experience that could revolu...
...millions of rows of data collection with a budget greater than $500.00 for you. 2) You will collect a total of 750,000 contact information from the following a) US and b) International university websites or from any of the online sources. Also collect contact info from V.P. of external affairs or Alumni or dean of entrepreneurship or Research. 3) It is not possible to do this job manually. You will have to automate it by writing and running web scraping script or using 3rd party App or platform. 4) Do not use chatGPT’s fake email address and phone numbers it spit out. Those are not correct. I will randomly pick some data and call them to verify the quality of your data collection. 5) No duplicate contact is allowed. Daily update is required. Fin...
I'm looking for a secure and reliable online voting system that leverages biometric technology and facial recognition. The system should be web-based and fully accessible, ensuring compliance with all accessibility standards. Key Requirements: - Voter registration with personal and facial data - Secure storage in a database - Live image capture for user authentication during elections - Utilization of facial recognition algorithms to prevent fraud - Anonymous vote recording to maintain privacy - Scalable and user-friendly interface - Full compliance with accessibility standards The ideal candidate would be proficient in Python with Django/Flask, and have experience in developing secure web applications. Prior work involving biometric technology and facial recognition systems...
...contact details for businesses across Canada by scraping a number of websites. This will be a multi-stage project. You will find businesses’ contact details from five types of websites, with each type being a stage in this project: Stage #1: Municipality websites Stage #2: Chamber of Commerce websites Stage #3: Business Improvement Area (BIA) websites Stage #4: Niche business directories Stage #5: Business associations ** NOTE: This first project only concerns the first type of website: Municipality websites. Once this stage is completed, I will move on to the second stage (Chamber of Commerce websites) ** Here is exactly what you will do in this first stage, step-by-step: Stage #1: Municipality websites: a) You will scrape the website for every muni...
I will create a script that scrapes data from the following link "", and save this data in a Google Sheet.
I require assistance in scraping specific financial reports from various websites. This task will involve gathering Sec 10q and 10k reports for 80 companies for 12 years Ideal skills for this project: - Proficiency in web scraping tools and software - Experience in gathering financial data - Ability to compile data into a clear and usable format - Attention to detail and strong analytical skills Pull the reports and save them as is in three formats HTML Excel Pdf For example Apache company for 2012 10Q
...Aggregator Website Development Looking for a developer to create a fully automated news aggregator website with the following specifications: ## Requirements: - Set up a WordPress (or similar CMS) website - Implement web scrapers to automatically collect AI-related news from English-language sources - Ensure proper content formatting and categorization - Set up automated posting system - Integrate advertising spaces/modules - Implement basic SEO optimization ## Technical Specifications: - Web scraping system that can: - Extract headlines, article content, and images - Handle multiple news sources - Filter for AI-related content - Avoid duplicate content - Automated posting schedule - Mobile-responsive design - Ad placement optimization ## Delivera...
I'm seeking a SQL expert to analyze my sales data. The main focus of the project will be to identify sales trends over time. Key Requirements: - Proficient in SQL with a strong background in data analysis. - Experience in analyzing sales data. - Ability to create insightful reports on sales trends. Skills & Experience: - SQL programming - Data analysis - Report generation - Sales data analysis
...Statistical Analysis of Secondary Data Using Stata Do you want to enhance your skills in statistical analysis of secondary data and efficiently use Stata software? Join us for a comprehensive training course that takes you from the basics to advanced specializations! Course Details: Title: Statistical Analysis of Secondary Data Using Stata Dates: January 25, 2025, to February 25, 2025 Location: Online (Zoom link will be sent upon registration) Instructor: Mr. Alaa Amarna, PhD candidate, Expert in Statistical Analysis and Stata Software What You Will Learn: Understanding the basics and practical applications of secondary data Using Stata software for data analysis Conducting common statistical analyses (such as regression,...
I'm seeking a freelancer to assist with data entry on my Wordpress website, specifically utilizing ACF fields. The task primarily involves entering text content. Ideal Skills: - Proficiency in Wordpress and ACF - Strong attention to detail - Excellent English language skills Please note, the text content has yet to be sourced and will need to be gathered from existing documents. The ability to format text into HTML or Markdown may be required, although this will depend on the specific documents. Experience with web scraping could be advantageous for sourcing additional content, but this is not a primary requirement. The project requires a freelancer who is able to: - Understand and correctly populate ACF fields - Accurately input data from various source...
for scraping linkedin posts for scraping linkedin posts
I need a skilled freelancer to set up scrappers on various automotive marketplaces, particularly focusing on European platforms like lacentrale.fr. These scrappers will run periodically and feed our database with important data. Key Responsibilities: - Set up scrappers on specified automotive marketplaces - Ensure scrappers run periodically to feed our database - Set up alerts for any scrapper failures The ideal candidate for this project would have experience with web scraping, data management, and alert systems. Excellent troubleshooting skills are essential to ensure quick resolutions to any issues that may arise with the scrappers.
...Equipment Mapping Project for the Sociobiodiversity in the Legal Amazon. We are in the process of developing a comprehensive catalog of machines and equipment available in the market and are seeking a specialized web scraping company to broaden our database. Key Responsibilities: - Scrape relevant government databases for: - Equipment specifications - Company information - Market prices - Deliver the data on an annual basis Ideal Skills and Experience: - Proven expertise in web scraping, particularly from government databases - Ability to extract and compile diverse types of data - Strong understanding of equipment specifications and market analysis Please send your commercial proposal by January 10, 2025, the date we will begin evaluating and se...
I'm looking for a proficient data extractor who can download all questions and responses from a website. The link will be provided in chat for safety. Requirements: - Download all data without any filters - Format the data into an Excel file - Provide the completed Excel file via a cloud storage link (e.g., Google Drive) Ideal Skills: - Experience with data scraping and Excel - Familiarity with cloud storage services - Attention to detail to ensure all data is accurately captured and formatted.
I need someone to extract all 887 names and addresses in and around (+25 km) Hannover (Germany) from a for market research purposes. Requirements: - Extracted data should be delivered in a CSV file. - Attention to detail is crucial for data accuracy. - Experience with data extraction or web scraping is highly preferred. Ideal Skills: - Proficient in data extraction and web scraping. - Able to deliver data in a specified format. - Detail-oriented.
I need an expert who can make Filemaker Go take a picture of an invoice and use Google Cloud AI (API) and machine learning to read the document and extract various data points. This extracted information should then be input into my Filemaker server. I need to extract the following data points from the invoices: - Invoice number - Date - Total amount - Details from the different items - Different item names Ideal candidates should have: - Extensive experience with Filemaker Go - Proficiency in Google Cloud AI and machine learning - Skills in data extraction and server input - Capability to ensure the process is seamless and efficient
I'm on the hunt for a skilled web scraping professional, preferably with Python expertise, to help me gather valuable leads. Key Responsibilities: I will provide the details information in Chat I need more then 2 Millions Leads from Provided list.
I have a Python web scraping code that needs fixing due to a recent update on the website. The code is currently failing at the data extraction phase, specifically with extracting tables and structured data. - Data Extraction: The code is unable to retrieve the necessary data from the website. - Data Type: The focus is primarily on extracting tables and structured data. - Data Usage: The extracted data will need to be saved as CSV and Excel.. Ideally, the freelancer for this project should have substantial experience with Python, web scraping and database management. Familiarity with the site would be a plus. Please provide examples of similar projects you have completed in your bid.
Budget $600.0 Time limit: 3 days per Milestone. You will collect several millions of record from thousands of websites and online resources for this main project but you must win the contest in the link below before you can apply for this main $600.00 Project. You won't be able to do web scraping manually but automate it using your written script code or other online resources. https://www.freelancer.com/contest/Data-Collection-Contest-2501765/details
Developing a 2D or 3D mobile game using Unity or Godot is a great choice for creating immersive experiences. Here's how you can approach it step by step: --- Step 1: Choose a Game Engine 1. Unity Strong 2D/3D support. Large asset store and community. C# scripting. 2. Godot Lightweight and beginner-friendly. Open-source with great 2D support. GDScript (Python-like scripting) or C#. --- Step 2: Define the Game Concept 1. Game Genre: Platformer, puzzle, endless runner, RPG, shooter, etc. 2. Mechanics: Key features like jumping, shooting, solving puzzles, or collecting items. 3. Story or Theme: Add a story or aesthetic that stands out. Example Ideas: 2D Game: A platformer where the player avoids traps and solves puzzles to escape a dungeon. 3D Game: A r...
...Entrepreneurship v) Sciences 4. No duplicate contact is allowed. Submit your deliverable 100,000 rows populated according to these requirements on the Excel sheet I provided. 5. Finding the URL, writing script or using any other form of tools, platform, VPN, are your responsibilities. 6. It is not possible to do this job manually. You have to automate it by writing and running web scraping script or use 3rd party App or platform. Do not use chatGPT's provided fake email address and phone numbers. I will randomly pick some data and call them to verify quality of your data collection. 7. For the list of educational institutions, online resources and the Excel sheet see in the link below. Collect twice as many contacts from the 3 universities liste...
I'm looking for a data analyst with strong skills in MS Excel, Java, and HTML. The primary focus of this project is to analyze and report on sales data. Experience in data visualization and reporting is crucial, as the results will need to be presented in a clear and coherent manner.
