作为一名企业主，我不断寻找方法来简化我的运营流程。我需要一位经验丰富的网络抓取和自动化专家开发一个工具，以协助完成以下任务： 从1688抓取产品详情：理想的工具应该能够抓取产品详情，如定价、描述和图片。 自动填充购物车：工具应该能够根据关键词或特定的产品ID高效地自动填充我的1688购物车。这种灵活性将允许我根据决定如何采购我的产品迅速行动。 结账：一旦产品加入购物车，系统应该继续进行结账。这将为我节省宝贵的时间，并大大减少我购买过程中涉及的操作步骤。 了解1688平台、精通网络抓取和自动化编程是这个项目的关键。 所需技能包括： PHP JavaScript Python 网络抓取 React.js框架
我需要有人帮忙从一些网站上复制一些信息。
I'm seeking a savvy lead generator and industry researcher utilising LinkedIn, ZoomInfo and similar with a focus on the healthcare, fintech, manufacturing, private hospitals, and ecommerce sectors. The project involves gathering key contacts, particularly CEOs/Executives and Department Heads ( CTOs and CISOs) within these industries. Key Responsibilities: - Conduct comprehensive industry research across one of the mentioned sectors with validation via Linkedin / Zoominfo. - Generate 50 leads and gather key contacts, focusing on top level executives and department heads in healthcare organizations, private hospitals and fintech firms. You could choose a market and go from there, 200-5000 employees enterprises must be targeted. - Deliver a well-organized contact list for potent...
I am seeking a skilled developer located in India to create a web scraper for me. The goal of this project is to collect open interest data from the National Stock Exchange of India (NSE). Key Responsibilities: - Design and implement a robust data scraping tool capable of extracting open interest data from the NSE. - Ensure the tool can operate continuously and efficiently, collecting data for analysis on a daily basis. Ideal Skills: - Proficiency in data scraping and web development. - Experience with financial market data, particularly from the stock market. - Familiarity with the National Stock Exchange of India and its data. I would prefer a freelancer who has prior experience in developing similar tools and can demonstrate their ability to deliver...
I am seeking an expert in data scraping to collect text content from a specific websites (aprox 25 of them). The purpose of this project is to aggregate the scraped content for further use. Each of the target sites have contact section with offices listed. We need to aggregate working hours for these. Ideal Skills: - Proficient in data scraping tools and techniques - Experience with content aggregation projects - Strong attention to detail -python Please bid only if you have proven experience in scraping website text content and are able to deliver clean, structured data fast! Message for more details.
...upcard. The system should offer strategic suggestions and highlight the most optimal move for the player to increase their chances of winning. Skills Required: Strong experience with OpenCV and computer vision for real-time card and game area detection. Knowledge of Blackjack rules and strategy to provide correct game suggestions. Experience with game automation and screen scraping tools. Familiarity with Python or C# (or other programming languages suitable for this type of automation and analysis). Ability to integrate card counting and game analysis features effectively. Real-time strategy recommendation algorithms for Blackjack. Deliverables: A fully functional system that monitors the game screen and tracks the cards in real-time. ...
I'm in need of a skilled data scraper to extract information from a variety of sources. Website Scraping: - Text content - Links Social Media Scraping: - Data from Facebook - Data from Twitter - Data from Instagram The ideal freelancer for this project should have extensive experience in web scraping and social media data extraction. Proficiency in programming languages such as Python is a plus.
I'm seeking a proficient web scraper to extract contact details from the provided website. Ideal Skills: - Proficient in web scraping tools and software. - Experienced in data extraction from company websites. - Deliver the extracted data in Excel format.
I'm in need of a skilled web scraper to extract property listings from PropertyFinder. The project involves capturing essential details such as property descriptions, prices, locations, sizes, and pictures. Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Prior experience in scraping real estate data - Ability to handle large datasets - Attention to detail for accurate data capture - Familiarity with handling images in data scraping
I'm looking for a skilled Python developer to create a program that reads text content from the website and stores it in a Pinecone vector database, categorized by keywords. Key Requirements: - Proficient in Python programming - Experience with web scraping - Familiarity with Pinecone vector database - Ability to categorize data by keywords Please provide examples of your previous work in web scraping and vector database integration.
I'm in need of a professional data entry and scraping expert to assist in filling out a Google Sheet using SensorTower. Instructions and examples have been provided. The data primarily focuses on downloads and revenue statistics. Key Requirements: - Proficiency in data scraping and data entry - Familiarity with SensorTower is a plus - Ability to follow instructions accurately - Experience with Google Sheets Please write 'APPLES' as a test to confirm you are not a bot.
Extract data from website and export in excel sheet
I'm looking for a data scraping expert who can help me gather information on potential internship candidates in Canada. Ideal Skills and Experience: - Proficient in data scraping techniques and tools. - Familiarity with various platforms such as job boards, university websites, and social media. - Ability to compile comprehensive data sets including contact information, educational background, work experience, and email addresses. I need a one-time collection of 200-300 contacts. This project will be a stepping stone towards potentially more extensive future collaborations if the data is of high quality and the process is efficient.
I need a skilled web scraper to gather data and images from residential real estate listings. The specific data fields I need are: - Property address - Price - Number of bedrooms Experience with web scraping and data processing is crucial. Please provide examples of similar projects you've worked on.
I am looking for european freelancer to avoid time zone difference. I need to scrap thousand images and rename it by name and date of creation
I need a skilled freelancer to scrape product information from a specific website. The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and imag...The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and images, and product specifications and reviews. The ideal candidate should have experience with web scraping tools and techniques, ensuring clean and organized data output in CSV format. Key Requirements: - Web scraping expertise, preferably with Python - Attention to detail for data accuracy - Ability to deliver results in a timely manner - Providing the ...
I need help with web scraping from a specific e-commerce website. The goal is to gather comprehensive data for product analysis. Key Data Points: - Product details - Pricing information - Stock levels - Minimum order quantities - Delivery times - Specific product information as detailed on the sites The extracted data should be delivered in an Excel format. Ideal Candidate: - Proficient in web scraping tools and techniques - Excellent data analysis skills - Familiar with e-commerce platforms - Able to deliver clean, well-organized data in Excel Looking forward to your proposals. The website would be the following and we would like to see the details for all manufacturers listed:
I'm seeking a skilled freelancer experienced in crawl4ai web scraping to assist me with data extraction from various e-commerce sites. Specifics of the project: - I need detailed product information, pricing data, and customer reviews extracted from these sites. - The purpose of this project is to gather comprehensive data for analysis and potential application in AI. Ideal Skills: - Proficiency in web scraping tools and techniques. - Experience in extracting data from e-commerce sites. - Ability to deliver clean, organized data. Please provide examples of similar projects you've completed in your proposal.
I'm looking for a skilled developer to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and exp...developer to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and export them into a CSV file via Excel. Key Requirements: - The script needs to operate automatically, without manual intervention. - It should meticulously gather: - Photos and text - Price and description - Category and SKU Ideal skills include web scraping, Python or similar programming language expertise, and experience with data handling in Excel and CSV formats. Please ensure your proposal includes relevant past projects, as well as your ...
I need a data collector who can scrape an industry-specific websites for over 500 contacts. This task involves extracting specific fields and updating th...searches and LinkedIn profiles of the company and people working in that company , if available. The ideal candidate will have experience in data collection, web scraping, and a knack for thorough research. Mandatory Fields: - Company Name - Email ID Mobile Number Important but not mandatory: - Contact Person - Designation The primary source will be an industry-specific site, and the selected freelancer will need to find other details and verify the Email IDs and Mobile numbers through other online sources. Familiarity with LinkedIn is a plus. Please note, the focus is on Email IDs and Mobile numbers, which are crucial ...
I need someone to help me download images from various websites. I have a list of URLs that contain images I need to save. I have a list of 800 URLs of listings. Each listing contain 19-20 images. I need all images saved in JPEG format ...serial no of the urls. In each sub folder save the photos by name 1,2,3,... & make sure that the 1st image is the cover photo of that listing. In total I expect 14-15k images. I have tight budget & deadline. Let me know if this is possible programmatically. Budget 30$ MAXXXX Requirements: - Download images from provided URLs - Save all images in JPEG format Ideal skills: - Familiarity with web scraping and image downloading - Attention to detail to ensure all images are downloaded - Experience with file management to ensure all i...
...formatting data is a plus. Our Terms : - No toxic working environment - You must be responsive, agile, and fast work deliver to avoid our assumption that you no longer working on this project. - Full of integrities : Trustworthy, independence, responsible, firmed-straightforward, modest-humble, care-emphatetically, fair, and hard worker. - Willing to learn new things. I am looking for someone who can understand the intricacies of data processing and can help ease the burden of manual tasks. The goal is to streamline our operations and enhance productivity. -- Basically, we have a data scraping and processing project which is going to be presented into our new website. We need a backend Python Developer whom can process data in our Goo...
I'm in need of a seasoned Data Scraper/Automation Specialist to create a systematic process for gathering data from multiple websites. Initially, this project will focus on 10 major brands. Key Responsibilities: - Scrape membership information, pricing, opening hours, and other relevant data weekly. - Structure and store this data in Google Sheets for straightforward analysis and historical tracking. - Set up the process so that new brands can be easily added. - Facilitate the assessment of variances within brands and the analysis of seasonal changes. Ideal Skills: - Proficiency in data scraping and automation. - Experience with Google Sheets. - Strong analytical skills to interpret the data and identify trends.
I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...
I'm in need of a Google Sheet that consolidates real-time grain cash bid information from local and regional elevators into one accessible location. Key Requirements: - The sheet needs to pull data...cash bid information from local and regional elevators into one accessible location. Key Requirements: - The sheet needs to pull data from specific elevator websites: ADM Sauget, Bunge, Green Plains, and Cargill. - It should only focus on updating cash bids in real-time. Ideal Skills: - Proficiency in Google Sheets and data scraping. - Experience with automating Google Sheets for real-time data updates. - Familiarity with grain elevator cash bid data. This project will be a great fit for you if you're adept at creating automated Google Sheets and have experience w...
I'm looking for a data entry specialist to collect email addresses from a specific website. The site has 480 pages, and there are 10 companies per page. What You Need ...addresses from a specific website. The site has 480 pages, and there are 10 companies per page. What You Need to Do: - Navigate through the 480 pages and 10 companies per page. - Collect email addresses and input them into an Excel file. - Format: One email per cell. Ideal Skills and Experience: - Proficient in Excel. - Good attention to detail. - Previous experience in data collection or web scraping is a bonus. Please note, I only require the email addresses, not any additional information.
We are seeking a skilled developer to create an AI form filler capable of navigating a list of URLs, identifying contact forms, and autonomously filling them out and submitting the data. The solution should be efficient, reliable, and easy to integrate with existing systems. Familiarity with web scraping and AI technologies is essential. If you have a proven track record in developing similar applications, we would love to hear from you.
Job Title: Software Developer Intern (Automation & Web Scraping) Location: Remote About Us: We are a dynamic tech company dedicated to building innovative solutions for data processing and automation. We are looking for a motivated Software Developer Intern who is passionate about web automation and data scraping to join our team. This is an exciting opportunity to work on real-world projects and gain hands-on experience in the tech industry. Role Overview: As a Software Developer Intern, you will be responsible for developing automation tools that can scrape data from websites using available APIs. You will be working with modern technologies like Postman, Selenium, Python, and various automation techniques to build solutions that streamline our processe...
I’m looking for a skilled developer to help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation. Current Situation: I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached). The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable. What I Need: A robust and reliable solution for faster and more efficient scraping without interruptions. The ability to download HTML files in the required structure. Ideall...
Job Title: Develop a Workflow for Scraping Global Mosque & Muslim-Based NGO Data with Detailed Documentation ________________________________________ Job Description: I am looking for a skilled automation expert to build a workflow that scrapes Google for global contact details of mosques and Muslim-based NGOs. The workflow must allow for targeted searches by category (e.g., society, charity, non-profit) and be optimized for credit efficiency in Make.com. The final system should produce structured data outputs and include clear, beginner-friendly documentation. ________________________________________ Scope of Work: 1. Automation Workflow: 1) Build a workflow to scrape Google for the following details: a. Organization Information: i. Organization Name ii. Organization
Hello, I have experience in Python, web scraping, and data extraction using tools like Scrapy, Pandas, and Selenium. I can quickly debug your script and ensure it meets all your requirements. Here’s how I plan to help you: 1. Fix bugs in your script within 2-3 hours. 2. Add functionality to match conditions and extract data as per your requirements. 3. Provide an easy-to-use script for future use. I will deliver the output in the required Excel format. Looking forward to your response so we can start immediately! Budget: $8 (as per your project description). Timeframe: First phase within 2-3 hours. Thank you,
I'm looking for a skilled web scraper with API development experience. The task involves extracting product information from three specific websites. Key Requirements: - Extract product descriptions from specified websites - Develop an API to facilitate this - Present data in a user-friendly JSON format Ideal Skills: - Strong background in web scraping techniques - Proven experience with API development - Attention to detail - Ability to work independently If you've successfully completed similar projects in the past, I would love to hear from you!
I'm seeking a freelancer who can provide me with a daily supply of up to 30K email addresses of individuals aged between 50 and 60 in the USA. The primary purpose of this email database will be for marketing campaigns, so the emails should be valid and ideally have a history of engagement with similar campaigns. Skills and Experience Required: - Data mining and web scraping - Experience with email list building - Understanding of demographic targeting - Knowledge of email marketing standards Please note, the lists need to be delivered daily, and must be of high quality to ensure maximum deliverability and engagement.
...large-scale video processing. Project Requirements: Create a bot that processes YouTube channel video pages (e.g., @TheCookingFoodie/videos) Core Functionalities: Process all videos from a channel's video page Extract and save: Video titles Video URLs Closed captions (CC) Save data in text files named after each video Process videos chronologically (oldest to newest) Handle 1000-2000 videos per channel Technical Specifications: Language: Python Implementation using Python requests or YouTube-specific libraries Error Handling Requirements: Handle video page loading failures with refresh capability Log videos without CC to Implement robust error handling for large-scale processing Design for resilience against YouTube UI updates Project Parameters: Budget: $50 Timeline...
I need a skilled Python developer to create a web scraper for me. The scraper should be able to extract structured data, like tables, from various e-commerce websites. The project requires a deep understanding of web scraping techniques and best practices in Python.
I'm looking for a Python-based email validation checker that can efficiently check millions of email addresses against the Kucoin sign-up page. This tool needs to: - Utilize proxies: It should be able t...addresses against the Kucoin sign-up page. This tool needs to: - Utilize proxies: It should be able to run with proxies and handle the load of millions of checks with a budget of $200 worth of proxies. - Store results: The checker should store the results of the email validation in a file. The output format for the results file should be TXT. Ideal candidates for this project would be those with extensive experience in Python, web scraping, and proxy handling. A deep understanding of email validation and experience working with cryptocurrency exchange websites...
I need an “AI” that can generate realistic images. The data scrapper should be capable of scraping the entire internet to gather unique details and use random generation to create distinct images. I want the AI to output a variety of image types, including portraits, landscapes, and abstract art. Ideal skills for this job include: - Experience in machine learning - Proficiency in data scraping - Knowledge in image generation - Familiarity with different art styles - Skills in random generation algorithms
I'm looking for a service to add members from one Telegram group to another (scraping usernames from public groups and adding them to my group). 1) What is the price for 1k members? 2) What is the timeline to finish? - NO smm panel/bots... (I will provide you public groups to take members from and add to my group) - This will be an ongoing project, as I plan to place many additional orders later. - Only professionals with prior experience in this type of work !
...Optimize the bot to process and deliver alerts without delay. • Avoid rate-limiting issues and ensure reliable performance. • Code Maintainability: • Write well-documented and modular code to facilitate future updates or extensions, such as adding new profiles or refining detection logic. Requirements: • Experience with X API or Web Scraping: • Proficiency in using X API or unofficial libraries like Tweepy to extract data from X. • Knowledge of web scraping methods as an alternative if required. • Telegram Bot Integration: • Hands-on experience with the Telegram Bot API to configure notifications. • Ability to design clear, concise, and user-friendly Telegram notifications. • Real-Time Data Processi...
Development of a Cost-Efficient Microservice for Color-Based Apparel Search and Price Comparison Project Overview: We are developing a Minimum Viable Product (MVP) website focused on fashion, styling, and makeup. The platform will allow fashion artists to create profiles and showcase their work while offering users practical tools to enhance their styling experience. As part of this MVP, we are seeking an experienced freelancer to develop a lightweight and cost-effective microservice that enables users to search for apparel by color and compare prices and availability across major online retailers. The freelancer will develop a simple yet functional microservice with the following features: Color-Based Search: Users can search for apparel by selecting specific colors or providi...
...contacto, etc.). 2. Automatizar el contacto: Enviar correos electrónicos personalizados y atractivos a las agencias. 3. Presentar nuestro producto: Crear correos persuasivos que reflejen el valor de nuestra cadena de emisoras para sus clientes. Requisitos del profesional Experiencia en desarrollo de proyectos con Python, inteligencia artificial o herramientas similares. Conocimientos en web scraping (e.g., BeautifulSoup, Scrapy) para extracción de datos. Habilidad para integrar herramientas de automatización de correos (Gmail API, Mailgun, etc.). Experiencia redactando correos persuasivos o conocimiento básico de marketing digital. Qué ofrecemos Presupuesto ajustado para el desarrollo inicial del proyecto (como freelance ). ...
extract data from web ejar SA, and put it into excel sheet
I need an app to continually monitor when a driving test becomes available and then sends an SMS and/or email with the details of the earliest available appointment, if there is one The app will need to be able to login to the DVSA website (I will give my credentials) which has a visual CAPTCHA security screening This is the URL: This link is to the rebooking site for an existing appointment where you can look for an appointment at a date earlier than the existing booking so it will need to know that data too (to be provided). The app doesn't need to make the rebooking, only to alert when one an earlier appointment is available. It needs to monitor for multiple users ar a time
I'm in need of an expert who can scrape live video data from video streaming services. The data should then be converted into an API, with the format being JSON. Ideal Skills: - Proficiency in web scraping - Experience in API development - Understanding of JSON format Your primary task will be to collect data from live videos on various streaming platforms and turn it into a usable API. Please note that the specific types of data to be collected have not been specified yet. Prior experience working with video data is a plus. Please bid if you have the necessary skills and experience. Looking forward to your proposals.
...link containing lists of other companies. For each company, gather the following information (where available): Company Name Key People (CEO, Founder, Marketing Head, Sales Head, or equivalent) Job Titles Contact Details (email addresses, phone numbers) LinkedIn Profile URLs (if available) Organize the data into a structured Google Sheet or Excel file. Requirements: - Experience in data scraping, web research, or lead generation. - Attention to detail and accuracy in collecting and entering data. - Ability to use professional tools like LinkedIn, email finders, or other research methods to locate information. - Familiarity with verifying email addresses to ensure they are active and bounce-free....
...solid foundation: The database is live in Supabase with role management, data inputs, and calculations fully set up. Key APIs like ScrapingBee (for data extraction) and FRED (for rate data) are ready and configured. The frontend uses React.js with TailwindCSS, DaisyUI, and ShadCN for layouts and visuals. We also have multiple Vercel deployments showcasing different features like login, scraping, and calculations. User flows are clearly defined and tested for functionality. Your Role: You’ll be the one pulling everything together into a cohesive, live MVP. Here’s what that looks like: Unify User Pages: Make sure Guest, Registered, and Admin pages function as intended. This includes fixing routing, refining role-specific content visibility, and pol...
...images, descriptions, and pricing -Automated data updates from external foreclosure listing sources - I.e. scraping or third party API -Backend Administration Panel: -Manage property listings (add/edit/delete) -Track subscriptions and payments -Analytics dashboard for user activity and revenue -User support/ticketing system integration Technology Preferences: - Based on WordPress CMS preferred (for ease of management and scalability) - Custom plugin development if required - Secure and scalable hosting setup recommendation - Mobile-responsive design (optimized for all devices) Security & Compliance: -Secure user data storage (GDPR/CCPA compliance) - SSL certification and best practices for web security - Payment gateway security (PCI compliance) Performance Optimiz...
I'm seeking a professional to scrape my WordPress website for 1100 entries related to our different offices. The data needs to be exported into an Excel file, without any specific filters or sorting. In addition to data scraping, I need a thorough code review of my WordPress site. This should encompass: - Documentation and review of custom code - Optimization where necessary - Plugin review for updates - Recommendations for optimization This project requires a deep understanding of PHP, as well as experience with WordPress and data scraping. The ideal freelancer will have a strong background in website code review and optimization.
