Data mining harvesting scraping trabalhos

Olá, Estou procurando programadores para desenvolver um sistema de captura de informações na internet. Esse projeto será desenvolvido no escritório em Curitiba com contratação CLT (salário + benefícios) . Apesar de não existir a opção de contratação CLT no orçamento do projeto no site do Freelancer completei os dados do orçamento com valores ...Freelancer completei os dados do orçamento com valores reais. Basicamente desenvolveremos rotinas para buscar dados em sites específicos. O conhecimento em diversas linguagens de programação facilitará o desenvolvimento das rotinas. Para receber mais informações basta se candidatar a ...

"Build a Conversational, Cutting-Edge Website for a Gold Mining Token Company" Project Overview We are seeking an extraordinary web developer or team to create a truly unique, AI-enhanced website. The client is a gold mining company backed by its own crypto token, and they want a site that stands out from the crowd—both visually and functionally. Our vision is a conversational-style website where users can easily type in what they are looking for, rather than having to click through endless menus or sift through static pages. We want to reduce the typical “wall of text” approach and replace it with something more dynamic, interactive, and memorable. We are on the forefront of the AI revolution, and we expect the site to reflect that. If you are ...

I need a bot that scrapes text content from selected medtech and regulatory news websites and social media platforms. The bot should compile the scraped data into comprehensive reports in Word format. Ideal Skills: - Proficiency in web scraping tools and programming languages (Python, Java, etc.) - Experience with data analysis and report generation - Familiarity with medtech and regulatory content preferred Please provide your previous work samples related to web scraping and data report generation.

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data collection from the...

I'm looking for a developer to create a scraper for dexscreener.com. Initially, it's about scraping a single coin's subpage, for example: and downloading the TopTraders for 30d and 7d, and Holders, at least the first 100 positions, preferably 250. Most likely we will be expanding the number of endpoints later. Please keep cloudflare in mind. I need your program to act as a local API endpoint, meaning I provide the address in the request and get a JSON with the data in response. I don't need to read data every second - let's say 1 coin per minute is enough for me (if that makes any difference).

...specifically for the South African legal industry. This agent's primary role will be conducting legal research and retrieving case law. Key Responsibilities: - The AI agent will need to communicate back to lawyers. - It should be capable of scraping all legitimate South African law from various sources. - These sources include the South African Legal Information Institute (SAFLII), Journals and Law Reviews, and government-owned legal databases. Security is a critical aspect of this project. The AI agent must incorporate the following security measures: - Data encryption to protect sensitive information. - User authentication to ensure that only authorized personnel can access the system. - Regular security audits to maintain the system's integrity. - Robust se...

I need a freelancer to scrape the names and cell phone contacts of real estate agents from the website Ideal Skills and Experience: - Proficiency in web scraping - Familiarity with real estate industry - Attention to detail

I'm seeking someone to help me create a data web scraping from different car-selling websites. I need to get the prices of the cars during the time (create a timeline) of prices and characteristics of the vehicles. Getting the data from those websites, for example: You can export the data to Excel or PDF format if you like. I need the prices of the cars and their characteristics. Ideal skills for this job would include: - Proficiency in web scraping tools and programming languages like Python, BeautifulSoup or Scrapy - Experience with data extraction from eCommerce or product websites - Ability to deliver clean, structured data Please ensure you can commit to delivering this project promptly and efficiently

I require a professional data miner who can secure a comprehensive list of newly incorporated companies in India, including their directors' contact details. The focus is on all sectors, specifically technology, retail, and finance, encompassing both LLP and private limited companies. Key Requirements: - Data of companies registered within the last month, although slightly older data may be considered - Information on director names and their contact details - Utilization of reliable sources for data collection - Delivery of the data in an Excel file The ideal candidate should have experience in data scraping and knowledge of reliable databases. Please include in your proposal your planned approach for this task, and if possible, pro...

I'm looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to extract data from the ...

I'm in need of a detail-oriented support secretary to assist with my weekly Excel report for our various mining exploration projects. The tasks involve basic data analysis and project management. Key Responsibilities: - Data Entry: Accurately inputting project data into the report. - Financial Tracking: Keeping tabs on project budgets and expenditures. - Performance Metrics: Monitoring and recording project performance indicators. Ideal Candidate: - Proficient in Excel with experience in data analysis and project management. - Some familiarity with mining industry terminology. - Excellent attention to detail and good with numbers. Bonus: - Previous experience in mining projects. The task should take around 3-4 hours each week, wit...

...AI agent that can extract contact data from social media platforms, primarily Instagram, and manage my email marketing tasks. Key Requirements: - Data Extraction: The AI should be able to extract 'Name' and 'Email' from Instagram, FaceBook, Ticktok, X, Youtube and compile this data into a CSV file. - Email Management: It should check for duplicate entries and manage email campaigns, sorting emails based on their status (with a focus on 'Opened'). It should have the ability to send emails in batches. Ideal Skills: - Proficiency in AI development - Experience with data scraping - Understanding of email marketing systems - Ability to create and manage CSV files I'm looking for a professional who can deliver a sy...

? Busco un experto en automatización para integrar alertas de en Google Sheets y Discord ? Hola, soy Chema, y estoy buscando a alguien que pueda ayudarme a crear una automatización eficiente y programable que monitoree anuncios en Wallapop y me notifique en tiempo real si cumplen con ciertas condiciones. ? ¿Qué necesito? ✅ IMPRESCINDIBLE: Scraping programado: El sistema debe poder ejecutar el scraping en intervalos de tiempo definidos para detectar nuevos anuncios que vayan saliendo en la URL de Wallapop que yo aporte. Analisis de iA de que esos anuncios cumplen una directrices. Almacenamiento en Google Sheets: Todos los anuncios filtrados deben guardarse automáticamente en una hoja de Google Sheets. Automatización en Make o Zapie...

...**web scraping** for a specific project. Here are the details: 1. Scrape data from [website name: stats perform/URL: ]. 2. Extract the following information: - [Specify the data fields you need, e.g., Seasons, Matchday, Results, Match Summary, Opta Points, Match Details, Venue, Attendance, Referee, date, Goal Assist, Cards, Cross ,Foul won, Foul conceded, Goal/Own Goal, Interception ,Offside, Pass, Penalty (Won, Conceded and Taken), Shot, Shot on target, Shot off target, Tackle, Save, Penalty Save] 3. The data should be delivered in [desired format, Excel, CSV]. 4. Ensure the script is reusable for future updates and scraping. 5. Follow best practices for web scraping, including

Por favor, Cadastre-se ou Faça Login para ver os detalhes.

...FBA Wholesale sellers. The goal of the extension is to help sellers make data-driven decisions about whether a product is worth selling on Amazon based on the analysis of Keepa’s price history and sales rank trends. The extension will need to: - Detect Keepa charts on Amazon product pages and extract relevant data from them. - Use AI to analyze the data from the charts and provide a recommendation about whether the product is a good candidate for Wholesale FBA selling. - Display the analysis results in a simple and user-friendly interface, directly on the Keepa chart page. Key Features and Requirements: 1. Keepa Chart Detection: The extension must detect when a user is on a page with a Keepa chart, and extract data such as price history, sales rank,...

I need a skilled Python developer who can scrape text data from a website for me. Key Requirements: - Experience in web scraping using Python - Familiarity with handling table data - Ability to output scraped data into a CSV file If you possess these skills and have prior experience with similar projects, I look forward to receiving your bid. There are three websites which I needs this for: (1) all race results for all seasons (seasons can be changed in the top right hand corner) for all categories on this website - noting that all seasons are needed (and future seasons) (2) all results from this link: (3) another link that should return results similar to (1) but will be the method going forward so needs to be

I'm looking for an experienced web scraper to automate the collection of text data from various websites. Key Requirements: - Expertise in web scraping tools and techniques - Proficiency in programming languages commonly used for scraping (e.g., Python, R) - Ability to create automated scripts for repetitive tasks Ideal Skills: - Experience in handling large volumes of data - Understanding of data cleaning and processing Please note that the source websites and the intended use of the scraped data have not been determined yet, but they could range from e-commerce and social media to news sites. If you have a proven track record in web scraping and are comfortable working with text data, I would love to hear from you.

I'm seeking a skilled Python developer to assist with automating web scraping tasks. The primary focus will be extracting text data from various social media platforms. Key Responsibilities: - Develop Python scripts for effective web scraping of text data from specified social media platforms. - Ensure data is collected systematically and efficiently. Ideal Skills: - Proficiency in Python and web scraping libraries (BeautifulSoup, Scrapy, Selenium). - Experience with data extraction from social media platforms. - Strong problem-solving skills and attention to detail.

...specifically for the South African legal industry. This agent's primary role will be conducting legal research and retrieving case law. Key Responsibilities: - The AI agent will need to communicate back to lawyers. - It should be capable of scraping all legitimate South African law from various sources. - These sources include the South African Legal Information Institute (SAFLII), Journals and Law Reviews, and government-owned legal databases. Security is a critical aspect of this project. The AI agent must incorporate the following security measures: - Data encryption to protect sensitive information. - User authentication to ensure that only authorized personnel can access the system. - Regular security audits to maintain the system's integrity. - Robust se...

I'm looking for a Python programmer who can help me with creating a web scraping script. The primary goal of this project is to scrape data from various websites, particularly e-commerce sites, news sites, and social media platforms such as Twitter, Facebook, and Instagram. Key Requirements: - Proficiency in Python programming - Experience in web scraping - Ability to create a script based on an initial idea Please include examples of your previous web scraping projects in your bid.

Description: I am looking for an experienced web scraper to extract product reviews and general product data for Alpine Baby Muffy and Kids Muffy hearing protection earmuffs. Project Requirements: 1. Data Extraction: Target Websites: E-commerce platforms (Amazon, eBay, Walmart, official retailers, review sites, etc.) Primary Focus: Extracting and categorizing customer reviews into: Positive remarks (what customers like) Negative remarks (what customers dislike) Additional Data Points: Product name Price Availability (in stock/out of stock) Retailer name & website URL Product specifications Customer ratings (e.g., average rating, number of reviews) 2. Data Processing & Output: Output the review remarks in a structured format (CSV, Excel, or JSON) Categ...

web scraping and video automation developer. Job Description Project Goal: Automate the manual process of collecting business data and generating customized videos for outreach. Key Tasks to Automate: Business Research & Data Collection Scrape Google search results (pages 2–10) for target businesses. Extract business names, website URLs, and email addresses into a spreadsheet. Automated Video Generation Create a script/tool that: Simulates browser activity (e.g., scrolling, mouse movements) for a list of URLs. Overlays a pre-recorded talking-head video onto the automated browser activity to create a single, seamless video. Vimeo Upload & Link Tracking Automatically upload generated videos to Vimeo. Save Vimeo video links back to the spreadsheet...

I'm looking for a freelancer who can help me scrape text content from a specific website and deliver it in an Excel spreadsheet. Ideal Skills and Experience: - Proficiency in web scraping tools and techniques - Experience with data organization in Excel - Attention to detail to ensure all relevant text content is captured Please note, the specific sections of the website to be scraped have not yet been determined, so flexibility and adaptability will be key.

I'm in need of a reliable and efficient data scraper who can pull order details from my Aliexpress account into an Excel file. The scraper should allow me to manually set a date range for the data I want to extract. -Data Requirements: I will provide a template for the data. - Frequency of Task: I would like the scraper to be user-friendly enough so that I can set a start and end date for future data scraping tasks each time I run the scrapper. Ideal skills for this project include experience with web scraping, familiarity with Aliexpress, and proficiency in Excel. A good understanding of data handling and the ability to create a user-friendly interface will be an added advantage. I have attached below a sample of output f...

...Registration & Profiles – Users can sign up, manage profiles, and track their completed tasks and earnings. 2. Mission Listings – A dashboard displaying available tasks, with filters (e.g., Instagram, TikTok, Twitter). Task Submission & Proof System – Users submit proof via screenshots or by entering their username/post link. 3. Automated & Manual Approval – Automatic validation by scraping usernames or post engagement data (e.g., checking if a user has followed an account or liked a post). 4. Admin panel for manual approval when needed. 5. Payment System – Secure payments via PayPal & Amazon Gift Cards. 6. Leaderboard & Gamification (Optional) – Highlight top earners and incentivize engagement. 7. Security & Anti...

I need an expert in web scraping who can extract email addresses of faculty professors from various university websites in the educational sector. Ideal skills and experience: - Proficiency in web scraping tools and software - Previous experience in data extraction from educational websites - Excellent attention to detail to ensure data accuracy - Knowledge of data privacy laws and ethical considerations in data scraping - Ability to deliver the work in a timely manner

I'm a data analyst with expertise in data mining, statistical analysis, data cleaning, and data visualization. I have a proven history of delivering actionable insights from complex datasets. My skills include: * Advanced data manipulation * Transforming raw data into strategic insights * Creating visually compelling reports and dashboards I can help you turn your data into meaningful, actionable information. Let's collaborate to transform your data into a powerful asset for your business. Note: Specific data types, goals, and sources are yet to be determined.

Website Data Scraping for The Electric Radiator Superstore Objective: To scrape and extract all relevant data from the above website for internal use. The extracted data must be well-organised, accurate, and easy to navigate for future reference. (Wordpress based but do not want to use the WP plugin) Scope of Work: 1. Data to Scrape: • Product details (e.g., product names, descriptions, specifications, features, images, pricing, and PDFs, if available). • Blogs and articles (titles, content, and associated metadata such as publication dates). • Contact details (email, phone, address, etc.). • Any other publicly accessible, relevant information. 2. Data Format: • Deliver all extracted data in a well-structu...

I'm looking for a skilled developer to create a Decentralized Exchange DApp on Ethereum, with a custom WordPress theme and backen...facilitates token creation. - Build a DApp with a fully functional Order Matching Engine and Liquidity Pool Support. - Ensure seamless integration of User Wallets. Wallet Integrations: - Implement support for popular wallet services: MetaMask, WalletConnect, Coinbase Wallet, and Trust Wallet. Ideal Candidate: - Proficient in Ethereum smart contract development. - Good knowledge about the crypto mining pool. - Extensive experience in building DApps. - Strong knowledge of WordPress theme customization. - Past work showcasing user wallet integration and Order Matching Engine development. - Familiar with Liquidity Pool creation. Looking forward to ...

...Bot Objective To build a fully automated meme coin trading bot that autonomously identifies and executes profitable trades by analyzing patterns from historical and real-time data. The bot must include robust filters and blacklist mechanisms to mitigate risks and maximize returns. Key Features 1. Integration with PumpFun Advanced Data Acquisition: Develop a module to either scrape data or integrate with the PumpFun Advanced API (if available). Parse and store information on coins that have migrated to new contracts. Analyze historical data to identify patterns associated with high-profit opportunities. Save parsed data into a structured database for efficient querying and analysis. 2. Filters and Blacklist Mechanisms Filters: Implement configurable f...

We are launching a new digital token in the cryptocurrency market based around crypto mining and return on investment through our coin. I need an experienced expert who can create a “social media buzz” , an on-trend hash # tags to most importantly add followers across all our social media accounts including, Instagram, Twitter (X) and TikTok. The primary goal is to increase our follower base, which will assist in the promotion of our new digital crypto token. Primary Goals: - The main aim of the campaign is to generate more followers for potential investment into our coin. - You'll also need to create a buzz that drives engagement and interest in the digital token. - Also understanding of cross promotion and interaction with our target demographic within each ...

...or Node.js (Puppeteer, etc.) Frontend: Any modern framework (React, Vue, Angular) or a simple server-rendered approach. Database: MySQL, PostgreSQL, or similar for storing user credentials and scheduling data if needed. Deliverables: Complete source code with documentation. Deployment instructions for both the web application and any background scheduling processes. Basic test suite or demonstration to ensure the workflow functions end-to-end. Budget & Timeline: Please propose a reasonable timeline and budget based on the above requirements. Include examples of similar automation/scraping projects or relevant experience. If you have the expertise to develop this solution reliably and efficiently, we’d love to hear from you. Please share your approach, technical...

I need a proficient web scraper to extract 30,000 datasets from a single German fashion website. This includes product names, descriptions, prices, and product images (approximately 4 images per product, around 30 kB each). Key requirements: - Meticulous attention to d...web scraper to extract 30,000 datasets from a single German fashion website. This includes product names, descriptions, prices, and product images (approximately 4 images per product, around 30 kB each). Key requirements: - Meticulous attention to detail to ensure accurate data capture - Experience with handling images during data scraping - Ability to deliver clean, well-organized data The final dataset should be delivered in either CSV or SQL format. Please be prepared to demonstrate your...

Maybe using Puppeteer? because website seems very protected. I'm looking for a skilled web scraping expert with a focus on e-commerce. The project involves extracting specific product information from only one platform. Key Requirements: - Extracting price and availability from product pages - Experience with web scraping tools and techniques - Response in json format Please note that I will disclose the specific platform to scrape during the project. I have a shared server so this ideally would have to be done with php. For starting now please.

I'm looking for a freelancer who can scrape text data from a specific website and store it in a CSV file. Key requirements: - Proficient in web scraping and familiar with tools like Python's BeautifulSoup, Scrapy, or similar. - Experience in data extraction and CSV file creation. - Ability to deliver clean, well-organized data. Please note that the specific text fields to be scraped have not yet been determined, but you should be able to adapt to various requests. Your input on what data could be useful will be appreciated.

I'm looking for a freelancer who can help me scrape text content from a specific website and deliver it in an Excel spreadsheet. Ideal Skills and Experience: - Proficiency in web scraping tools and techniques - Experience with data organization in Excel - Attention to detail to ensure all relevant text content is captured Please note, the specific sections of the website to be scraped have not yet been determined, so flexibility and adaptability will be key.

web scraping and video automation developer. Job Description Project Goal: Automate the manual process of collecting business data and generating customized videos for outreach. Key Tasks to Automate: Business Research & Data Collection Scrape Google search results (pages 2–10) for target businesses. Extract business names, website URLs, and email addresses into a spreadsheet. Automated Video Generation Create a script/tool that: Simulates browser activity (e.g., scrolling, mouse movements) for a list of URLs. Overlays a pre-recorded talking-head video onto the automated browser activity to create a single, seamless video. Vimeo Upload & Link Tracking Automatically upload generated videos to Vimeo. Save Vimeo video links back to the spreadsheet...

...Continuous monitoring of markets to generate and execute signals around the clock. Use of robust servers and cloud infrastructure to ensure uptime and backtesting on historical data to refine algorithms. Regular updates and optimizations based on market Volatility: Sudden price movements can render signals inaccurate.(Bot Creation, Strategy Implementation, Market Analysis, Integration with IQ Option API / Web Scraping): including testing and implementation of the core functionalities. This covers: Telegram bot setup Integration with IQ Option (API or web scraping) Strategy for market analysis and execution of trades User interaction setup (confirmation for trades) Visual indicators and user interface for the bot Liquidity Issues: Particularly in OTC markets

Maybe using Puppeteer? because website seems very protected. I'm looking for a skilled web scraping expert with a focus on e-commerce. The project involves extracting specific product information from only one platform. Key Requirements: - Extracting price and availability from product pages - Experience with web scraping tools and techniques - Response in json format Please note that I will disclose the specific platform to scrape during the project. I have a shared server so this ideally would have to be done with php.

We are seeking an experienced web scraping professional to assist in extracting all content from a substantial website comprising approximately 700 pages. The project requirements are as follows: Content Extraction: Scrape the entire website, ensuring all textual content, images, and media files are accurately captured. Image Handling: Some images are hosted on external Content Delivery Networks (CDNs). These must be identified and included in the extraction process. PDF Generation: Create PDF documents for each webpage that precisely mirror the live site's appearance in desktop view. While mobile view PDFs are not mandatory, they would be considered a valuable addition. Static Site Deployment: Provide a fully functional static version of the website that can be rendered in...

I'm in need of an expert data scraper who can help me gather contact information from a Business Directory website. The focus will be on local businesses. I require comprehensive details including: - Email addresses - Phone numbers - Mailing addresses - Company names - General contact information Ideal Skills: - Proficient in data scraping - Familiar with Excel for data formatting Primary Deliverable: - A neatly organized Excel spreadsheet containing all the scraped data. Please note, the website is quite extensive and would require someone with expertise in data scraping.

I'm looking for a script that can find photos of generic product categories from e-commerce websites and add them to an Excel file. The images should be saved in JPEG format. Ideal Skills: - Proficient in scripting languages (Python, JavaScript, etc.) - Knowledge of web scraping techniques - Familiarity with Excel automation Please include your relevant experience in your bid.

I need someone who can scrap data from the existing site and enter it on the WordPress site, We also provide a product CSV file but its not complete.

I need a script that can crawl through selected social media sites, seeking out specific keywords and returning the associated text data. This data should be compiled into a CSV format for easy analysis. Key requirements: - The ability to traverse social media sites efficiently and effectively. - The capability to filter text data based on a pre-defined list of keywords. - The proficiency to compile and deliver the data in a CSV format. Ideal skills and experience: - Proficient in programming languages such as Python or JavaScript. - Previous experience with web scraping and data collection. - Familiarity with social media site structures and data dissemination. - Excellent attention to detail and ability to follow complex instructions.

I'm looking for a proficient web developer who can create a web scraper for a real estate website, specifically propertyfinder.com. The scraper should be able to extract comprehensive property details, agent information, size, pictures, bedrooms, and location. Key Requirements: - Extract data from - Save the scraped data in Excel/CSV format. Ideal Skills: - Proficient in web scraping - Familiarity with real estate websites - Excellent data handling skills. Please include examples of similar projects you've completed in your proposal.

I'm in need of a reliable tool that can meticulously scour the web for email addresses of approximately 7,000 businesses. The busi...tool must prioritize high accuracy over speed. The searches should be thorough and precise, ensuring that the email addresses collected are valid and relevant. - The results of each search should be exported in a CSV file (.csv). The file should contain the business name, address, and corresponding email address. Ideal Skills and Experience: - Proficiency in web scraping and data mining - Experience with CSV file handling and data organization - Ability to design a tool that balances high accuracy with a methodical pace. Please note, there are no specific websites or sources that need to be included or excluded from the sea...

I am seeking a skilled developer located in India to create a web scraper for me. The goal of this project is to collect open interest data from the National Stock Exchange of India (NSE). Key Responsibilities: - Design and implement a robust data scraping tool capable of extracting open interest data from the NSE. - Ensure the tool can operate continuously and efficiently, collecting data for analysis on a daily basis. Ideal Skills: - Proficiency in data scraping and web development. - Experience with financial market data, particularly from the stock market. - Familiarity with the National Stock Exchange of India and its data. I would prefer a freelancer who has prior experience in developing similar tools and can demonstr...

I am seeking an expert in data scraping to collect text content from a specific websites (aprox 25 of them). The purpose of this project is to aggregate the scraped content for further use. Each of the target sites have contact section with offices listed. We need to aggregate working hours for these. Ideal Skills: - Proficient in data scraping tools and techniques - Experience with content aggregation projects - Strong attention to detail -python Please bid only if you have proven experience in scraping website text content and are able to deliver clean, structured data fast! Message for more details.

I need the famous well known mining pool site software installation to my Ubuntu server and do every needed steps to make my new multi algo & multi coins supported mining pool Site. I may provide the licence for the MiningCore Pro Please do not bid if you are not smilliar with the above details!