Web scraping using pandas jobs
...Engineer/Full Stack Developer with extensive knowledge and experience in database structuring and implementation on AWS. The project revolves around a financial platform, necessitating the design and implementation of a robust ETL (Extract, Transform, Load) pipeline for our data warehouse. Key Responsibilities: - Creating the ETL pipeline - Data extraction primarily from vendor APIs with occasional web scraping - Data loading to various databases Ideal Skills: - Strong expertise in AWS and cloud-based database implementation - Proficiency in designing and optimizing ETL pipelines - Experience in integrating vendor APIs - Knowledge in database structuring and optimization Good to Have: - Proficiency in AI and prompt engineering Please note that while the specific databa...
i have code for collection tweets but the problem it doesn't collect tweets more than 100 tweets only i need to collect more than that
I need a professional who can help me with lead scraping. The primary source for the leads has not been determined yet, so a good understanding of various platforms and their potential for lead generation will be beneficial. Ideal Skills: - Proficiency in data scraping tools and software. - Experience with various lead generation platforms. - Knowledge of data analysis and processing. - Strong attention to detail to ensure data accuracy. Please note, the specific data to be collected from each lead is yet to be decided, so flexibility and creativity in suggesting valuable data points will be appreciated.
I'm looking for a freelancer who can scrape a public website for contact details. The information I need includes email addresses, phone numbers, and names. This is a one-time project. Ideal Skills and Experience: - Proficient in web scraping techniques and tools - Prior experience in data extraction - Attention to detail to ensure data accuracy - Understanding of privacy laws and ethical standards in data collection This is the website: We need the following information: - Name - Adress - E-Mail - Phone number You find an example in the attached Excel file. Please add all other contacts in the same manner.
Job Description: We are looking for an experienced web developer/designer to create a professional, responsive website for our Home and Office Renovation business using WIX. The website should be modern, user-friendly, and responsive for all devices (mobile, tablet, and desktop). Reference Websites: Key Features and Requirements: Platform: The website must be developed using WIX. Design: Clean and modern design inspired by the reference sites. Must be visually appealing, intuitive, and user-friendly. Responsiveness: Fully responsive for mobile phones, tablets, laptops, and desktops. Services Pages: The website should include the following services pages: Kitchens Bathrooms Painting Flooring Wardrobe and Cabinets Villa Renovation
I'm seeking a developer to create a script or browser extension for me. This tool should help me, with only view access to a Shopify backend, to scrape order details at scheduled intervals. Key Requirements: - Acc...view access to a Shopify backend, to scrape order details at scheduled intervals. Key Requirements: - Access the order tab and individual orders - Copy specific information: customer name, number, products, address, city or state Data Handling: - The scraped data should be saved in a CSV format Ideal Skills: - Proficient in developing Chrome extensions or scripts - Previous experience with web scraping - Knowledge of data handling and CSV format Please note, this is a scheduled task, so the tool should be able to operate at predetermined intervals withou...
Project Details £10.00 – 360.00 GBP I am seeking a talented freelancer with strong web scraping skills, preferably in Python, to assist with a project involving two specific websites initially. There is potential for more sites in the future. I will provide the specific data fields that need to be extracted. Key Requirements: - Proficiency in web scraping and/or Python. - Familiarity with MS SQL Server databases is a plus, but not essential. - Ability to extract data efficiently and effectively. - Understanding of necessary security measures, including captcha integration if required. - Capability to deliver quality work quickly, as this project is a priority and needs to be completed ASAP. This project could evolve into a long-term partnership, as...
I'm in need of a data extraction expert to help me gather information from a specific website. The dataset contains approximately 200,000 entries, and I'm looking to filter for contacts from a specific location. Key Requirements: - Export data fields: Name, Email, Designation, Company Name, - Data to be delivered in Excel format - Experience with web scraping and data extraction - Ability to filter data by specific location Compensation: I can offer 20-30 paisa per contact.
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is React.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here: Overall Development Requirements: - Front-End to Back-End Integration: All front-end features must have corresponding back-end operati...
... Introduction to Data Analysis - CRISP-DM reference model - Data Analytics workflows - Distinction between Artificial Intelligence, Machine Learning, and Deep Learning - Roles and requirements of Data Engineers, Data Scientists, and Data Analysts in organizations Review of Python Fundamentals - Data types - Functions Data Analysis - Key Python modules for Data Analytics (NumPy, Pandas) - Data preparation process - Data mining algorithms in Python - Artificial Intelligence (AI) in the workplace - Introduction to specific AI technologies and their applications in professional settings Data Visualization - Exploratory Data Analysis - Insights - Data quality - Benefit analysis - Visualization with Python: Matplotlib, Seaborn, Plotly Express - Dat...
I'm seeking a professional email scraper who can help me collect email addresses from specific ...email addresses from specific social media platforms, for a Rock Band that have 969k Facebook followers and 154k on followers on Instagram. I have recently used the services from someone here and was supplied with a completely fake list, he gave me 95.5% and I couldn't find one single known 'fan' email. I run a website and social media for ex members of that band and I already have 1.5k emails using targeted Facebook ads for that band that have since logged in as members to our website. So if you're saying you can provide 70% success rate, I would anticipate to find a similar % rate when I check your list, I hope that sounds reasonable, fair and understandable....
I'm seeking an expert in Apify for web scraping and for process automation. The main focus of this project is data extraction and reporting, specifically targeting market trends data from various platforms. Key Responsibilities: - Utilize Apify to scrape relevant market trends data from e-commerce websites, social media platforms, and news/financial sites. - Implement to automate the data extraction process, ensuring efficiency and consistency. - Generate comprehensive reports based on the extracted data. Ideal Skills and Experience: - Proven experience in web scraping using Apify. - Proficient in using for process automation. - Strong understanding of market trends data. - Excellent data analysis and reporting skills. - Ability to work w...
I'm in need of a trading strategy to be implemented on the TradingView platform using Pine Script. The strategy should be based on breakout techniques and specifically utilise the Central Pivot Range (CPR) indicator. Key requirements: - Develop a comprehensive strategy that includes Entry points, Targets, and Stop Loss (SL). - Incorporate a Dynamic Trailing Stop (TS) within the strategy. - The strategy should be designed for a single timeframe, as I do not require multi-timeframe analysis. - The milestone for payment will be created only after the strategy is fully ready and tested. Ideal Skills: - Proficiency in Pine Script. - Experience with TradingView platform. - Strong understanding of breakout strategies and CPR indicator. - Ability to incorporate dynamic elements into...
...proficient Python developer with extensive experience using Beautiful Soup, Scrapy, and Requests for a web scraping task. Key Requirements: - Expertise in Python and web scraping libraries such as Beautiful Soup and Scrapy - Proficient in using Requests for HTTP requests - Comfortable working with public websites - Capable of extracting diverse data types including text, images, and audio Task Overview: - The project involves the extraction of data from a public website. - The specific data types to be extracted include text, images, and audio. Ideal Candidate: - A keen attention to detail is crucial for this task, as is the ability to navigate and extract data from potentially complex web structures. - Prior experience with similar...
grocery stores,Surpermarkets ,conviniance stores Fresh Produce wholesellers Fresh Produce importers Catering Companies Food Processor Wine producers Dairy product manufacturer Meat processor Fish processor
I need a freelancer to scrape 30,000 records of contact information from a provided URL within 48 hours. The information will specifically consist of names, email addresses, phone numbers, and mailing addresses. The final output should be in an Excel format. Ideal skills and experience for the job include: - Proficiency in web scraping - Experience with Excel - Attention to detail - Ability to meet tight deadlines
I have a project focused on video and image compression. My goal is to achieve maximum compression rates while preserving original quality using vector quantization (VQ) and deep learning techniques. Please bid only if you have prior experience with similar projects. Detailed requirements will be shared with the most suitable candidate.
I'm looking for a skilled developer to integrate the JVZoo payment system with my custom-built SaaS platform.. The integration should utilize IPN (Instant Payment Notification) to trigger specific actions upon payment confirmation including to Activate subscription, Send confirmation email, Update user account status Key Requirements: - Proficient in working with JVZoo payment systems - Experience with SAAS platform integration - Familiarity with IPN (Instant Payment Notification) The SAAS platform offers both Monthly and Annual subscriptions. Upon payment, the following actions should be automatically triggered: - Activation of subscription - Sending of payment confirmation email to the user - Update of the user's account status If you have a strong background in payment syst...
I'm in need of a web scraping expert with experience in extracting product information from manufacturer websites. Key Requirements: - Scrape product names and descriptions - Scrape product specifications Ideal Skills: - Proficient in Python or similar scraping tools - Prior experience with manufacturer websites - Good understanding of product specifications and descriptions Please provide examples of similar projects you've completed.
I'm in need of a professional who can extract data from a corporate website and compile it into an Excel spreadsheet. Key Requirements: - Extract data from a corporate site. - Data includes: Shopping Centre Name, Street Address, Suburb, State, and Post Code. - Focus on all store locations in New South Wales (NSW). - Use web scraping techniques for data extraction. Ideal Skills: - Proficiency in web scraping. - Experience with data extraction from corporate sites. - Excel spreadsheet management skills. - Familiarity with New South Wales geography is a plus.
...and move it from rough MVP to an evantually a launched site. The primary goal of the site is to enable easy access to data through visualizations and dashboards. This project involves completing a basic freemium model membership site that lists service offerings. Key Responsibilities: - Develop a freemium model membership site - Integrate role based auth system using 3rd party db auth system - Integrate listing scraping system using 3rd party scraper - Create a document generation feature - Establish a process management system (calendaring, scheduling) - Implement data processing and taggging system Ideal Skills: - Experience in developing membership sites, particularly freemium models - Proficiency in leveraging listing systems and document generation features -...
I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...
We are looking for an experienced Android developer to create an APK similar, with features like real-time audio communication, text messaging, and a user-friendly interface. The project involves using NIO (Non-blocking I/O) and WebRTC libraries for high-performance, low-latency communication.
I'm looking for a detailed, realistic t-shirt image for my apparel company featuring two racecars. Design Specifications: - The lead racecar should be depicted going into an outside turn, scraping the wall with its back end and creating sparks. - The second place car needs to be shown sliding in across the bottom of the turn. Important Notes: - The design perspective should be an angled view. - The racecars need to be in bright and vibrant colors. - The Image must be in vector form. - The final image files must be AI (Adobe Illustrator) and PDF file formats. Your expertise in creating realistic, dynamic illustrations and experience with designing for apparel will be crucial for this project. Please refer to the attached pictures for reference.
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is Vue.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here:
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is Vue.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here:
...Twitter, LinkedIn) - Manage strong, targeted social media campaigns. - Oversee and manage paid advertisements. - Assist in purchasing followers to increase visibility. - Email marketing (in charge of scraping details for target markets) (also creating music and uploading it on youtube spotify and other music platforms. Incharge of creating ai generated music videos, for multiple countries (faceless YouTube channels) This project involves two app launches, each targeting a different market. Therefore, flexibility and understanding of various market segments is crucial. Ideal Skills: - Proficient in web development - Experienced in social media management - Skilled in content creation and digital marketing - Knowledgeable in managing paid adverts and purchasing followe...
I need a freelancer who can help me scrape users from specific public Telegram groups and add them to my Telegram group.
I need a professional web scraper to extract contact information from multiple pages of a website and export the data into an Excel spreadsheet. The specific contact information to be extracted includes: - Process number - Face value - Creditor's name - Creditor's CPF Ideal candidates for this project should have: - Proven experience in web scraping - Proficiency in Excel - Attention to detail to ensure all data is accurately captured.
I'm seeking a professional adept in web scraping and macro automation. The project primarily involves: - Scraping financial data from company websites. - Extracting contact details from these websites. Ideal candidates should have extensive experience in data scraping, with a strong understanding of financial data and company websites. Proficiency in macro automation is a must. Please provide examples of similar projects you've completed in your proposal.
1) Collect data, examine it, and identify any duplicates or outliers, ensuring its completeness and accuracy. 2) Create a table and organize the data in a clear and easy-to-understand format. 3) Provide statistical analysis using mean, median, mode, variance, standard deviation, and other relevant metrics. 4) Present charts that illustrate the relationships between variables 5) Present charts that help predict future trends, identify gaps, and improve performance and operational efficiency.
I'm looking for a one-time web scrape of an eBay page containing 5,500 products. The products do not have any variants, which should simplify the task. Data to be scraped: - Product name, price, category, subcategory, brand - Product description and images The final deliverable should be an Excel/CSV file containing all the scraped data. Ideal skills for this project include: - Proficient in web scraping - Experienced in data organization and Excel/CSV Please, only bid if you can deliver quality work in a timely manner. Thank you!
I'm looking for a skilled data scraper who can collect both organic and paid Google search results for me. The data will need to be delivered in CSV format. Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Experience with data extraction from Google - Knowledge of SEO and understanding of organic vs paid results - Ability to deliver data in specified formats, particularly CSV - Prior experience with similar projects would be an advantage. Please include examples of your previous work with Google data scraping in your proposal.
I'm looking for a proficient Python developer to assist in the ongoing developme...should have a solid understanding of clean code practices and a basic familiarity with Indian stock market concepts. Your role will not involve building the bot from scratch, but rather completing specific tasks or modules. Some specifications are available for the modules you will be working on, but you will also need to interpret and define some requirements yourself. Preferred Libraries: - Pandas - NumPy Skills & Experience: - Proficient in Python - Experience with algorithmic trading bots - Familiarity with Indian stock market concepts - Strong clean code practices - Experience with data collection and preprocessing - Experience with strategy development - Experience with execution a...
I need a seasoned Octoparse 8 expert who can create various bots for scraping different E-commerce stores daily. The data will be used to stock my own Wordpress store, so accuracy and timely updates are crucial. Requirements: - Develop different bots for different product categories, including Electronics, Home and Garden, Kitchen, and Makeup. - Scrape specific data fields such as product title and description, price and availability. - Manage scraped data to include correct data fields and images The ideal candidate should have: - Proven experience with Octoparse 8 - Previous work in E-commerce data scraping - Familiarity with Wordpress store setup - Attention to detail for data accuracy - Ability to deliver on a daily schedule.
I need column AB from this list created - email addresses for the people in each row
I'm in need of a reliable and efficient web scraper skilled in Selenium. The task will be to scrape an e-commerce site for clothing information on a daily basis. Key Responsibilities: - Scraping data on a daily basis - Capturing product name and price, product images, and product descriptions Ideal Skills: - Proficiency in Selenium - Experience in web scraping, particularly from e-commerce sites - Ability to deliver consistent, reliable data on a daily basis
Scrape data from an auto part website and create CSV. You will also get images without copyright. Project must be in Shopify standards and be ready to upload. Scraping may be over 15k sku's
I'm seeking a skilled data scraper who can gather product descriptions and pricing information from a specified auto parts website. Key Requirements: - Scraping data for more than 2000 products - Creating a well-structured CSV file - Formatting product descriptions in plain text Ideal Skills: - Proficient in web scraping tools and techniques - Experienced in data organization and CSV creation - Attention to detail to ensure accurate data collection Please only apply if you have previous experience with web scraping and can provide examples of similar projects.
I am looking for a Python expert who can help me automate sending direct messages on Instagram and other social platforms. Ideal Skills: - Proficient in Python - Experience with Instagram's API or similar automation tools - Understanding of Python libraries for web scraping and data handling Key Requirements: - Create a script that can send pre-defined messages to a list of users at specified intervals to avoid being flagged as spam. - Ensure the script can handle potential errors, such as users with private accounts or those who have blocked the sender. - Provide a user-friendly guide for running the script on a local machine. Please note, adherence to Instagram's terms of service is a must. Your proposal should highlight any relevant projects you've compl...
I need an experienced creator for a 5-minute 4K 3D animation video of the Airbus A350. This video should include scenes of passenger boarding, takeoff, and landing. Key Requirements: - High level of detail and accurate engineering representation. - Inclusion of a modern/contemporary background score. - Seamless integration of sound effects and a professional voiceover. Deliverables: - A 5-minute 4K video. - Source files. - A draft for review. - Step-by-step documentation of the generative AI process used. Ideal Skills: - Proficient in 3D engineering animation. - Strong understanding of the Airbus A350. - Excellent audio-visual integration skills. - Experience with creating detailed source files and documentation.
...identify profitable wallets worth copying, based on reliable data metrics such as Profit and Loss (PnL), win rate, and performance over weekly/monthly timeframes. The current implementation is plagued by inaccurate or false data, resulting in wallets with near-zero balances being reported as highly profitable. Despite trying multiple APIs (Solana public API, GMGN API, and BirdEye API) and even scraping data from relevant websites, the results have been inconsistent and unreliable. This project requires a solution that not only filters out fake or non-credible wallets but also provides a robust mechanism to analyze and verify real-world wallet performance. Key Objectives: 1. Data Accuracy: - The output data must accurately reflect the true wallet performance on th...
I'm in need of an AI agent tailored for market research purposes. This agent will be responsible for scraping specific product pricing from Australian supermarkets, focusing on household items. The data collected should encompass a comprehensive set of product details including price, promotional price, weight, dimensions, colour, and additional product information. Ideal Skills: - AI/ML Development - Web Scraping Expertise - Data Analysis - Market Research Understanding The AI should collect this data on a monthly basis. Prior experience in developing similar projects would be highly regarded, as well as a deep understanding of market research methodologies and requirements.
I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...
I need a skilled programmer to automate login on a specific website. The primary goal is to extract data, with the volume of requests ranging from 20,000 to 100,000 per week. Key Requirements: - The automation script must be able to interact with a website. - The automation must be capable of bypassing DataDoom CAPTCHA challenges. Ideal Skills: - Proficient in web scraping and automation tools - Experience dealing with CAPTCHA bypass solutions. - Understanding of ethical and legal considerations in data extraction. The goal is to extract data systematically and efficiently. Please ensure your proposal outlines your relevant experience and approach to this project.
I'm looking for a quick Python script that can help me automate the reading and databasing of LAS file format headers using the LASIO library. The product tables should be exported in csv format. - Read a library of LAS files - Ingest and export CSV files The task is straightforward: there's no need for specific processing or data transformations on the files before exporting to CSV. The ideal freelancer for this job should have: - Proficiency in Python, particularly in file handling and CSV manipulation - Experience with automating tasks using Python scripts - Ability to deliver a simple and effective script in a short timeframe.
...process of registering vehicle license plates for visitors at our parking platform. Currently, the process is manual, and we would like to integrate voice-to-text and SMS-based automation to streamline registrations and improve customer experience. Key Responsibilities: Voice-to-Text Integration: Set up a system that can handle incoming calls, convert the spoken license plate information into text (using Twilio Speech Recognition), and automatically register the details in our backend system. Send an automated confirmation SMS or email to the visitor after successful registration. SMS Registration Automation: Integrate Twilio’s SMS API to automatically process incoming SMS with the license plate number. Parse the SMS content to extract the license plate number and valida...
I need an expert in data scraping to create Parsehub templates for extracting product information from a retailer's website. The specific product details I want to be captured include: - Product names and prices - Product descriptions and reviews - Product images and specifications - Product specs The data will be used for catalog comparison. Ideal skills for this job include: - Proficiency in using Parsehub - Experience in scraping data from e-commerce websites - Knowledge in handling product-related data - Ability to create effective templates for recurring tasks Please bid only if you have the relevant experience and skills. Thank you.
I'm looking for a skilled data scraper who can extract information from exhibitor profiles on a trade website. The specific information I need includes: - State and Local Destination Marketing Orga...information I need includes: - State and Local Destination Marketing Organisations Name Contact details (primarily email addresses and phone numbers) I would prefer freelancers with prior experience in web scraping, and who are familiar with data extraction software. Please include examples of similar projects you've completed in your bid. Confirm price and only apply if you can complete by monday 9am GMT
