Web scraping using selenium and beautifulsoup jobs

...expert in Nodejs, nginx reverse proxy, and bash scripts for a personal project. This personal project is focused on web scraping. The successful candidate will be tasked with scraping product information, news articles, and social media data. Exemplary knowledge of proxifying requests through nginx and formatting bash scripts that interact with Nodejs applications is a requisite. Mandatory Skills and Experience: - Advanced proficiency in Nodejs - Extensive experience with nginx reverse proxy - Expertise in formatting bash scripts - Proven experience in web scraping, with emphasis on scraping product info, news articles, and social media data The ideal candidate must be able to present a portfolio demonstrat...

Hello I have a simple WordPress website that has been online for about 8 years The theme it was made with is outdated & causing issues I'd like the same website redone simply using HTML because we rarely change any content there  It has 5 simple pages: Home, About, Contact, Services, Work for us Need this done ASAP Will share link to site

I'm looking for a skilled web scraper who can extract data from the website The data is dynamically loaded through JavaScript and there is a 'view detail' button that opens a new tab. Key Requirements: - Scrape all relevant data from the site, including text and image data. - Capture agent name and contact details when clicking the 'view detail' button. - Deliver the final scraped data in a CSV file. Ideal Skills and Experience: - Proven experience in web scraping with tools like Python, BeautifulSoup, Scrapy, or Selenium. - Understanding of JavaScript and how to scrape dynamic content. - Experience working with CSV files and data cleaning. Please note that the data will be collected ...

I'm seeking a developer to create a web scraping tool that will extract reviews from the Salesforce Appexchange on a daily basis. The scraper should collect the reviewer's name, review text, and rating. The data needs to be both stored in a database and displayed on a dashboard.

I'm looking for a detail-oriented individual to help me with a data extraction task. The job involves visiting a specified website, copying relevant text content, and pasting it into an Excel file. The data extraction will involve: - Copying text content from the website - Extracting data from more than 10 tables The final Excel file should be in a simple text format, without any complex or styled formatting. Ideal skills for this task include: - Proficiency in Excel - Attention to detail - Ability to follow instructions accurately - Experience with data entry and web scraping Please ensure you can commit to this task before bidding. Thank you.

Please Sign Up or Login to see details.

We are on the lookout for a creative and witty freelancer with a sharp sense of humor and a solid understanding of the U.S. landscape—be it politics, entertainment, or any trending topics. Your task? To provide us with **20 humorously crafted comments daily** based on the latest news and trends in the Instagram USA. Responsibilities: - Keep an eye on trending U.S. news from credible sources. - Deliver 20 humorous comments from INSTAGRAM "daily" based on these trends. Budget: -$50/month, with potential for an increase based on performance and results.

I need a freelancer to help me with a daily data extraction task from a web page that contains several tables. This project involves logging into the web page, extracting mixed data (text and numbers) from the tables, and pasting each cell into a provided Excel file format. Key Requirements: - Data Type: The data to be extracted is mixed (text and numbers). - Frequency: The data needs to be extracted daily. - Login Method: The login to the web page should be automated with credentials. Ideal Skills and Experience: - Proficient in data extraction and web scraping. - Experience with Excel and formatting data. - Ability to set up automated login processes. - Attention to detail and ability to handle mixed ...

I need a freelancer to help me with a weekly data extraction task from a web page that contains several tables. This project involves logging into the web page, extracting mixed data (text and numbers) from the tables, and pasting each cell into a provided Excel file format. Key Requirements: - Data Type: The data to be extracted is mixed (text and numbers). - Frequency: The data needs to be extracted daily. - Login Method: The login to the web page should be automated with credentials. Ideal Skills and Experience: - Proficient in data extraction and web scraping. - Experience with Excel and formatting data. - Ability to set up automated login processes. - Attention to detail and ability to handle mixed...

...add-on. The website will serve as an information hub, marketing tool, and support center, following a clean and modern design, with a focus on user experience, responsiveness, and SEO optimization. Objectives Inform: Clearly showcase the product (Google Sheets Common Tools Add-On) and its benefits. Engage: Provide free resources such as templates, formulas, and tips to attract and retain users. Support: Offer a user-friendly support section to address customer inquiries and issues. Drive Conversions: Encourage users to download/purchase the add-on. Deliverables 1. Landing Page Eye-catching hero section with a clear call-to-action (CTA) to "Download the Add-On" or "Try It for Free." Highlights of the add-on’s ma...

I would like to have a plugin developed with scraping functionality for use on my affiliate site(AdultSite), which is built on WordPress. Based on this, I would also like to request ongoing site maintenance and support. Create a plugin using Python, AWS, and PHP. The plugin must be capable of automating posts to WordPress. The deadline is not urgent, so I am flexible with the timeline. The preferred programming languages are Python, PHP, etc. When submitting a proposal, please include your desired price and delivery time. please check this docs. [Link] i want to hire professional person.

I'm in need of a skilled data scraper to help me extract product information from various e-commerce websites. The primary focus will be on gathering product descriptions and specifications, along with the ingredients of food products and their barcodes. Ideal Skills: - Strong experience in data scraping - Familiarity with e-commerce and retail sites - Attention to detail - Ability to handle and process large data sets Please ensure that your proposal includes examples of similar projects you have completed.

...looking for a web scraper who can gather information on all solicitors in New South Wales, Australia. The focus should be on solicitors specializing in family law, property law, and Planning and Environment. The data should be categorized by specialty and include: - Full name - Firm - Address - Email - Phone number - Specialty The final deliverable should be an Excel spreadsheet that I can filter. It is important that the data is sourced from a variety of platforms, including: - Official government websites - Solicitor associations' directories - General business directories Additionally, I require all data to be cleaned and validated. The ideal freelancer for this project should have experience in web scraping and data ...

I'm seeking an expert in deep learning and computer vision to develop an object detection model. The primary task will be to identify multiple objects within natural scenes, like landscapes or animals. Key Requirements: - The model should be capable of detecting various objects in a single image - A strong understanding of deep learning techniques and computer vision is essential - Experience with working on projects involving natural scene images will be highly beneficial

...value the freshness of hand-ground beans, especially in outdoor settings like camping or hiking. While it is admired for its portable size and manual operation, eliminating the need for electricity, the grinder has several design vulnerabilities when it comes to outdoor utility. Key components of Hario Skerton Plus are displayed in Figure 1, showcasing its current design. It features a cylindrical body made from materials like ceramic for the burrs and a combination of steel and glass for the rest of the structure. Despite these sturdy materials, the grinder’s construction presents issues during transport; its components are sensitive to damage, and the grinding mechanism is prone to wear, resulting in reduced reliability over time. Fig. 1 Hario ...

We are looking for a freelance designer to: Duplicate a Website Design: Recreate an existing website design using WordPress, ensuring a responsive and high-quality result. Figma File Creation: Create a complete Figma file of the website design, including all layouts, components, and visual elements.

...personalized web platform for monitoring my stock market holdings. The platform should utilize web scraping for automating stock data collection. It needs to present a comparison of my holdings alongside some mathematical calculations. Key Aspects: - Data Visualization: The web solution should include a webpage displaying stock prices and performance summaries. - Data Source: All stock prices and performance summaries should be fetched from custom APIs. - Previous Work: Please share screenshots of similar projects you have developed. Ideal Skills: - Proficient in web scraping and API integration - Experienced in creating data visualization platforms - Familiar with stock market data Please note that the project requires ...

I'm in need of a skilled data scraper with experience in database creation. The project entails: - Scraping from public databases and ASSOCIATION website I need to create my own database of golf course pro shops. Specifically, full name(s), of Golf Pro and most importantly, want to then email anyone at that facility and get a reply with TWO FIELDS filled in….Who is the BUYER for the Pro shop? And their email. Key Skills and Experience Required: - Proficient in data scraping tools and techniques. - Experience in handling and organizing large datasets. - Ability to deliver clean and well-structured data in the specified format. Please provide examples of similar projects you've completed in your prop...

I have two logos and I need elements of each used. For example: I have a skeleton head that I want used with a hat from a different logo. So just putting them together and making the cohesive looking.

I'm in need of a skilled data scraper with experience in database creation. The project entails: - Scraping from public databases and ASSOCIATION website I need to create my own database of golf course pro shops. Specifically, full name(s), of Golf Pro and most importantly, want to then email anyone at that facility and get a reply with TWO FIELDS filled in….Who is the BUYER for the Pro shop? And their email. Key Skills and Experience Required: - Proficient in data scraping tools and techniques. - Experience in handling and organizing large datasets. - Ability to deliver clean and well-structured data in the specified format. Please provide examples of similar projects you've completed in your ...

Build a directory using wix EXACTLY as described in this video I'll give you dev admin access to my wix.

I have a list of 4 million USA business URLs that needs to be scraped for various data points. Key Data Points: 1. Company Name 2. Company Industry/Niche 3. Company City 4. Company State 5. Company Zip 6. Company Phone 7. Num...Phone 7. Number of Employees 8. Company Email 9. Company Street Address 10. Company Gross Annual Revenue 11. Any Additional Fields for Better Insight Deliverables: - Complete data in CSV format - A "bad" field for invalid URLs with the corresponding URL in the output table - Prioritize the first 7 fields, but also include as much data as possible for the other fields Your expertise in data scraping and CSV formatting is crucial. Please note that the list of URLs will be provided by me. Your task will be to extract as much useful data as p...

I'm in need of a proficient scripter to create a web scraping program for Carousell user review pages. The script should be capable of reading and extracting information from inputted Carousell user URLs without requiring a user login. Information to extract: 1) Unique Carousell user ID (not profile username) 2) Profile username 3) Rating score 4) Total number of reviews The output should be in Excel or CSV format. Please note that the Carousell website utilizes Cloudflare and IP restrictions. Key Requirements: - Expertise in web scraping and script writing - Familiarity with working around Cloudflare and IP restrictions - Ability to deliver output in required formats Clarification on Project Details: - Dynamic IP Rotation: I...

I'm looking for an experienced Python developer to help me scrape product data from booking.com. The target data includes hotel details and amenities as well as user reviews and ratings. Ideal skills and experience for the job include: - Proficiency in Python, with a focus on data scraping - Familiarity with web scraping libraries and tools - Experience in data cleaning and processing - Understanding of how to ethically and legally scrape data - Ability to provide the data in a structured and easily digestible format

...specifically for Basketball and Tennis. The tool should compare odds of the same market across various betting platforms, displaying these comparisons in an organized and visually appealing way. Key Requirements: - The application can be a Chrome extension, standalone software, or a bot, whichever fits best. - It should be capable of tracking changes in odds that occur within a few seconds. - The tool should be able to compare odds across all markets. I will provide the specific betting websites to monitor later. Ideal Skills: - Proficient in software development, specifically in creating Chrome extensions or standalone software. - Experience in developing bots for web scraping and data comparison. - Understanding of sports betting and famil...

I'm looking for a skilled machine learning expert who can develop a malware detection model for me. The model should use supervised learning techniques to classify data as either ...model for me. The model should use supervised learning techniques to classify data as either malware or benign. Key requirements: - Experience with supervised learning techniques - Ability to handle and process malware class data - Proficiency in building and training classification models The ideal candidate will have a strong understanding of machine learning and cybersecurity. They will be able to create a model that accurately identifies different types of malware, including ransomware, Trojan horses, and spyware. The ultimate goal is to develop a reliable system for detec...

I'm looking for a programmer who can create a software that lists all music venues, nightclubs, and strip clubs in a state of choice. The program should be able to transfer the data into an Excel sheet with a specific format that I'll provide. The Excel sheet should include: - Name of the venue - Address - Owner or manager's name - Contact information (phone number and email address) The data should be sourced from crowdsourced platforms. Experience with data scraping and Excel is a must, as well as the ability to work with a specific format.

...Beamforming Optimization: Develop and implement optimization algorithms using GA, PSO, and a hybrid GA-PSO approach to jointly optimize the beamforming vectors at the Base Station (BS) and phase shifts at the RIS. ·      Performance Improvement: Maximize the achievable sum rate, improve the signal-to-noise ratio (SNR), and minimize power consumption by solving the non-convex optimization problem of joint beamforming. ·      Algorithmic Comparison: Conduct a performance analysis and comparison of GA, PSO, and GA-PSO algorithms under various simulation conditions, including different RIS elements, users, and channel environments. ·    ...

I need help evaluating my API's encryption and decryption times using the Golang Gofe library, specifically its ABE scheme. The specific tasks involve: - Measuring encryption time in relation to the number of leaf nodes in the access policy. - Measuring decryption time in relation to the number of attributes in the private key. Despite exploring various methods and implementations, I have not been able to achieve the desired results. I am a beginner with the Golang Gofe library and am particularly struggling with integrating it into the ABE scheme. I need someone with advanced expertise in this library who can help me accurately evaluate these performance metrics. Ideal skills for this project include: - Extensive experience with the Golang Gofe librar...

...to help us collect and organize data from UrbanPro. The primary focus is on students registered for IT and non-IT courses who are actively seeking enrollment. This project requires someone familiar with ethical data collection practices and tools. Project Scope: Data to be Collected: Student names Course interests (IT and non-IT) Contact details (if publicly available and allowed) Location preferences Platform: UrbanPro () Purpose: To identify prospective students interested in enrolling in IT and non-IT courses. To create a database for targeted marketing campaigns. Requirements: Experience in web scraping or data mining. Proficiency in tools like Python (BeautifulSoup, Scrapy), or similar software. Knowledge of UrbanP...

Please continue with the 2nd round of 6 links scraping

I need from Pakistan or India. I need a Junior Level Freelancer who has good skills in Sentiment Analysis using Python It will use Windows OS I need a serious and hard working person

I need a freelancer who can extract text content from a specific website for me. This is a one-time extraction task. The extracted data should be delivered in an Excel file. Ideal Skills: - Web scraping - Data extraction - Proficiency in Excel - Proficiency in Python, specifically libraries like BeautifulSoup or Scrapy for web scraping. - Experience in cleaning and organizing extracted data for better usability. Please note: The focus of this project is solely on the collection of text content.

I need a skilled data analyst to replace whole numbers in specific columns of my .csv file with values sourced from two .xlsx files, and PI.xlsx. The deliverable is a modified .csv file that maintains the original structure.

...Co-Founders, C-Suite executives, and Chairpersons from Indian companies with 500+ employees. The scope of this project includes data scraping from Apollo and other reliable sources for validated email IDs and contact numbers. Key Requirements: - Data collection should specifically include work contact details ( email) of the aforementioned individuals. - Companies should belong to all sectors, not limited to a specific industry. Ideal Skills: - Proficiency in data scraping. - Experience with Apollo or similar platforms. - Ability to verify data for accuracy and reliability. - Familiarity with the Indian corporate landscape, especially large companies. This project will be a great fit for you if you have the necessary skills and experi...

I need a web scraper that can extract PDF links from an educational site and list them in an Excel file. Ideal skills and experience for the job: - Proficient in web scraping tools and techniques - Experience with Excel - Familiarity with educational sites preferable Work Process: You have to extract PDF links from last 10 session question papers (December 2019 to June 2024) -Visit the link: -Choose Session from (Dec 2019 to Junr 2024) -Here you will find a link of around 23-24 schools like SOMS, SOE, SOCE -Click on it and Extract complete page and re-arrange them using Course Code, Course Name, PDF Link -Do not forget to add Program Name in Heading so that I can understand which list belongs to which program -Each link s...

Junior Data and Automation Associate Are you a fresher eager to dive into the world of data management and automation? We’re looking for a motivated individual to help us manage customer data, update product pricing, and set up simple automation workflows. What You’ll Do: • Data Entry and Syncing: Use Microsoft Excel or Google Sheets to handle bulk imports and sync data across platforms. • Price Updates: Assist in updating product pricing on Amazon and our website using CSV files. • Basic Automation: Set up simple automation workflows using tools like pabbly connect or (don’t worry, we’ll guide you!). • Support Web Scraping: Help gather data using basic web...

Data Automation and Pricing Specialist Are you a tech-savvy professional who thrives on managing data and building automation systems? We’re seeking someone with a strong background in automation, data integration, and bulk pricing updates for Amazon and our website. What You’ll Do: • Automation Expert: Develop and maintain automation workflows using tools like Pabbly Connect and to streamline data management processes. • Data Import and Syncing: Manage bulk imports via CSV using Microsoft Excel or Google Sheets, ensuring seamless data flow across platforms. • Bulk Pricing Updates: Implement large-scale pricing updates for products on Amazon and our website using CSV files. &bull...

Please register the businesses using the keywords I provided on Google Maps to my WordPress site. business name, phone number, detail, photo, location, region need to be added in category you can search just 1 city and use your method

I need a skilled data scraper to collect specific text from a webpage. This is a one-time job, and I require the data to be delivered in a CSV format. The ideal freelancer for this project should have: - Proven experience in web scraping - Proficiency in delivering data in CSV format - Ability to work independently and meet deadlines Content to scrape is an online retail store. Values to record are: - Product SKU - Product Name/Title - Product Price - Product page URL Two CSV files showing. - All items on sale, found on a single landing page, under 400 urls - Entire site, under 10k urls Website to scrape will be given to the winning bidder. Please tell me you favourite song and what artist it's by in your proposal. Thank you.

I need from Pakistan or India. I need a Junior Level Freelancer who has good skills in Sentiment Analysis using Python It will use Windows OS I need a serious and hard working person

I'm looking for a Unity developer to create a 2D Tic Tac Toe game using  Low Level API/Transport Layer only. The game should utilize the Multiplayer Low Level API/Transport Layer and start from the provided server and client networking scripts. Key Requirements: - Expand the provided server and client scripts to create a fully functional Tic Tac Toe game. - Right now it just have making connection and sending message to each other functioning. - Ensure the game is compatible with PC. Ideal Skills: - Strong experience with Unity and C#. - Previous work with the Multiplayer Low Level API/Transport Layer. - Ability to deliver clean, efficient code. ** Open and see the client and server scipt. Use this as a base and e...

I'm looking for a skilled data scraper to extract product details from a specific website. prefer to build out in Octoparse AI or Octoparse Key requirements: - Scrape product names, prices, and descriptions from the site - This will be a one-time project, so the data needs to be captured all at once - Scrape image URLs for each product listed on the website Ideal skills for this project include: - Proficiency in web scraping tools and techniques - Ability to deliver clean and organized data - Attention to detail to ensure all necessary information is captured Please deliver the data in CSV format. Please also include product images in the extracted data. I have full access to the website including login credentials if needed.

I need a skilled Selenium developer to write code for testing various aspects of my CRM website. The tests will need to cover: - User login and authentication - Form submissions and data entry - Reporting and data retrieval The tests will be run locally on my machine and only on the Chrome browser. Ideal candidates for this project should have extensive experience with Selenium, be able to write efficient, reliable test scripts, and have a solid understanding of web application testing. Please only apply if you are able to deliver high quality work within a reasonable timeframe.

More details: Is this project for business or personal use? Business What information should successful freelancers include in their application? Working Knowledge of using Elementor on WordPress How soon do you need your project completed? Within a month

I'm looking for a skilled web scraper to help me gather contact information from various websites and directories. Key Requirements: - Proficient in web scraping tools and techniques - Able to deliver data in a well-organized Google Sheet

...analysis of Takni Com's performance using the Balanced Scorecard framework. We will identify critical gaps across five key perspectives – Financial, Customer, Internal Processes, Learning & Growth, and IT – providing actionable recommendations for improvement. Our deliverables will include a detailed report and a compelling presentation, leveraging Adobe Creative Suite for visually engaging data representation. This project will empower Takni Com to achieve strategic alignment, optimize operational efficiency, and drive sustainable growth. 2. Project Objectives: Conduct a thorough assessment of Takni Com's performance using the Balanced Scorecard framework, focusing on five key perspectives: Financial, Customer, Internal Pro...

Looking for an experienced developer to create a SaaS website builder using GrapesJS. The platform should allow users to design and manage website content through an admin panel. Tech stack: React, Node.js, TypeScript, MySQL/MongoDB. ONLY FOR INDIVIDUAL FREELANCERS

I'm seeking a proficient web scraper to extract contact details from various company websites. Ideal Skills: - Proficient in web scraping tools and software. - Experienced in data extraction from company websites. - Able to organize and deliver data in a clear format. Please note, the specific contact details to be extracted will be determined at a later stage of the project. Please deliver the extracted data in CSV format. Please focus on extracting email addresses. Also, please extract phone numbers.

I need a script that checks the availability of a hotel every five minutes. The script should take two parameters: the hotel name and the date. When availability is found, the script should send me an email notification. Key Requirements: - The script should output results in plain text. - It will run on my local machine. Ideal Skills: - Proficiency in Python or a similar scripting language. - Experience with creating scripts for web scraping or API calls. - Knowledge of implementing email notifications in scripts.