Web scraping using selenium and beautifulsoup jobs

I need a proficient data scraper who can extract and compile information from public websites into Google Sheets. Key Responsibilities: - Scrape data from various public domains on the web. - Organize and integrate the collected data into Google Sheets. Ideal Skills: - Proficiency in web scraping tools and techniques. - Experience with Google Sheets, particularly in data integration and management. - Familiarity with handling data from e-commerce sites, social media platforms, and news websites.

I'm seeking assistance in configuring an automation on Make.com. I have a couple of Google Sheets with a column of URLs that I want to scrape for e...seeking assistance in configuring an automation on Make.com. I have a couple of Google Sheets with a column of URLs that I want to scrape for email addresses and potentially the names of business owners or managers. Key tasks include: - Helping me connect Google Sheets to - Setting up the built-in web scraping tools of to extract data from the URLs - Configuring the automation to insert the scraped data back into the original Google Sheets I am new to , so I would appreciate your help in configuring this automation so I can run it in my account. Ideally, you have experience in web scraping, Google S...

I'm seeking a professional Python developer with experience in phylogenetic analysis. The main task is to compute phylogenetic distances using the Euclidean distance method for a professional project. Key Requirements: - Proficient in Python with strong programming skills - Experienced in phylogenetic analysis - Ability to work with CSV files Please note, the input data is currently in CSV format. The successful candidate will have the opportunity to contribute to a research publication stemming from this project. The project should utilize the Biopython library. The computed phylogenetic distances should be outputted in a CSV file.

All information will be shared on private chat

...have a VPS server with dedicated IPs and use the paid version of VirtualMin. It has Ubuntu 22.04 64-bit with phpList installed but not fully configured. (Virtualmin had an auto-install package I used.) There is nothing on this server except for this, so there are no other applications or websites to worry about that might break. It's all a fresh install. 1) I have approximately 80k emails from a previous service I used, and I need the server set up finished -I would like to have the following done: -finish setup and config, including DKIM, SPF, and DMARC (if you give me the info, I’ll put it in any additional DNS info, which is on GoDaddy, not the provider the server is on) -Set up any autoresponders and whatever automation is available ...

I need a skilled professional to diagnose and fix bugs in my Selenium script. The main issue is timeout problems. Ideal Skills & Experience: - Proficient in Python or Java (Selenium's primary languages) - Strong problem-solving skills - Experience with debugging and optimising Selenium scripts - Understanding of timeout issues and potential solutions - Familiarity with running scripts on a local machine Please only apply if you can work on a local machine, as that's where the script runs. Thank you.

I'm in need of a quick automation/bot for Facebook, specifically for interacting with the Facebook Ad Library. Key Requirements: - Utilize Python and Selenium for the project. - Handle multiple accounts and proxies efficiently. I am open to suggestions and will discuss this in more detail with potential candidates. The project must be completed within a couple of hours. Please reach out to me directly for more details.

I need to increase my circuit gain to 3000 using this behavioral model

I'm searching for a skilled Automation and Manual Tester with a strong background in core Java and BDD. The primary focus will be on Functional testing of web applications optimised for Chrome. Key Requirements: - Expertise in finding dynamic XPaths and using Selenium - Proficiency with the Zephyr test management tool - Experience with Jenkins: creating jobs and troubleshooting issues - Advanced Microsoft Excel skills - Regular document creation on Confluence - Availability during India Night shift timings The tests will be run on Web browsers, specifically Chrome. The ideal freelancer for this project will have a keen eye for detail, excellent problem-solving skills, and a proactive approach to testing and docume...

I have a project that requires data scraping and AI generation. The task involves working with a list of companies and their URLs, and I need this completed by Saturday/Sunday. Here's what I need scraped: - Location (City, State) for US companies or (City, Country) for non-US companies - Year founded - Employee count - Logo from LinkedIn - Accent color from their logo or website - Amount of reviews the company has (don't look too hard for this) Additionally, I need the following to be generated via AI (ChatGPT, Claude, Perplexity, etc): - A description of the company using a template I provide - Two comments/small descriptions using a template I provide The task involves 3000-4000 line items, but many are already complete. There are s...

...looking for a professional who can assist with integrating and filtering live stock data for me. Key Responsibilities: - Data Integration: Fetch live stock data from reliable sources such as NSE APIs, third-party APIs (e.g., Zerodha Kite) or through web scraping. - Real-time Updates: I need updates every 5 minutes for stocks that are experiencing notable changes, specifically: - Spurts in Open Interest (OI) with changes greater than 7%. - Stock prices with percentage changes greater than +2% (gainers) and less than -2% (losers). - Filtering Logic: I need stocks to be identified that meet the following criteria: - OI% change > 7%. - Top gainers: Price % change > +1%. - Top losers: Price % change < -1%. The identified gainers and losers need ...

I need help fixing my Python script that's encountering some XPATH issues. The script is using the Selenium framework for browser automation and the problems seem to be related to dynamic elements.

I'm in need of a skilled automation tester who can...automation tester who can aid in ensuring the quality of our applications across both mobile and web platforms. The ideal freelancer will have a strong background in Java, JUnit, TestNG, Appium, and Selenium, as well as experience with both native and hybrid mobile applications. Key Responsibilities: - Develop automated test scripts - Conduct functional testing - Execute tests on both mobile and web applications The primary goal of this project is functional testing. So, if you have a passion for quality assurance and a knack for automation, please get in touch with me. Please focus on using JUnit as the testing framework. Please focus on using ExtentReports fo...

...of a proficient Python developer who can create a web scraping application for me. The primary aim of this application is to extract text data from various e-commerce sites. Key Requirements: - Expertise in Python, particularly in libraries/APIs used for web scraping (e.g., BeautifulSoup, Scrapy, Selenium). - Previous experience in developing web scraping applications, preferably for e-commerce sites. - A strong understanding of data extraction, transformation and loading (ETL) processes. - Ability to write clean, efficient and well-documented code. - Good problem-solving skills and attention to detail. Your task will be to create an application that can navigate e-commerce sites, identify relevant text data,...

...extracting headlines and summaries from the articles. Please provide all source code. Ideal Skills and Experience: - Proficiency in Python and web scraping - Familiarity with news websites - Understanding of Traditional Chinese Characters or ability to use google translate to understand the website's source and content. - Experience with data organization in Excel linked in python (recommend Pandas) - Ability to create efficient and reliable scripts on time and on budget. - Ensure you can handle this project BEFORE accepting it. We will have more projects in the future, we prefer to know your limits and pair you with projects matching your skill level. - We keep margins low with our client to favor volume over one tim...

...professional who can assist with integrating and filtering live stock data for me. Key Responsibilities: - Data Integration: Fetch live stock data from reliable sources such as NSE APIs, third-party APIs (e.g., Zerodha Kite, Upstox, Alpha Vantage), or through web scraping. - Real-time Updates: I need updates every 5 minutes for stocks that are experiencing notable changes, specifically: - Spurts in Open Interest (OI) with changes greater than 7%. - Stock prices with percentage changes greater than +2% (gainers) and less than -2% (losers). - Filtering Logic: I need stocks to be identified that meet the following criteria: - OI% change > 7%. - Top gainers: Price % change > +2%. - Top losers: Price % change < -2%. The identified gaine...

Development of a Tyre Shop Website with Live Data Integration We are looking to develop a website for our tyre shop that allows us to fetch and display live tyre pricing and availability from multiple wholesalers. The system should streamline our workflow by consolidating the search process into one platform, saving time and improving efficiency. This website is for internal use only, and public access or transactions will not be required. Project Objectives Build a responsive website for a single tyre shop. Integrate live data from 7-10 wholesalers website for tyre prices and stock availability. Allow users to search for tyres by price, size, location, or type. Display results from all connected wholesalers in real-time. Redirect use...

I'm looking for a cross-platform (iOS and Android) mobile application that compares fuel and food prices. The app will rank prices to help customers order the cheapest option. Key Features: - Price Comparison: The app should fetch prices from different sources and compare them in real-time. It should utilize APIs from vendors, web scraping, and manual input by users. - User Reviews and Ratings: A section for user feedback on product prices and quality is essential to foster community engagement and trust. - Order Placement: The app should allow users to place orders directly from the platform. Ideal Skills and Experience: - Proficient in mobile app development for both iOS and Android. - Experienced in API ...

...LinkedIn and extract relevant data from posts, profiles, or groups where those keywords are mentioned. The goal is to automate the process of monitoring discussions, mentions, and trends for selected keywords on LinkedIn. Requirements: 1. Scraping Functionality: Search for predefined keywords across LinkedIn posts, comments, and group discussions. Extract relevant information, such as: - Post content. - Date and time of the post. - Engagement metrics (likes, comments, shares). - Export results to a CSV or Excel file. - Ability to schedule regular searches (e.g., daily/weekly). Tech Stack (Flexible): Python or similar programming language for scraping and automation. Use of libraries like BeautifulSoup, Selenium, or APIs...

B2B emails need to be sent out to win new business. These will be cold emails for the UK, EU and USA markets. We are a start up software design company Must have skills: - Can set up an SMTP using amazon - Sending emails using platforms - Scraping Business emails - Problem solving skills so we by pass any issues with the accounts - Getting emails to not hit the spam box or classed as junk Not Important for now because we have our own template - Copy wiring skills - Making an email template The emails should target the technology, transport, finance, construction and many many more industry specifically.

I am looking for an experienced developer or team to create a simple yet functional platform similar to for creating UGC videos with AI. The platform will leverage the API or another API that offers the same possibiliy, OpenAI, etc. to allow users to generate videos and access other AI-powered features, such as avatars and text-to-speech functionalities. The goal is to build a streamlined, user-friendly interface where users can quickly create and manage video content. The platform will focus on simplicity while maintaining scalability for future upgrades. While my preferred technology stack is Python/Django, I am open to alternative suggestions if the freelancer performance better with other technologies. Thank you !

Provide code for scraping host/vehicle/rate info continuously dumping data into provided mongodb. to be delivered in 10 days with providing 30 days of running scrapes to stabilize and provide data until running on our infrastructure with a docker image.

I'm looking for an experienced VBA programmer to enhance my existing sports web scraper. This tool needs to be updated to collect odds from the correct score market for soccer fixtures on reputable betting websites, specifically William Hill and Ladbrokes. Key Requirements: - Modify the current web scraper to extract specific data from the correct score market. - Capture and distribute odds data into an Excel table. - Enhance web scraper to handle dynamically loaded content on betting websites. - Implement robust error handling and logging mechanisms. Ideal Skills: - Proficiency in VBA for web scraping. - Familiarity with soccer betting markets. - Experience in data distribution to Excel. Please note, the primary focus of this...

i have a old version of an e-commerce website running on a old Prestashop. The job is to make a fantastic and amazing new website using old data like products/customers... I am open to other plateform if you can first give a demo to see if i can use another plateform (wordpress, drupal...)

I'm seeking a skilled data miner to extract public information from tripadvisor.it. The aim is to compile a comprehensive CSV file containing data on all Italian restaurants, hotels, and B&Bs. Data Requirements: - Name and address of each establishment. - Email address of each establishment. Ideal Skills: - Proficiency in data mining and web scraping. - Experience with handling large datasets. - Ability to deliver data in a clean, well-organized CSV file.

Please Sign Up or Login to see details.

I need an experienced Python developer to help with some modifications to my scripts. Ideal Skills: - Proficient in Python - Experience with script modification - Problem-solving skills - Understanding of data processing, web scraping, and automation scripts. Please note that the specifics of the scripts and the modifications needed are currently not documented. Your ability to understand and modify scripts without extensive documentation is crucial.

I am seeking a talented freelancer with strong web scraping skills, preferably in Python, to assist with a project involving three specific websites initially. There is potential for more sites in the future. I will provide the specific data fields that need to be extracted. Key Requirements: - Proficiency in web scraping and/or Python. - Familiarity with MS SQL Server databases is a plus, but not essential. - Ability to extract data efficiently and effectively. - Understanding of necessary security measures, including captcha integration if required. - Capability to deliver quality work quickly, as this project is a priority and needs to be completed ASAP. This project could evolve into a long-term partnership, as I would like to be able ...

I am seeking a talented freelancer with strong web scraping skills, preferably in Python, to assist with a project involving two specific websites initially. There is potential for more sites in the future. I will provide the specific data fields that need to be extracted. Key Requirements: - Proficiency in web scraping and/or Python. - Familiarity with MS SQL Server databases is a plus, but not essential. - Ability to extract data efficiently and effectively. - Understanding of necessary security measures, including captcha integration if required. - Capability to deliver quality work quickly, as this project is a priority and needs to be completed ASAP. This project could evolve into a long-term partnership, as I would like to be able to...

...prices, and other relevant details. -Automated Integration with Magento: -Automatically transfer the product data from the reference website to our Magento store. Price Adjustment: -Apply a configurable price adjustment rule (e.g., 10%-20% markup) to the imported products before they are displayed on our website. -We also need the developer to make sure all product attributes that show on the reference website is going to set up exactly the same on our website as well. -Better to avoid to do customisation coding but find an extension to do it. Requirements: -Strong expertise in Magento (preferably Magento 2). -Experience with web scraping and data integration tools. -Familiarity with pricing automation and e-commerce workflows. -Ability to ensure th...

I'm looking for an experienced web scraper to find email addresses, Australian mobile numbers starting with 04__ , current Company employed at and current Role - for a list of names that I will supply. Key Responsibilities: - Scrape information from various sources including social media profiles, company websites, public directories and apollo.io. - Deliver the collected data in an Excel spreadsheet. Ideal Skills: - Proficiency in web scraping and data collection. - Familiarity with social media platforms and company websites. - Experience with public directories and apollo.io. - Ability to deliver data in an organized and efficient manner. Please note, the data should be verified for accuracy using automated to...

SP to LAMBDA expression using context

...expert web scraping developer who can help me with a project. The scraped data needs to be delivered in CSV format, so proficiency with handling and structuring data for CSV is crucial. Ideal Skills and Experience: - Extensive experience with web scraping tools and techniques - Proficient in data handling and structuring for CSV - Previous experience with delivering web scraped data in CSV format - Ability to work independently and meet deadlines - Excellent problem-solving skills - Skills in data cleaning and preprocessing before saving to CSV - Experience with scraping data from dynamic websites using JavaScript/AJAX - Proficient in using proxies to avoid IP bans while scraping -...

I am looking for an experience Excel, Pivottable, Wpdatatables plugin expert to create: - Stacked stacked barplot chart based on G Sheet Document - Date comparison filter function on existing tables. - Interactive filters for users to dynamically adjust data views. This project will use a single data source for the charts and tables. The stacked barplot chart should be interactive.

I'm seeking a seasoned academic writer with a strong background in cloud computing and dynamic resource allocation. My project focuses on load balancing, resource optimization, and scalability, specifically within the realm of parallel data processing in the cloud. Key Responsibilities: - Research and content creation for the main body of the thesis - Need 10000 words Ideal Candidate: - Strong academic writing skills - In-depth understanding of dynamic resource allocation - Experience with writing or editing theses - Familiarity with cloud computing concepts Please include relevant samples of your work, particularly any related to cloud computing or dynamic resource allocation.

I am looking for a freelancer that can assist us in doing a 3D model using Neural Radience Fields with NerF Studio, Luma AI or similar solutions. The project is a 3 room area of approx 190x 360° images. I can also deliver some video material if 360° images are not enough. Please only bit if you hafe prior experience with NerF and can show demo projects. If this job is conducted successfully, a long-term partnership with additional projects is possible.

I need a template that can help me download eBooks from a library archive website. - The eBooks are in PDF format. - I do not have permission to download these eBooks. This project is a bit tricky since it involves downloading content without permission. I am offering a commission of 200 RMB. The ideal freelancer for this job should have experience with web scraping and programming, as well as a strong understanding of ethical considerations in this field. Please note, I am looking for a solution that can be used at any time to download eBooks from this site. The URL of the library archive website is: " For your convenience, you can use my account to log in to this website 账号：alice003 密码：12345678aa 现在里面的书只能试读十几页 我想下载下来整本书 The books inside can only

...students and teachers in an educational institution. The application will be built using the MERN stack (MongoDB, , React.js, Node.js). It will support three types of users: Student, Teacher, and Admin, each with specific roles and permissions. The system will enable users to register, mark attendance, track attendance history, and allow admins to manage users. User Roles & Permissions 1. Student 2. Forgot Password: Students can reset their password through an email recovery link. ● Registration & Login: Students will be able to register and log in to the system. ● Mark Attendance: Students can mark their attendance by taking a selfie and having their attendance timestamp recorded. ● Attendance History: Students can view their att...

I need a template that can help me download eBooks from a library archive website. - The eBooks are in PDF format. - I do not have permission to download these eBooks. This project is a bit tricky since it involves downloading content without permission. I am offering a commission of 200 RMB. The ideal freelancer for this job should have experience with web scraping and programming, as well as a strong understanding of ethical considerations in this field. Please note, I am looking for a solution that can be used at any time to download eBooks from this site. The URL of the library archive website is: " For your convenience, you can use my account to log in to this website 账号：alice003 密码：12345678aa 现在里面的书只能试读十几页 我想下载下来整本书 The books inside can only

I am seeking a Data Scientist with a s...Machine Learning for a time series analysis project. The ultimate goal is to forecast future sales using SARIMA and ARIMA models. Ideal Skills and Experience: - Proficiency in data science and machine learning techniques, particularly ARIMA and SARIMA - Extensive experience with time series analysis - Strong skills in handling and interpreting sales data - Excellent forecasting abilities - Knowledge of Python or R for statistical modeling Key Project Details: - The data to be analyzed is sales data - The data is already prepared and ready for analysis Your primary task will be to accurately predict future sales based on the provided data. If you have a proven track record in sales forecasting a...

I'm seeking a skilled web scraper to gather information from four county government sites pertaining to civil court cases. The task involves extracting specific details such as case numbers, involved parties, current case status, judgment dates, amounts owed, and addresses of up to two plaintiffs and three defendants. Three of the counties use the same IT system vendor, making their systems and formats very similar. This should facilitate the development of a routine for those counties. Several of these counties are small and should not result in more than several thousand records in those. Key Responsibilities: - Scraping the websites for civil case details - Delivering the data in MS EXCEL, organized by county - Approximately 40 fields to s...

...Japan-based proxy shopping and auction platform that enables international customers to purchase items from Japanese marketplaces (online stores). The platform acts as an intermediary, bridging the gap between global buyers and Japanese sellers, especially those who do not offer international shipping. Proxy Buying Service • Allow customers to submit product requests using URL of the desired product (which comes from other japanes online store) or make direct purchases using the integrated search system. • Provide notifications and support for real-time purchases like auctions or special sales or any question user wants to ask . • Build a unified search engine to explore products across multiple onlines stores like Amazon Japan, Raku...

...create me a custom gpt model and set it up to automatically reach out to leads if there is some way to automate the lead scraping into a Google sheet to trigger an action from zapier that would be great I have detailed in the document attached exactly how to create the custom gpt and set it up how I need this process I am not looking to spend thousands of dollars if your price is too high I will just do the project myself but I am looking for someone to do this for me and then do it multiple more times for clients of mine so you would get this exact same job and be paid to do it multiple times so I want to make sure I am getting an affordable price again not trying to spend thousands not even several hundred dollars read over everything and gi...

I'm looking for a skilled web scraper to collect text data from job-related sites using BeautifulSoup or other tools. The data needs to be scraped daily. Ideal Skills and Experience: - Proficient in Python and BeautifulSoup / other tools - Experience with web scraping, particularly from job websites - Ability to set up automated daily scraping - Strong attention to detail to ensure all relevant text data is captured

I'm looking for a data scraping expert to help me collect business information from Google Maps. I will provide a list of trades and a specific area in Australia to focus on. You will need to find and record the following details for each business: Business Name, Address, Email, and Company Name. The final data should be delivered in an Excel spreadsheet. Ideal Skills: - Proficient in data scraping - Familiar with Google Maps - Excellent attention to detail Requirements: - Able to generate 300-400 leads - Provide comprehensive and accurate data. The project should be completed within 1 week.

...retail websites and convert it into Shopify-compatible CSV format. The scraper should include the following features: 1. Category-based Scraping: Allow the user to input a retail website category URL. Automatically scrape all products from the category. 2. Specific Product Scraping via Notepad Links: Allow the user to upload a notepad file containing individual product links. Scrape data for all products listed in the file. 3. Comprehensive Data Extraction: Extract all available product data, including but not limited to: Product Name Description Images Price SKU Inventory Variants (if applicable) 4. Shopify CSV Compatibility: Output the scraped data in a Shopify-compatible CSV format, ready for upload. 5. Scraping Status Window: P...

...equipped with fin stabilizers based on NACA 0012 and NACA 0015 airfoil profiles. Scope of Work: 1. Geometry Development: • Create detailed 3D models of the vessel’s hull and fin stabilizers using NACA 0012 and NACA 0015 airfoil profiles. • Ensure accurate scaling and positioning of fins relative to the hull. 2. Mesh Generation: • Develop a high-quality mesh for the computational domain, emphasizing finer elements near the fin surfaces to capture boundary layer effects. 3. Boundary Conditions and Setup: • Define appropriate boundary conditions, including inlet velocity, outlet pressure, and wall conditions for the hull and fins. • Specify fluid properties corresponding to operating conditions...

I'm looking for someone who can create engaging, fast-paced, dynamic video tutorials on YouTube, covering various topics within the AI tech sphere. You don't need to be an expert, but you should be a quick learner and motivated enough to grasp the concepts and create compelling content. Skills & Experience: - Proficiency in video editing tools - Familiarity with AI tools for content creation - Experience in creating YouTube videos - Ability to learn quickly and adapt to new topics Please share your video examples and your understanding of the role when bidding. This will be a consistent job with opportunities for long term collaboration.

I'm in need of a data scraping expert to extract information from and compile it into a Google Sheet. The data fields required are: - City Name - Arena Name - Address - Phone - Website - Postal Code: Capture the postal code for each arena location. The final product should be a single Google Sheet with all fields neatly organized. Please note that this is a one-time task, and I do not require regular updates. Ideal candidates for this project should have: - Strong proficiency in data scraping - Experience working with Google Sheets - Attention to detail to ensure accurate data collection I look forward to your bids. The project should be completed within one week.

I'm looking for a data scraper to collect information from a Toronto real estate website. The target is 434 records of real estate agents. Requirements: - Data to be collected includes: - Name - Email - Phone number - Company name - Data to be delivered in an Excel spreadsheet The data will be used for email marketing, so experience with web scraping and data processing is crucial. Please only apply if you can deliver within the specified timeframe.