Web scraping using selenium and beautifulsoup일자리
...to scrape pricing data from 1 website and compile it into an Excel spreadsheet. The script should take variables from an input Excel file. It should be able to capture error messages and continue on screen while saving output (so I don't have to start from scratch if 1000th record failed or connection got interrupted). Key Requirements: - Proficient in web scraping and familiar with creating scripts for this purpose - Able to integrate Excel for input variables and output data - Experience with scraping pricing data specifically - Capable of delivering a clean and organized Excel spreadsheet Ideal Skills: - Python or similar programming language for script creation - Prior experience with web scraping tools...
I'm looking for an expert in web scraping to extract data from LinkedIn.
I'm looking for a proficient data scraper who ca...proficient data scraper who can compile a list of events in Chicago, IL and surrounding areas from November 15th to February 15th. Specifically, I need galas, parties, and other events that would potentially require audio visual services. Key Responsibilities: - Scraping data from Eventbrite, Facebook events, and local city websites. - Collecting specific details for each event including the event name and date, venue location, and contact information. Deliverables: - All scraped data delivered in an Excel spreadsheet. Ideal Skills and Experience: - Prior experience in web scraping, especially from the mentioned platforms. - Familiarity with event planning and A...
I'm looking for a proficient web scraper program written in python
...to scrape pricing data from 1 website and compile it into an Excel spreadsheet. The script should take variables from an input Excel file. It should be able to capture error messages and continue on screen while saving output (so I don't have to start from scratch if 1000th record failed or connection got interrupted). Key Requirements: - Proficient in web scraping and familiar with creating scripts for this purpose - Able to integrate Excel for input variables and output data - Experience with scraping pricing data specifically - Capable of delivering a clean and organized Excel spreadsheet Ideal Skills: - Python or similar programming language for script creation - Prior experience with web scraping tools...
More details: Is this project for business or personal use? Personal What information should successful freelancers include in their application? This question was skipped by the user How soon do you need your project completed? This question was skipped by the user
Hello, everyone, I am seeking the SwiftUI developer experienced in working with pencilkit and apple pen for drawing iPad application development. The idea behind this app is user experience and interface designer or production owner type of role to be able to rapidly create wireframe like figma Xd. For now, we need to create a prototype for only drawing and erasing features and so on. I can provide you you the brief workflow and go through it. let me know if you have any experience in it. thanks.
I'm looking for a skilled data scraper to extract personal emails from specific social media platforms and web directories. Key Requirements: - The primary platforms for this project are Facebook and LinkedIn. - Experience and expertise in web scraping, particularly on social media sites, is crucial. - Knowledge of data privacy regulations and ethical scraping practices is a must. - Familiarity with web directories and ability to filter for personal emails. Your role will be to help me gather personal emails from these sources in a clean and organized manner. Please ensure that your bid outlines your relevant experience and past projects.
I'm looking for a freelancer to scrape content articles from a specified website. The data needs to be collected and saved into a CSV file. Ideal Skills: - Proficient in Python and web scraping libraries. - Experienced in data handling and CSV file management. - Familiar with scraping content articles specifically. Please note, this project requires a one-time data scrape.
I'm looking for a freelancer who can extract and web scrape contact details from 1500 websites. The focus will be on gathering email ids, phone numbers and LinkedIn profiles of different companies through the website list provided to you. The collected data should be prepared and organized into a standard column format Excel sheet. Key Requirements: - Proficient in web scraping and data extraction techniques - Able to deliver clean, well-organized data - Familiarity with Excel and its various functions - Attention to detail and commitment to data accuracy Please note, I will provide the list of websites to scrape from.
I'm looking for a Junior Level Android Developer based in Pakistan. While specific tasks have not yet been determined, It is simple work of coding. I need a person who may work for long term in android apps I need work at low budget but for long term
I'm in need of a skilled data scraper to extract text data from a specific website. The primary purpose of this task is to gather information for analysis. Key requirements: - Experience in web scraping and data extraction - Proficient in delivering data in CSV format - Ability to ensure data accuracy and completeness Please note, the data will be used for analysis purposes, so it's crucial that the text data is scraped meticulously.
...* Develop and deploy custom web crawlers to collect data from specified websites, databases, and APIs. * Utilize advanced AI tools like OpenAI GPT-4, Scrapy, BeautifulSoup, TensorFlow, and PyTorch to optimize data gathering and processing. * Ensure data accuracy and compliance with data protection regulations (e.g., GDPR). * Customize crawling scripts to target specific data based on our needs. * Collaborate with us to ensure all deliverables meet our objectives. Requirements: * Proven experience in web crawling, data scraping, and automation. * Proficiency with AI-powered tools (e.g., GPT models, TensorFlow, PyTorch). * Strong English communication skills (written and spoken). * Knowledge of online databases, ...
...team full time. The ideal candidate needs to be proficient in Laravel, redis, proxies, scraping, WordPress and plugin creation, as well as API implementation. Key Responsibilities: - Immediate immersion into our current codebase, understanding and mapping it out. - Developing custom plugins with Laravel. - Handling general setup and maintenance tasks for WordPress. Skills and Experience Required: - Extensive knowledge and experience working with Laravel is crucial. - Proven track record in creating custom plugins. - Strong background in WordPress, particularly in general setup and maintenance. - Experience with redis, proxies and scraping will be a plus. I need someone who can start immediately, and can tackle thi...
I'm looking for a professional who can assist with integrating my Shopify store with a popular brand inventory via API, or suggest alternative solutions if direct API access is not fea...professional who can assist with integrating my Shopify store with a popular brand inventory via API, or suggest alternative solutions if direct API access is not feasible. Key Requirements: - Experience with Shopify and API integrations - Ability to automatically update inventory levels - Proficiency to suggest and implement alternative solutions like web scraping or spreadsheet updates - Previous experience with eCommerce platforms highly preferred Please note: I'm unsure if my brand partner currently provides API documentation or access credentials, so flexibilit...
I'm in need of a professional data scraper who can help me gather product lists from various marketplaces. The specific sources can be discussed, but the focus will primarily be on e-commerce platforms. Ideal Skills and Experience: - Proficiency in web scraping tools and software - Experience with data extraction from e-commerce sites - Strong attention to detail and accuracy - Ability to deliver data in requested format and timeframe Please note, the specific marketplaces to scrape from will be determined in discussion with the selected freelancer.
I'm looking for someone to collect the following data from various business listing websites: - Business Name - Address - Phone Number - Email - Short Description - URL if applicable - Facebook URL if applicable The information needs to be 100% accurate. This project is for the collection of 650 business listings from 3 different websites and if it is completed well, there is the opportunity for more projects in the near future.
I'm looking for a professional lead scraper who can scrape Instagram and Facebook for genuine, organic leads in the real estate sector. Requirements: - Focus on international, English-speaking real estate agencies. - Identify agencies with active, listing-posting accounts. - Use Facebook's ad library to check the agency's advertising status, primarily targeting those not running ads. Information to be collected: - Agency name and contact info - Posting frequency and type of listings - Advertising status and audience engagement The leads should be stored in an Excel sheet, which I will provide. Ideal candidates for this project should have experience in data scraping, lead generation, and knowledge of the real estate industry is a ...
I am in need of a skilled Data Engineer or Data Analyst who can assist with the gathering and organizing of raw data from the web. The data will be used primarily for training machine learning models. Key Responsibilities: - Conduct web scraping to collect both text and image data - Clean and categorize the collected data Ideal Skills and Experience: - Proficient in data collection and web scraping techniques - Experienced in data cleaning and categorization - Familiar with preparing data for machine learning models - Knowledgeable in handling both text and image data
...someone to scrape emails from College and University websites, specifically focusing on the Library department. The primary goal is to gather emails from librarian members, not students or administrative staff. I have a list of about 130 university websites, and I want to get emails from 100 of them. I've attached the Excel sheet with the list of College and Universities for your reference to check the work process. What I Need: - Find emails only for librarians or related roles. - Make sure the emails are correct and without errors. - If you can't find the right email, just skip that website. Note: Some websites may have multiple librarians, so please copy all of their emails. Requirements: - Experience scraping from educational websites...
I'm seeking a comprehensive email list of management staff from the USDA. The focus should be on specific departments such as Agriculture, Food Safety, and research. Ideally, the list should include: - Name - Position - Email Address - Office Location - LinkedIn Profile Skills in data mining, web scraping, and research are essential for this task. Experience in acquiring similar information from government agencies would be a significant advantage. Please ensure the information is up-to-date and accurate.
...existing data scraping system. Currently, I operate numerous 24/7 scraping systems on separate EC2 instances. The process involves running a scraping script against a small subset of entities (e.g., 100 out of 1 million) in each iteration, followed by a monitoring script that continuously cycles through every batch. Key Improvement Areas: - Error Handling and Reliability: The current setup feels rudimentary and prone to errors. I need assistance in making the system more robust. - Monitoring Scripts: This is the part I believe requires the most optimization. The current monitoring scripts are not sufficient. - Real-time Monitoring and Alerts: I want to implement a more sophisticated monitoring system that includes real-time alerts for any issue...
I'm looking for a professional lead scraper who can scrape Instagram and Facebook for genuine, organic leads in the real estate sector. Requirements: - Focus on international, English-speaking real estate agencies. - Identify agencies with active, listing-posting accounts. - Use Facebook's ad library to check the agency's advertising status, primarily targeting those not running ads. Information to be collected: - Agency name and contact info - Posting frequency and type of listings - Advertising status and audience engagement The leads should be stored in an Excel sheet, which I will provide. Ideal candidates for this project should have experience in data scraping, lead generation, and knowledge of the real estate industry is a...
...create a cross-platform mobile app (iOS and Android) using Flutter and PHP. The app should be similar to a specific live app that I will provide the link to. Key Requirements: - Extensive experience with Flutter and PHP. - Ability to create a cross-platform app. - Keen attention to detail to ensure the app closely mirrors the one provided. You can do web scraping from above site to achieve. You must do the front end and backend parts and also integrate to our existing app. Front end in flutter Backend in PhP Please note that the primary functionality of the app has not yet been determined. Therefore, flexibility and willingness to adapt to changing requirements
Project Brief: Logitech G502 Automation with Multi-Answer LED Feedback Objective: Create a custom macro script that integrates with Logitech G502 and Logitech G-Hub software to automate a workflow involving browser interactions with GPT and LED feedback on the G502 mouse. The script should be able to: Browser Automation: Automatically open GPT () on a 2nd desktop. Copy selected text (multiple-choice questions) from one window and paste it into GPT. Submit the query and wait for a response, then use the given feedback from the response to turn on a certain coloured light to indicate the answer. LED Feedback System: The G502 mouse LEDs will display specific colors to indicate correct answers: Red for Answer A Blue for Answer B Yellow for Answer C Green for Answ...
...solution for capturing and storing highresolution slide images for offline access and analysis. Project Requirements The script should perform the following tasks: Analyze Site Structure: Understand how the website renders zoomable slides and identify the location of image tiles at different zoom levels. Download Slide Tiles: Programmatically access and download the required tiles, accommodating various zoom levels as needed. Stitch Tiles into a Complete Image: Merge downloaded tiles into a single highresolution image using libraries like OpenCV, PIL, or other suitable Python tools. Save and Organize: Store the final stitched images in a structured and organized format. Ideal Candidate We seek a freelancer with expertise in web...
I'm looking for a professional who can help me display a live cricket scoreboard over a video stream to be posted on youtube. The live scores need to be scraped from the playhq website. Ideal Skills and Experience: - Proficient in web development - Experience with video stream integration - Familiarity with web scraping techniques - Understanding of live sports scoreboards - Previous work with overlaying content on video streams Your task will include: - Scraping live cricket scores from playhq - Overlaying the scores on the video stream - Ensuring the scoreboard is updated in real-time - Need video clips to be automatically saved/added to a playlist based on live score triggers such as wicket, boundary etc. (Optional-Will be bonus if this is also...
I need assistance in building an SMTP mail sender. It should be capable of sending over 100k emails per month to i...emails per month to inboxes, with a perfect score on email tester. Additionally, I need to be taught how to extract email leads using web scraping tools. The system should allow me to track campaign progress via a panel. Key Features: - Email tracking and analytics - Customizable email templates - Automated email scheduling - Real-time analytics - A/B testing - User segmentation Ideal Skills and Experience: - Proficient in SMTP server setup and configuration - Extensive experience in email marketing and campaign management - Skilled in web scraping and data extraction - Knowledgeable in email deliverab...
I'm looking for an expert in machine learning and quantitative analysis to help me analyze various stock performance metrics using the Random Forests technique. The primary goal is to identify which financial ratios are most indicative of stock performance. Key Tasks: - Analyze a comprehensive range of stock performance metrics, including but not limited to: - Price-to-Earnings Ratio (P/E) - Return on Equity (ROE) - Earnings Per Share (EPS) - Debt-to-Equity Ratio - Dividend Yield - Free Cash Flow - Develop an algorithm that outputs a numerical score indicating how indicative a particular metric is for a specific stock. The algorithm should allow for the selection of different stock tickers. Ideal Skills: - Proficiency in machine learning, particularly with...
Necesitamos una persona apta para realizar llamadas en frio a cirujanos ubicados en México y España. Se necesita compromiso, ya que nosotros realizamos todo el trabajo por ti de scraping de datos y demas para que lo unico que hagas sea llamar y generar lead como cualquier otro. Nuestro proposito es ayudar a cirujanos a escalar sus negocios y aumentar su facturación mediante estrategias de marketing y consultoría personalizada. Nuestro enfoque abarca la optimización de ventas y la maximización del impacto en redes sociales.
Poszukuje oosby która zajmie się ekstrakcją danych z konkretnego zródła zawierajacego nazwy 8000 tyś firm do których potrzebuje emaile. Zainteresowanych proszę o kontakt na (Removed by Freelancer.com Admin)
...Cycle Assessment (LCA) using SimaPro software for a water treatment plant. Key Requirements: - Proficiency in SimaPro software - Experience in conducting Process LCA - Knowledge of the water treatment industry - Ability to provide comprehensive LCA results Ideal Skills and Experience: - Previous work in the water treatment sector - Familiarity with manufacturing, energy, and agriculture industries - Data analysis and interpretation skills - Excellent communication and reporting abilities This project is a great opportunity for freelancers with LCA expertise to assist me in assessing the life cycle of processes within a water treatment plant. I aim to understand the environmental impacts, resource use, and potential improvements. If you have ...
I want to create an Azure Openai based GPT interface that talks to sql server data, and returns results and graphs. I should be able to combine multiple such output graphs to create a dashboard that can be shared with others. Admin side: I would need an admin interface to manage API Keys, Users, Brand identities like logo, color scheme.
...supports real-time messaging using technologies like WebSockets or Socket.io. - The chat system must be smooth and reliable, maintaining synchronization across multiple clients. 2. Admin Features: - Admin controls, including the ability to manage conversations, moderate users, and apply role-based access control for different admin levels. 3. Typing Animation: - Typing indicators with smooth transitions and animations. 4. Message Delivery and Read Receipts: - Status indicators for sent, delivered, and read messages. - Stable message delivery even during network issues or page refreshes. 5. AI Integration: - Integration with AI chatbots integrated with OpenAI API(GPT-4o) 6. Emojis, Media Sharing, and File Attachments: - Support...
I need a python expert who can download text data from a specific website, convert it into structured tables in Excel and integrate it with Power Automate for transferring data to other applications. Key Requirements: - Proficiency in Python for web scraping and Excel manipulation. - Experience with Power Automate for seamless data transfer. - Ability to structure data into tables in a coherent and accessible manner. Please include examples of similar projects you've completed in your bid.
...developer to create a simple web app. This app will scroll through dates and download CSV files from a specific website, which I will provide access to. The purpose of this web app is for data collection. Key Requirements: - The web app should be able to navigate through dates and download historic CSV files over the last x months (to be discussed). - The app will source data from one website with CSV downloads. Ideal Skills: - Proficient in Python, with experience in web app development. - Familiar with data collection techniques and Python libraries for web scraping. - Understanding of CSV file structures and data handling in Python. The app will be written to allow for start / end date range and save to a...
...integration and service reservation functionalities. Key Features: - API Tracking: The application should efficiently monitor and track various APIs, integrating seamlessly with others. - Service Reservations: Incorporate a user-friendly feature for making service reservations. - Web Scraping: The app should have web scraping capabilities, specifically for gathering availability information from different websites. - Session Management: Implement a robust session manager to handle multiple user sessions effectively. - Cookie Management: A cookie manager is necessary for maintaining user states and preferences. - JWT: The application should incorporate JSON Web Tokens for secure data transmission. - CAPTCHA Solving: Integrate an O...
More details: Is this project for business or personal use? For starting a new enterprise What information should successful freelancers include in their application? Experience How soon do you need your project completed? 45 days
I'm in need of an experienced web scraper to collect contact details from various websites. Key Responsibilities: - Scrape contact information from designated websites - Ensure the data is accurate and up-to-date Ideal Skills and Experience: - Proven experience in web scraping - Familiarity with tools such as Python, Beautiful Soup, Scrapy, etc. - Attention to detail and ability to deliver clean and organized data
I'm seeking an experienced Angular developer to implement a micro frontend architecture in my Angular project. Key Aspects: - The primary aim of thi...implementation is to enhance code maintainability. - Another critical factor is to improve performance, so experience in optimizing micro frontends for scalability is a plus. - The project is currently using Angular 13 or above, so expertise in this version is essential. Ideal Skills: - Extensive experience with Angular, especially versions 13 and above. - Proven track record of implementing micro frontend architectures. - Strong understanding of performance optimization techniques. - Excellent coding and code maintainability skills. Your contribution will significantly aid in improving the overall quality ...
I'm in need of a Python and Web Scraping expert to streamline my online interactions. The project primarily revolves around process automation on a website. Key Responsibilities: - Automate data scraping from a specified website - Facilitate form submissions seamlessly - Implement content updates as per requirements Ideal Skills and Experience: - Proficient in Python and Web Scraping techniques - Prior experience in process automation - Knowledge in App Development is a plus - Familiarity with desktop application and API is beneficial - Excellent problem-solving skills and attention to detail The specifics of the project can be discussed further in chat. Thank you.
I'm seeking a Laravel developer proficient in Socialite to implement social login options (Facebook, Google, Apple) into my appl...seeking a Laravel developer proficient in Socialite to implement social login options (Facebook, Google, Apple) into my application. The social login should be available on both the registration and login pages and for all user roles (4). Key Requirements: - Proficient in Laravel and Socialite - Experience in implementing social login features - Ability to work with multiple user roles (though specifics are not provided, the app does cater to Admin, User, and Guest roles) - Knowledge of integrating with Facebook, Google, and Apple login APIs. Please provide examples of previous work with Laravel and Socialite, p...
...game inspired by Angry Birds using the libGDX framework in Java, implementing core gameplay mechanics and additional features. Basic Gameplay: Bird Launching: Use a slingshot to launch birds at structures containing pigs. Destruction Mechanics: Birds can break blocks and hit pigs. Blocks can collapse, causing chain reactions. Winning and Losing: Win by destroying all pigs; lose if all birds are exhausted. Features to Implement: Birds: Different types with varying speeds and impacts. At least 3 types of birds. Pigs: Different sizes requiring different hits to destroy. At least 3 types of pigs. Materials: Structures made of wood, glass, steel, etc., with varying durability. At least 3 types of materials. Levels: At least 3 different levels with unique...
- Downloads file form website using selenium - Manages logins - Extracts ZIP archives - Removes specific files (like .htm) - Handles nested archives - Includes error handling
I'm looking for a program in Excel, or an add-in, that will help me monitor product sizes on a brand's official website. Key Features: - I will input the product links manually, one by one. - The program should extract all the available sizes for each product. - If a size is available, the program should display the number 1...product sizes on a brand's official website. Key Features: - I will input the product links manually, one by one. - The program should extract all the available sizes for each product. - If a size is available, the program should display the number 1. - If a product is out of stock, it should show the number 0. Ideal Skills: - Proficient in developing Excel programs or add-ins. - Familiar with web scraping techniques. - Understanding...
It is required to send mass emails from Laravel according to a configuration table. The table will have the following columns, scheduled date, reception date, email, username, message, function_relacion_laravel When it is time to send the message, a Laravel function will be executed, which allows bringing the template related to said email with the necessary data for said emails. It is required to send email alerts with templates that may be eligible, but these templates will have texts, tables, indicators, everything that can be created in Laravel. This is the context. What we want is for only the functionality to be done, with a basic example with what is required. This should work in hostinger, in that environment it will run.
deployment of flask application to digital ocean using gi and creating cicd pipeline
Hello guys, I need developers who will be capable of scraping/fetching data from many sport betting sites. The process works like this: 1: The list of betting sites is on a spreadsheet document on google 2: A developer would decide which sites they would like to do 3: We discuss the price before they start working on it 3.1: There can be multiple sites that run the same API, so just URL's would need to be changed + maybe some minor additions which means that the pay will be the same There are two jobs that I offer: --------------------------------------------------------------------------------------- 1: (Price Range from: 30 EUR to 100 EUR): - Scraping/fetching data in existing betting sites that we have. That data will be used so we can create a fast-ticket o...
...can develop an AI-driven sentiment analysis tool using Python. The tool will be used to analyze customer reviews, classifying them as positive, negative, or neutral based on the sentiment expressed. Key tasks will include: - Data Collection: This will involve scraping customer reviews from specified websites for analysis. - Data Preprocessing: The selected freelancer will be tasked with cleaning and preparing the text data for analysis. This includes removing special characters, stop words, and tokenization. - Model Building: Implementing machine learning algorithms (like Logistic Regression, SVM) or deep learning models (like LSTM or BERT) to train the sentiment classifier. - Model Evaluation: The model's accuracy, precision, recall, and F1 sco...
I'm in need of a skilled data scraper who can extract email addresses from public directory pages. The data should be compiled and delivered to me in an Excel file. Key Requirements: - Proven experience with data scraping, specifically from public directory pages - Proficiency in Excel for data compilation - Respect for privacy and legal boundaries in data collection Ideal Skills: - Data mining - Web scraping - Excel expertise
