Is java good for web scrapingJobs

Description: I am looking for a skilled web scraping specialist to develop a program that scrapes product data from the Schneider Electric website. The program should meet the following requirements: Program Requirements Input: Accept a list of product codes (e.g., ATV212HU40N4, ATV212HU55N4) provided in a CSV or XLSX file. Accept a list of specific parameters to scrape, such as "Device short name," "Motor power kW," "EMC filter," etc. Output: Generate a CSV or XLSX file with: Column A: Product codes. Row 1: Names of the selected parameters. Rows below: Data for each product. Additional Data to Scrape: For each product, the following should also be scraped: Link to the main product image. Link to download the "Produc...

...The platform is designed to integrate e-commerce, social media, live streaming, music distribution, and job board functionalities. This is an enterprise-level project requiring advanced coding skills and expertise in building scalable, high-performance systems capable of generating massive revenue. Key Responsibilities: Complete outstanding features for the website and mobile apps (iOS/Android). Fix bugs and optimize performance for scalability to handle high traffic and revenue generation. Implement advanced integrations, including: Live streaming (WebRTC, Agora, or Mux). Map API for location-based talent services. Music distribution system with per-view revenue tracking. Set up in-app purchases for Google Play Store and Apple App Store. Buil...

I'm looking to create a bot using Python and JavaScript for automation purposes. The specifics of the automation tasks, the platforms it needs to interact with, and the user interface requirements are still to be determined. Ideal Skills: - Proficiency in Python and JavaScript - Experience in creating automation bots - Knowledge of web scraping, task automation, and data processing - Ability to create both command-line and graphical interfaces Potential Tasks: - Defining the type of automation tasks the bot will handle - Determining the platforms or environments the bot will interact with, such as websites, APIs, or local files - Designing and implementing a user interface if necessary I am open to suggestions and discussions on these points.

I'm in need of a skilled data scraper who can gather contact information for business owners in specific industries. Key Requirements: - Data to be collected includes: first name, last name, work and personal email address, and cell phone number. - More than 500 business owners' data is required. - Industries of interest: roofing, restoration, paving, and landscaping. Ideal Skills/Experience: - Proficiency in data scraping from various sources. - Familiarity with the specified industries. - Prior experience with lead generation or business contact data collection. - Ability to provide accurate and up-to-date information. LEAD RATE IS .15 PER LEAD

JDK upgrade exception : I've encountered an issue while upgrading the JDK for my web application running on Apache Tomcat. The application is currently running on JDK 8 and facing one exception after upgrading to jdk17. - The issue has caused an exception. - The application is hosted on Apache Tomcat. I'm looking for a freelancer with strong expertise in Java, JDK and Apache Tomcat, who can help me troubleshoot and resolve this issue. Please include your relevant experience in your bid.

...need a small project done, to help our dev team as they're busy. Task is to make a Java EE tool that processes a CSV file with "Name" and "phone number" columns. For each record, it will: 1. Make an API call to Elevenlabs' text-to-MP3 service to synthesize a one-minute voice file with a script including the "Name". 2. Send the generated MP3 file to the corresponding phone number via Slybroadcast's API. You need to have previous experience with Java Spring Boot and API integrations, particularly with audio synthesis and telephony APIs. Key Tasks: - Read and process a provided sample CSV file. - Make API calls to Elevenlabs and Slybroadcast. - Handle phone numbers in local format without country code. I've...

I'm in need of a software solution that can convert messages from a Windows-based Telnet Client into UDP messages. The project requires a retention of certain functionalities, specifically ...from a Windows-based Telnet Client into UDP messages. The project requires a retention of certain functionalities, specifically data logging. Ideal Skills and Experience: - Proficiency in software development for Windows - Experience in creating conversion software - Understanding of UDP and Telnet protocols - Skills in data logging implementation - Prior work with C/C++, Python, or Java is a plus Please provide examples of similar projects you've completed in your proposal. Attached is the TCP 2 port telnet client we board we utilise which needs software conve...

I'm in need of a skilled web scraper (proficient with AI) capable of extracting data from a webpage with 5,500 products. These products do not have variants, which should simplify the task. The data to be scraped includes: - Product name - Product Part Number - Product description (The product descriptions aren't formatted the same way for each product. They are inconsistent but similar.) - UPC - How many sold The final deliverable should be an Excel/CSV file containing all the scraped data, sorted by product name with separate columns for each data point. Ideal skills for this project include: - Proficient in web scraping - Proficient with AI - Experienced in data organization and Excel/CSV Please, only bid if you can deliver quality...

...looking for skilled developers to demonstrate their ability to integrate PAX payment terminals into Android applications using the POSLink SDK. The goal is to assess your understanding of the integration process, ability to troubleshoot, and overall proficiency in creating a reliable and secure solution. Requirements: Application Functionality: - Implement basic connectivity with a PAX terminal using the POSLink SDK. - Using Android Studio's Kotlin/Java - Process a test transaction (e.g., sale or refund) with a user-defined amount. - Display the transaction result (e.g., success or error) on the app’s UI. Code Quality: - Ensure modular, maintainable, and well-documented code. - Use best practices for error handling and logging. Security: - Adhe...

...doors and windows-based software that can generate production drawings and quotations based on my cost estimations. I've laid out the algorithm in Excel files, which will be provided for this project. As a developer, your responsibilities will include: - Creating a user-friendly interface (UI) that allows easy access to the software's functions. - Implementing the cost estimation and production drawing generation features. The ideal candidate for this project should have robust experience in: - Java with JavaFX: This is my preferred programming language and framework for this project. - Software development for Windows: The software needs to be compatible with this platform. - UI design: The software should have a simple, intuitive ...

Project Goal Enhance an existing Python web scraper to process 20 websites per second, achieving a total of 1,200 websites in under 60 seconds, without data storage. Scope of Work Performance Analysis Analyze the current scraper code for performance bottlenecks, focusing on areas such as network latency, processing delays, and inefficient code structures. Implementation of Parallel Processing Integrate asynchronous processing using libraries such as asyncio and aiohttp for non-blocking HTTP requests. Explore multiprocessing or threading to handle 20 websites in parallel efficiently, ensuring resource utilization is optimized. Code Optimization Optimize the scraper code to reduce the processing time per site to 1 second or less, focusing on efficient par...

I'm in need of a scraping tool that can help me identify potential bids from various government bid sites. This tool will need to access the API from known bid sites, and pull specific information from these sites. Key Requirements: - Target Government bid sites exclusively - Extract bid titles and descriptions - Extract submission deadlines - Extract bidder requirements Data Delivery: The extracted data will need to be delivered to me in a CSV file daily. Ideal Skills: - Proficiency in web scraping and API integration - Experience with government bid sites preferred - Strong skills in data extraction and CSV generation

I'm in need of a data scraping expert who can collect email addresses and phone numbers from specified company websites. The extracted data should be delivered in an Excel spreadsheet. Ideal Skills: - Data Scraping - Proficient in using Excel - Attention to Detail Experience with previous data scraping projects is preferred. Please provide examples of your work in your bid.

I'm in need of a Java developer with a deep interest in information security, specifically in data encryption. The project involves sovling the college assignment. Ideal Skills and Experience: - Experience in Java programming - Strong knowledge and interest in information security - Experience with data encryption techniques - Problem-solving skills and creativity in approaching challenges

*** NOTE that there is a requirement of around 100hrs per month (around 5 hrs per day Mon-Fri). PRICE is the main factor so quote your hourly price wisely. The maximum, we are paying for this is around 10k-15k per month [Rs 100 - 150 per hour] on above basis. flexible working per day is allowed. Long Term possibility of up to couple of years *** I'm looking for a skilled technical content writer to help me bid for software development projects. The ideal candidate should have: - Basic understanding of technical landscape with respect to cloud technologies, programming languages such as Java, Python etc. - Excellent writing skills - Experience in drafting bid applications Your role will be to leverage your basic knowledge of p...

All requierements:

Adobe Experience Manager (AEM) Consultant We are looking for a highly skilled Adobe Experience Manager (AEM) Consultant with 6+ years of experience to join our team on a contract basis for 3 months. The ideal candidate will help us in developing custom (AEM) components and templates, ensuring system integration, and optimizing the platform for enhanced performance and scalability. Strong problem-solving skills and the ability to work collaboratively with cross-functional teams are essential. If you are passionate about creating seamless digital experiences, we would love to hear from you! Responsibilities: 1) Create and maintain customized AEM components, templates, and workflows 2) Collaborate with front-end developers and designers to ensure efficient rendering o...

Project Description: We are looking for an experienced developer to integrate multiple social media platforms into our application. The goal is to enable seamless access to influencer data and campaign metrics for our users. This integration will support automated data fetching and provide insights for influencer marketing campaigns.

...built for that we can use to scrape all previous cases as well as scrape new cases on a daily basis. The database is huge with over 2.3M entries, we had already been Abel to scrape 2.1M entries but didn't have any data on which cases were missed out. This functionality should include: - Storing all the cases into Postgres with proper indexes/partitions to allow FTS(Full text search) - Scraping only new cases and not re-scraping previously scraped cases. - Progress on which cases were successfully scraped and which ones were left out. We would prefer having a scraper built from scratch rather than fixing the existing one , unless you can make use of it. Existing repo: and issues: - The CSS selectors and database mapping is correct

...confident that I can assist you in efficiently extracting URLs and images related to Google AdSense from the designated blog. With extensive experience in web scraping technologies like Python, BeautifulSoup, and Scrapy, I will ensure accurate extraction of all URLs across the site and gather images associated with Google AdSense, overcoming any challenges related to dynamic or JavaScript-loaded content. I’ll use advanced techniques such as headless browsers (e.g., Selenium or Playwright) to handle dynamic elements, ensuring a comprehensive data extraction process. All extracted data will be saved in a clean and structured JSON format for easy access and analysis. With my expertise and understanding of Google AdSense protocols, I’m confident I can provid...

...network connectivity issues. Experience with Java connectivity is a plus. The goal is to restore stable network connectivity and prevent future interruptions. The problem I am encountering is Java programs keep encountering 'The Network Adapter could not establish the connection at ()'. However the issue does not happen when Toad connects to the RAC. The problem happens intermittently when there is heavy load. There are multiple servers which are connected to this 3 node RAC server. Each time we need to reset the firewall and the problem goes away for a while and then comes back on again. Ideal person is one who has installed and administered Oracle RAC version 19c and is familiar with Java network conne...

I'm in need of a proficient web scraper to extract data from a property listing on a daily basis. The specific data points of interest are user reviews and the availability and booking status of listings. Key Project Aspects: - **Data Points**: Scrape price, user reviews and availability/booking status of property listings. - **Frequency**: Data needs to be scraped and delivered daily. - **Purpose**: The primary goal of this project is to gain real-time booking insights. Ideal skills for this project would include: - Proficient in web scraping - Experience with scraping data from property listing or similar platforms - Ability to deliver data on a daily basis - Capable of providing insights from the scraped data

I'm seeking a professional and straightforward Android Java and iOS app, along with a corresponding website, designed for quick commerce in groceries and vegetables. This project will include a user-friendly catalog, a system to display delivery orders, and a separate app for delivery partners. Key Features: - The app should include a payment gateway supporting Credit/Debit Card, Mobile Wallets, and Bank Transfers. - A search system allowing users to find products by categories and subcategories. - A clean, professional user interface without unnecessary complexity or distractions. Ideal Skills and Experience: - Proven experience in app development, specifically for Android and iOS. - Familiarity with creating professional and straightforward user interfa...

I'm seeking a talented web developer to create an insurance comparison website, primarily focused on price comparison. The site will compare the following types of insurance: API of Applied Systems, CSIO, Various Insurance providers ( 35 ), Product features comparison ( Including writeups and detailed analysis ), Capability to develop in ASP.net. Java React and App on ios and Android including App inclusion on MS system, Azure etc are essential requirements. We may need to include Chatbot trained for the Policy explanation and comparison , Virtual Assistant Integration - Home Insurance - Auto Insurance - Travel Insurance - Business Insurance Key features of the project include: - Integration with various insurance providers' APIs, third-party comparison...

tengo un proyecto desarrollado en java es un sistema de ventas necesito crear un instalador unico para instalacion facil en windows

We are looking for a skilled Python developer to help us integrate and automate processes using the Manatal API. The project involves fetching, processing, and updating candidate data within Manatal and streamlining recruitment workflows. Key Deliverables: 1)Fetch candidate data from Manatal using the API. 2) Process resumes and job descriptions using OpenAI's API for evaluation (resume match, skillset match, etc.). 3) Update candidate profiles in Manatal with evaluation scores and custom fields. 4) Automate assessment progress monitoring and status updates via scraping. 5) Implement centralized logging and error handling. We have part of the code done that can be reused and tweaked.

All requierements:

...chatbot responses, scraping and parsing. Key Issues to Address: - Improving the speed of the chatbot responses - Fixing minor details that are affecting the overall functionality - Enhancing the job opportunity search and alternatives for new candidates Ideal Skills and Experience: - Proficient in Django and Python - Strong understanding of REST APIs - Experience in optimizing chatbots - Skills in web scraping and data parsing - Familiarity with GitHub for code review and collaboration The ultimate goal is to make this chatbot a reliable and efficient tool for job seeking migrants. Please only bid if you have relevant experience and can demonstrate your ability to improve functionality within a Django application. The full do...

I'm looking for a bot that can operate on the Target website. The bot's primary focus should be on toys, specifically hot items that are in high demand. Once an item is back in stock, the bot needs to check out that item instantly. Ideal skills and experience for the job: - Proficient in web scraping and automation - Prior experience with e-commerce bots - Understanding of the Target website's architecture - Knowledge of toy trends and hot items

I'm looking for a dedicated Technical Interview Collaborator with extensive experience in mobile app development, particularly on iOS and Android platforms. This long-term project requires someone with excellent English communication skills who is passionate about guiding the technical hiring process. Job type: Long term(+1 year) Key Responsibilities: - Conducting technical interviews to assess candidates for our team. Ideal Skills and Experience: - Strong background in mobile app development (iOS & Android). - Proficiency in programming languages such as Swift, Java, Kotlin, as well as cross-platform frameworks like React Native and Flutter. - Exceptional English communication skills. - Passion for guiding the technical hiring process. - Expe...

Telegram botumuzu bir üst seviyeye taşıyacak, yeni özellikler ekleyip mevcut yapıyı optimize edecek bir Python geliştirici arıyoruz. Botumuz, otomatik gönderiler, çekilişler, affiliate takibi sağlıyor. Versiyon 2 için yeni entegrasyonlar ve gelişmiş otomasyon özellikleri eklemeyi planlıyoruz. ? Aranan Yetkinlikler: Python (3+ yıl deneyim) API entegrasyonları, web scraping ve otomasyon araçları konularında deneyim Tercihen bahis casino sektörüne aşinalık tg: segujohnson Uzaktan çalışma ve esnek saat imkanı.

Project Title: Namibia Tender Scraper Development Project Description: I am looking for a freelancer to develop a scraper to collect tender advertisements and documents from various sources within Namibia. The scraper should be capable of the following: Scraping Websites in Namibia: Scrape almost all Namibian websites for tender advertisements and tender documents. Scraping Social Media Platforms: Scrape LinkedIn, Instagram, X (formerly Twitter), and Facebook for tender-related adverts or documents localized to Namibia. Scraping Local Newspapers: Collect tender advertisements published in local Namibian newspapers. Scraping Specialized Websites: Scrape two key websites that focus on advertising tender documents: A government-owned webs...

''

I'm seeking a skilled full-stack software developer with extensive experience in Java for the development of a web-based supply chain application. Key Features: - The application will primarily focus on facilitating purchasing bidding within the supply chain. Ideal Candidate: - Proficient in Java with a strong full-stack development background. - Prior experience in developing web applications, particularly in the supply chain domain, will be a significant advantage. - Excellent understanding of purchasing bidding processes.

I'm seeking a web developer to create a comprehensive sports tournament management website. The site should facilitate player registration, tournament search, fixture generation, scoring and processing payments. Key Features Include: - Player Registration: Users should be able to register as players. This includes creating a profile, which will be stored on the site for future tournaments. - Tournament Search: The website should allow users to search for upcoming tournaments. - Fixture Generation: The site should automatically generate fixtures based on the registered teams. - Scoring: A section for live scoring should be included. - Payment Processing: The site should handle all payments for tournament entry fees, with a secure and easy to use int...

Código de scraping de la pagina web sin servicios de anticaptcha. Para entrega completa se debe lograr: 1. Código funcional que, a partir de un rut, busque información en nombrerutyfirma y devuelva un json son la información de la tabla generada en la pagina web. 2. Instrucciones de como Integrar en AWS lambda.

Web Scraping Expert for Automotive Marketplaces Project Overview: We are seeking experienced web scraping experts to develop robust and reliable scraping scripts for second-hand automotive marketplaces. An example of a platform we already scrape is AutoScout24. The goal is to build scripts that we can integrate into our existing systems to run daily, ensuring high-quality data extraction with minimal downtime. Key Requirements: 1. Script Development: * Create efficient web scraping scripts for various automotive marketplaces. * Ensure the code is clean, well-documented, and easy to maintain. * Deliver the source code, as we will be running and integrating the scripts within our existing infr...

I'm running a marketing campaign and I need someone to extract names and email addresses of chiptuning companies for me from google or other search engines. Specific Requirements: - Data should focus on performance tuning companies only - Target regions include: Asia, Central America, Mexico, Panama, Columbia, Chile, Argentina, Brazil, Japan, Singapore, Australia, South Korea, China, Taiwan, Thailand Skills and Experience: - Data extraction and web scraping - Familiarity with chiptuning industry is a plus - Email and contact management - Knowledge of the specified regions The goal is to create a comprehensive database of potential business partners for my marketing campaign.

We are looking for a skilled data scraper who can help gather wedding services reviews from various websites. The main task will involve scraping websites and extracting relevant information such as ratings, comments, and contact details for the service provider that was reviewed. ( Example: XYZ photographer is reviewed on Wedding Wire website. My website will list XYZ, with the publically available information, comments and reviews. If possible, I want all the information combined into a single review that combines the other reviews into an average review. The individual reviews can be viewed with clicking a "details" button revealing the specific individual reviews and the website source. ) Scraping will take place ongoing, but at least we...

I'm looking to scrape a website using the python package requests. 1) you'll have to login to get token 2) once you do that they make POST request behind the scenes that has page number in the payload 3) the return result is json - you have have to save that json to a text file

I'm looking for a seasoned professional well-versed in the following key areas, with substantial prior experience: 1. JavaScript 2. Node.js 3. Firebase (Firestore, related APIs etc) 4. CSS/HTML 5. Real-time hosting with GCP 6. Android Development (JAVA) The most critical aspect of this project is Backend development with Node.js and Firebase. Specifically, I require complex real-time data synchronization capabilities to support an educational application. The expert will need to implement features such as: - User authentication and management - Real-time data synchronization The ideal candidate should have extensive experience working with Node.js and Firebase, particularly in setting up and managing real-time data flows. A strong background in JavaScript, CS...

I'm in need of a skilled web scraper who can collect product details from various e-commerce sites. Key Requirements: - Expertise in web scraping techniques and tools. - Experience with e-commerce sites. - Ability to efficiently extract product details. Ideal Skills: - Proficiency in data extraction and analysis. - Familiarity with Python and libraries such as BeautifulSoup and Scrapy. - Strong attention to detail and ability to work independently.

...seeking a skilled developer to create a .NET C# desktop application. This application will primarily focus on API scraping app and web aplication . - key scraping api app and web top level and androad app - Web Scraping: The app should have web scraping capabilities, specifically for gathering availability information from different websites. - Session Management: Implement a robust session manager to handle multiple user sessions effectively. - Cookie Management: A cookie manager is necessary for maintaining user states and preferences. - JWT: The application should incorporate JSON Web Tokens for secure data transmission. CAPTCHA solving feature to enhance the web scraping pr...

...developer to create a desktop application that utilizes httpclient requests for token and json/jwt token generation. The application must also implement a captcha bypass feature and include comprehensive API scraping capabilities. Key Features: - Token Generation: The application should be able to generate tokens for API requests. - Captcha Bypass: This is a critical feature. The application must be able to bypass captcha prompts seamlessly. - API Scraping: The application should have the ability to scrape data from public APIs. - CODE DECODE: Implement a feature that can encode and decode data. Ideal Skills: - Proficient in C# and .NET framework - Experience with httpclient requests - Proven track record in API scraping - Familiarity with cap...

My webpage currently has an issue where the lower preview images do not automatically scroll past the first half a dozen images. I'm looking for someone to fix the HTML code so that these images scroll horizontally through the full set. It use to work. Is it a java script problem? See: Skills and experience ideal for this job include: - Proficiency in HTML - Experience with website debugging - Understanding of horizontal scrolling mechanics - Ability to deliver timely and effective solutions

I'm looking for a seasoned developer with hands-on experience in React and Java to create a web application with search functionality and display results. The backend will be a Spring Boot API. We can discuss the backend logic in detail once we connect. Ideal Skills: - Proficiency in React & Java - Experience with Spring Boot - Prior work developing web applications - Able to discuss and plan backend logic

I'm on the lookout for a dedicated, full-time website scraper and API expert. Currently, I have two projects that require intensive data collection and analysis. Key responsibilities include: - Scraping data related to music and movies from various platforms. - Collecting comprehensive music and movie Ideal candidates should have: - Extensive experience in web scraping and API utilization. - A deep understanding and interest in music and movies will be a plus. - Excellent data analysis skills. Please note, this role is full-time and requires commitment and dedication.

I need a web scraping solution that can take requests from people via messaging apps, scrape text data from a specified website, and then send that information out to people via both WhatsApp and Telegram. Key Requirements: - Web scraping to extract text data from a website. - Ability to receive requests from people through a messaging app. - Sending the scraped information through both WhatsApp and Telegram. Ideal Skills: - Proficiency in web scraping tools and programming languages such as Python. - Experience with WhatsApp and Telegram API. - Understanding of how to build a simple interaction system via a messaging app. If this project sounds like something you can handle, I look forward to your bid.

I'm in need of a tasker from Egypt for a coding project in Java, JavaScript and C++. This project is for an existing business and involves performing tasks available in the project. Ideal Skills: - Proficiency in Java, JavaScript and C++ - Experience in web application development - Strong problem-solving skills Tasks will involve: - Developing new features for web application - Fixing existing bugs - Improving performance Please, reach out if you possess the necessary skills and experience.

I'm looking for a skilled Java Developer with strong expertise in Hibernate, Spring, and MySQL for a new application development project. The primary focus will be creating a robust, user-friendly web-based interface. Key Responsibilities: - Design, develop and implement a new web application using Java and associated technologies. - Collaborate with me to enhance the user interface, ensuring it is intuitive and engaging. - Use Hibernate for ORM, Spring for dependency injection and MySQL for database management. Ideal Skills: - Proficient in Java with extensive experience in web application development. - Strong skills in Hibernate, Spring, and MySQL. - Previous experience in UI/UX design for ...