Web scraping java source code jobs

I'm looking for a professional to manage an open-source educational platform, with a bespoke dashboard that includes specific functionalities. The ideal candidate should have experience with platforms like Moodle, Canvas, or Open edX. Key Responsibilities: - Oversee the management of an open-source educational platform - Develop and implement a custom dashboard with specific features - The dashboard should include: * Student statistics * Course management * Notifications and updates User Management: - The platform will be used by: * Students * Teachers * Administrators Ideal Skills: - Proficient in managing open-source educational platforms - Experience in creating custom dashboards - Excellent understanding of user management in an educational cont...

I am looking for an experienced coder to convert my Arduino code to work with the Padauk PMS152. This is for a customized application aimed at enhancing my business operations. Key Responsibilities: - Retain and adapt the specific functionalities from the Arduino code: sensor data handling, communication protocols, and actuator control. - Ensure the converted code is optimized for a Padauk PMS152. The ideal candidate will have extensive experience with both Arduino and Padauk coding and a good understanding of developing custom applications for business purposes. Familiarity with sensor data handling and communication protocols is crucial. Please include in your proposal examples of similar projects you have completed.

A4 Artwork: QR Code Relinking & Page Numbering I'm looking for a professional who can assist me in relinking QR codes and numbering pages for 155 unique copies of pre-designed A4 Artwork. Key Requirements: - Relink 5 unique QR codes on each page - Ensure page numbers match QR code file names - Deliver outputs as per specified naming scheme I will provide: - A total of 775 QR codes - Necessary files for the design - Custom file naming scheme Use the below link for the files: Deliverables: - PDF batch files named based on page numbering - Adobe Illustrator files Quality Assurance: - Only a random sample of the QR codes needs to be verified for functionality. Software: - The work needs to be done using

I'm seeking assistance to extract email addresses from a dynamic website. I only have frontend access and this task is a one-time requirement. Ideal skills and experience for this job would include: - Proficiency in web scraping tools and techniques - Understanding of dynamic websites and their structures - Ability to extract data efficiently and accurately Please note, the task requires a thorough and meticulous approach to ensure all relevant email addresses are captured. website: (follow instructions by this video:

I need assistance with my microcontroller code. The project involves an occupancy control system using the STM32G031F6P6 microcontroller. The code is largely complete but requires debugging and cleanup. Key Responsibilities: - Debugging the setup code: The code for setting up the system has been identified as problematic. - Fixing bugs: The primary focus will be on identifying and resolving any bugs in the code. - Cleaning up the code: This includes optimizing performance, improving readability and overall tidiness of the code. Ideal Candidate: - Strong experience with STM32G031F6P6 microcontroller and STM32 Cube IDE. - Proficient in debugging and code cleanup. - Previous experience with microcontroller based projects. - Able to wo...

My e-commerce website needs a professional touch. I'm looking for a serious, experienced provider to check the site for any coding issues, and perform necessary SEO work to improve its visibility on search engines. Key Requirements: - Comprehensive site diagnosis for any coding issues - Professional SEO enhancement to improve search engine ranking - Recommendations for further improvements based on analysis I currently have Google Analytics integrated on the site, but I'm open to suggestions from the provider on what's needed. Please note, I've had previous negative experiences and therefore need a provider who can guarantee the integrity of my site during this process. Skills & Experience: - Proven experience with e-commerce site optimization - Strong knowledge...

data entry (copy EAN code, SKU, and size) from label /image 418 label /image to Excel spreadsheet / google sheet file. Need diligency skills. All images are doubled in the folder (840 images but we need 418 unique records)

Please Sign Up or Login to see details.

I'm seeking an experienced Minecraft Java developer to assist with server configuration and item creation. The project involves working with several plugins including Battlepass, AdvancedEnchanements, ItemAdder, and Advanced Custom UI. Your tasks will not only include the configuration and setup of these plugins, but also the creation of various enhancements and possibly a few other tasks. Ideal Skills: - Proficient in Java programming language - Extensive experience with Minecraft server setup and configuration - Familiarity with the mentioned plugins - Creative mindset for item and enchantment creation Please note that the custom enchantments we may need to create or modify span across combat, utility, and magic types, so a broad understanding of these categories wil...

I'm seeking a skilled developer for fixing Maps API services in a multi service application. Key Requirements: - Proficient in PHP, sWift, and Java - Extensive experience with API integration

I'm in need of a developer who can design and code a teaching website with specific features tailored for different membership levels. Key Requirements: - The website is almost done. - We have two pricing plans. - We need our "notes" tab to redirect non-paying members to a "notes preview page" and paying-members to be redirected to a "notes with membership page" Ideal Skills and Experience: - Proficiency in Java script and Wix Velo. - only need frontend and backend code. I look forward to your bids!

I'm looking for a proficient data scraper who can extract comprehensive product information from a specific website. Key Requirements: - Data to be scraped includes: product names and descriptions, product prices, product specifications, make year, and color. Skills and Experience: - Prior experience in web scraping, particularly product data is highly preferred. - Proficiency in tools like Python, Beautiful Soup, Scrapy, or similar. - Ability to deliver the data in a CSV file as per my requirement. I look forward to your bids. Thank you.

I need a web crawler that can capture video stream data to trigger real-time notifications. The specific types of notifications and data formats for saving the crawled data will be discussed later. Ideal Skills: - Proficiency in web scraping - Experience with video stream data - Programming skills in Python, Java or similar languages Please note, the specifics of the project may evolve as we progress.

I'm seeking a skilled Python developer with AWS experience to assist me in deploying an existing Amazon scraping script onto the Amazon EC2 platform. Key Project Details: - Deployment: Deploy the existing Python script on Amazon EC2. - Libraries: No specific Python libraries or frameworks are required, only standard ones. - CI/CD: Set up a simple deployment process for the script without a full CI/CD pipeline. Ideal Skills and Experience: - Proficiency in Python and experience with web scraping. - Proven track record of deploying Python scripts on AWS. - Strong familiarity with Amazon EC2. - Knowledge of standard Python libraries is necessary. - A comprehensive understanding of the deployment process is required. Additional Information: - The deployment should ...

I'm seeking a seasoned software developer with 7+ years of experience, primarily focused on Java Microservices with AWS. This role is based in Bangalore, requires working from the office, and involves interacting with both internal and external partners globally. Key Responsibilities: - Develop and maintain Java Microservices - Implement solutions using API Gateway and ECS - Work on both Internal and External APIs Ideal Skills: - Expert level knowledge in Core Java, Springboot, API’S, REST services, RDBMS like PostgreSQL - Experience with Angular, Rabit MQ, Camunda, NOSQL databases like Couchbase - Strong communication skills - Ability to work globally This is a contractual position for 6 months with a budget of 90k per month, extendable based on performa...

I'm in need of a professional who can assist with web scraping to collect valuable contact information. This project focuses on gathering data from various websites, specifically targeting: - Email Addresses - Phone Numbers - Mailing Addresses - Contact Person - Their Position Ideal candidates should have experience in web scraping, lead generation, and data cleaning. Proficiency in using scraping tools and ensuring data accuracy is crucial.

My current Python project needs an update. I have two solutions to check if a number is registered on a website, but they are too slow. I've attempted to use multi-threading to increase speed, but the website blocks me. I currently ...slow. I've attempted to use multi-threading to increase speed, but the website blocks me. I currently utilize proxies and a captcha solver, but the slowest part of my process is bot detection. I need a professional who can enhance my current system to better handle bot detection, so I can avoid being blocked by the website. Skills and Experience: - Proficient in Python - Experience with web scraping and bot detection - Knowledge of multi-threading - Familiarity with proxies and captcha solvers Please start your proposal with the...

I'm seeking a professional in web scraping to help me gather contact information for lead generation. The data will primarily be sourced from Company Websites and Industry Directories. - Specific Data: I need the following contact information: - Email addresses - Phone numbers - Website links Ideal candidates should have extensive experience in complex web scraping, with a proven track record of successfully generating leads. Proficiency in data extraction tools and software, along with excellent attention to detail, is crucial.

I need a skilled Java developer to enhance our existing code for uploading WooCommerce product pages to our Google Comparison Shopping Centre account. Key Tasks: - Enhance our current code to improve the upload process of product data to Google Comparison Shopping Centre. - Ensure the integration with Google CSS API is seamless and efficient. Ideal Skills and Experience: - Proficient in Java with a strong background in coding and enhancing existing software. - Experience with WooCommerce and Google Comparison Shopping Centre is a plus. - Previous work with Google CSS API would be beneficial. - Strong debugging skills and attention to detail.

...system**—similar in concept to ScreenCloud—that allows restaurants and other businesses (or your own team) to remotely manage and display content (images, videos, menus, prices, ads) on screens located in various places. We’ll break it down into key components, approaches, and technical considerations. --- ## 1. High-Level System Architecture 1. **Cloud-Based Management Platform (CMS)** - A web-based dashboard (for restaurants, your company’s internal users, etc.) to upload designs, videos, text, and schedule content for specific screens or groups of screens. - A backend server (API) to store and manage all the content, user information, screen configurations, etc. 2. **Player/Client Application** (running on the physical screen or de...

I'm seeking a Python programmer with machine learning expertise to clean and optimize my existing code. The main focus is on improving the code that employs unsupervised learning algorithms. Key tasks include: - Enhancing error handling mechanisms - Improving code readability Ideal candidates should have: - Proven experience in Python programming and machine learning - Exceptional code optimization and cleaning skills - Strong understanding of unsupervised learning algorithms - Ability to enhance error handling and code readability

I am seeking help with writing new R code. The project involves creating and implementing R code for data analysis and visualization. Please note that I do not need assistance with data manipulation or statistical analysis at this time. Ideal Skills: - Proficient in R programming - Experience in writing new R code - Familiarity with data analysis and visualization in R - Ability to explain code and concepts clearly

...presence or significant operations in multiple states. • Deliver the data in a well-organized spreadsheet format (Excel or Google Sheets). Ideal Freelancer: • Experience with web scraping tools (e.g., Python, BeautifulSoup, Scrapy, etc.). • Familiarity with data verification to ensure the information is accurate and up to date. • Knowledge of facility management or related industries is a plus. Budget & Timeline: • Please include your proposed budget and estimated timeline for completion when submitting your bid. Additional Notes: • The data collected must be publicly available. • No use of illegal or unethical scraping methods. • Please include a sample of 3-5 companies from your research in your proposal to de...

I'm seeking a seasoned Java Spring Boot developer for my client. The application will primarily manage Financial data and require seamless integration with a Payment Gateway. The ideal freelancer for this project should have: - Extensive experience with Java Spring Boot, webflux, Error handling, and basic understanding of react and Java reactive programming. - Proven track record in developing applications for handling Financial data with minimum experience of 5+ years in relevant technologies. - Able to write Junit/mokito test cases for newly developed code. - Expertise in integrating Payment Gateways We are looking for freelancers who work at a fixed time from 8 pm IST to 2:30 pm IST and have to work in a client environment with any desk or ultra viewe...

...the user, enabling anyone with the link to access the live location of the driver in real time. 2. Chat Functionality: • Implement real-time chat between the driver and the user. Technical Requirements: • Backend Framework: Java Spring Boot • Real-time Data Sharing: WebSocket (or any suitable alternative for live data sharing) • Database: PostgreSQL Development Scope: • The module must be developed as a standalone component to ensure it can be integrated with our existing Spring Boot application by our in-house team. • Access to our application’s source code will not be provided. The developer is expected to deliver a modular implementation that meets the specified requirements. Deliverables: • Fully functional sta...

I need a utility developing to web scrape and gather live auction data from a vehicle salvage website. The data to be collected includes: - Auction item details - Live bids - Winning bids The data needs to be scraped in real-time and stored into a MySQL database as vehicles go through the auction. Please see attached for detail of requirement.

I'm seeking a skilled web scraper to extract specific data from a website for me. The goal is to replicate certain features on a new site, specifically the filter options. Data to be Scraped: - Text data: This is the primary type of data that needs to be scraped. It could include anything from product descriptions to user comments. - Gallery images: These are the images that need to be scraped. They will be used to build a similar visual experience on the new site. Key Requirements: - Extensive experience in web scraping and data extraction. - Proven ability to replicate website features on a new site. - Familiarity with image data and its usage in website development. - Ability to work independently and deliver on time. Your task will primarily involve scr...

I am looking for assistance in collecting and organizing product information for a new online store. I have a spreadsheet with 2475 product lines distributed across five suppliers. Each product line includes a direct URL to the supplier's product (search) page. Y...1) Product Name 2) Description 3) Product page URL 4) Image URLs (usually only one, but up to four images per product, if available) 5) Additional description, if available If any errors or issues occur (e.g., missing data, broken links, unavailable products), leave a clear comment in the designated "Comments" column explaining the problem. This can be done manually with copy paste, og with web scraping tools, as long as you got attention to detail to ensure high-quality data entry. Pay per hour, ...

Description: I am looking for a skilled web scraping specialist to develop a program that scrapes product data from the Schneider Electric website. The program should meet the following requirements: Program Requirements Input: Accept a list of product codes (e.g., ATV212HU40N4, ATV212HU55N4) provided in a CSV or XLSX file. Accept a list of specific parameters to scrape, such as "Device short name," "Motor power kW," "EMC filter," etc. Output: Generate a CSV or XLSX file with: Column A: Product codes. Row 1: Names of the selected parameters. Rows below: Data for each product. Additional Data to Scrape: For each product, the following should also be scraped: Link to the main product image. Link to download the "Product Datasheet." Li...

...Google Play Store and Apple App Store. Build and customize a Zoho CRM system for managing user accounts and payments. Conduct full system testing, bug fixes, and performance optimization. Skills Required: Scalable Architecture: Laravel (PHP), MySQL with a focus on SEO optimization and revenue generation. Front-End Development: React, Vue.js, or Angular. Mobile App Development: Swift (iOS), Kotlin/Java (Android). Payment Integration: Stripe API, PayPal, in-app purchases for iOS and Android. Live Streaming Solutions: WebRTC, Agora, Mux integration. Map APIs: Google Maps API or Mapbox. CRM Expertise: Zoho CRM customization and setup. SEO Expertise: Advanced SEO optimization for both website and apps. Budget & Time Commitment: Weekly Budget: $100–$125 USD. Hours: 20–3...

I'm looking to create a bot using Python and JavaScript for automation purposes. The specifics of the automation tasks, the platforms it needs to interact with, and the user interface requirements are still to be determined. Ideal Skills: - Proficiency in Python and JavaScript - Experience in creating automation bots - Knowledge of web scraping, task automation, and data processing - Ability to create both command-line and graphical interfaces Potential Tasks: - Defining the type of automation tasks the bot will handle - Determining the platforms or environments the bot will interact with, such as websites, APIs, or local files - Designing and implementing a user interface if necessary I am open to suggestions and discussions on these points.

I'm in need of a skilled data scraper who can gather contact information for business owners in specific industries. Key Requirements: - Data to be collected includ...data scraper who can gather contact information for business owners in specific industries. Key Requirements: - Data to be collected includes: first name, last name, work and personal email address, and cell phone number. - More than 500 business owners' data is required. - Industries of interest: roofing, restoration, paving, and landscaping. Ideal Skills/Experience: - Proficiency in data scraping from various sources. - Familiarity with the specified industries. - Prior experience with lead generation or business contact data collection. - Ability to provide accurate and up-to-date information. LEAD ...

JDK upgrade exception : I've encountered an issue while upgrading the JDK for my web application running on Apache Tomcat. The application is currently running on JDK 8 and facing one exception after upgrading to jdk17. - The issue has caused an exception. - The application is hosted on Apache Tomcat. I'm looking for a freelancer with strong expertise in Java, JDK and Apache Tomcat, who can help me troubleshoot and resolve this issue. Please include your relevant experience in your bid.

We need ...is to make a Java EE tool that processes a CSV file with "Name" and "phone number" columns. For each record, it will: 1. Make an API call to Elevenlabs' text-to-MP3 service to synthesize a one-minute voice file with a script including the "Name". 2. Send the generated MP3 file to the corresponding phone number via Slybroadcast's API. You need to have previous experience with Java Spring Boot and API integrations, particularly with audio synthesis and telephony APIs. Key Tasks: - Read and process a provided sample CSV file. - Make API calls to Elevenlabs and Slybroadcast. - Handle phone numbers in local format without country code. I've got accounts for both APIs set up and can provide a sample CSV file. The p...

python code update

I'm in need of a software solution that can convert messages from a Windows-based Telnet Client into UDP messages. The project requires a retention of certain functionaliti...convert messages from a Windows-based Telnet Client into UDP messages. The project requires a retention of certain functionalities, specifically data logging. Ideal Skills and Experience: - Proficiency in software development for Windows - Experience in creating conversion software - Understanding of UDP and Telnet protocols - Skills in data logging implementation - Prior work with C/C++, Python, or Java is a plus Please provide examples of similar projects you've completed in your proposal. Attached is the TCP 2 port telnet client we board we utilise which needs software convert to output the data...

I'm in need of a skilled web scraper (proficient with AI) capable of extracting data from a webpage with 5,500 products. These products do not have variants, which should simplify the task. The data to be scraped includes: - Product name - Product Part Number - Product description (The product descriptions aren't formatted the same way for each product. They are inconsistent but similar.) - UPC - How many sold The final deliverable should be an Excel/CSV file containing all the scraped data, sorted by product name with separate columns for each data point. Ideal skills for this project include: - Proficient in web scraping - Proficient with AI - Experienced in data organization and Excel/CSV Please, only bid if you can deliver quality work in a timely man...

...understanding of the integration process, ability to troubleshoot, and overall proficiency in creating a reliable and secure solution. Requirements: Application Functionality: - Implement basic connectivity with a PAX terminal using the POSLink SDK. - Using Android Studio's Kotlin/Java - Process a test transaction (e.g., sale or refund) with a user-defined amount. - Display the transaction result (e.g., success or error) on the app’s UI. Code Quality: - Ensure modular, maintainable, and well-documented code. - Use best practices for error handling and logging. Security: - Adhere to PCI-DSS compliance guidelines for handling sensitive data. - Ensure secure communication with the terminal (e.g., SSL/TLS if applicable). Integration Details: - Use the .a...

...estimations. I've laid out the algorithm in Excel files, which will be provided for this project. As a developer, your responsibilities will include: - Creating a user-friendly interface (UI) that allows easy access to the software's functions. - Implementing the cost estimation and production drawing generation features. The ideal candidate for this project should have robust experience in: - Java with JavaFX: This is my preferred programming language and framework for this project. - Software development for Windows: The software needs to be compatible with this platform. - UI design: The software should have a simple, intuitive interface. Please note, the software needs to incorporate both cost estimation and production drawing generation features. A strong under...

Project Goal Enhance an existing Python web scraper to process 20 websites per second, achieving a total of 1,200 websites in under 60 seconds, without data storage. Scope of Work Performance Analysis Analyze the current scraper code for performance bottlenecks, focusing on areas such as network latency, processing delays, and inefficient code structures. Implementation of Parallel Processing Integrate asynchronous processing using libraries such as asyncio and aiohttp for non-blocking HTTP requests. Explore multiprocessing or threading to handle 20 websites in parallel efficiently, ensuring resource utilization is optimized. Code Optimization Optimize the scraper code to reduce the processing time per site to 1 second or less, focusing on effici...

I'm in need of a scraping tool that can help me identify potential bids from various government bid sites. This tool will need to access the API from known bid sites, and pull specific information from these sites. Key Requirements: - Target Government bid sites exclusively - Extract bid titles and descriptions - Extract submission deadlines - Extract bidder requirements Data Delivery: The extracted data will need to be delivered to me in a CSV file daily. Ideal Skills: - Proficiency in web scraping and API integration - Experience with government bid sites preferred - Strong skills in data extraction and CSV generation

I'm in need of a data scraping expert who can collect email addresses and phone numbers from specified company websites. The extracted data should be delivered in an Excel spreadsheet. Ideal Skills: - Data Scraping - Proficient in using Excel - Attention to Detail Experience with previous data scraping projects is preferred. Please provide examples of your work in your bid.

I'm looking for a professional who can help me set up a QR code that will be printed for my reception area. Customers will be able to scan the QR code and submit their feedback, which consists of star ratings, comments, and their phone number. The collected data will be channeled directly to my existing Google Form for easy data collection. Key Requirements: - Generate a functional QR code that links to my Google Form. - Ensure the QR code is suitable for printing and displays correctly on printed material. - Provide guidance on how to use the QR code if necessary. Ideal Skills and Experience: - Experience with QR code generation. - Familiarity with Google Forms. - Understanding of customer feedback systems. - Graphic design skills for creat...

I'm in need of a Java developer with a deep interest in information security, specifically in data encryption. The project involves sovling the college assignment. Ideal Skills and Experience: - Experience in Java programming - Strong knowledge and interest in information security - Experience with data encryption techniques - Problem-solving skills and creativity in approaching challenges

*** NOTE that there is a requirement of around 100hrs per month (around 5 hrs per day Mon-Fri). PRICE is ...around 10k-15k per month [Rs 100 - 150 per hour] on above basis. flexible working per day is allowed. Long Term possibility of up to couple of years *** I'm looking for a skilled technical content writer to help me bid for software development projects. The ideal candidate should have: - Basic understanding of technical landscape with respect to cloud technologies, programming languages such as Java, Python etc. - Excellent writing skills - Experience in drafting bid applications Your role will be to leverage your basic knowledge of programming languages to write compelling bids that can help us secure more projects. Knowledge of other programming languages or areas o...

Please Sign Up or Login to see details.

...6) Participate in requirement analysis, project planning, and status updates 7) Ensure high-quality deliverables by performing unit testing, integration testing, and debugging Technical Qualifications: 1) Experience working with Adobe Experience Manager (AEM) including AEM Sites and AEM Assets. 2) Experience with content repositories (JCR) and tools like Apache Jackrabbit 3) Experience in Java and JSP for building custom AEM components 4) Knowledge of HTL (formerly Sightly), Sling models, OSGi services, and Sling Servlet 5) In-depth experience with AEMaaCS implementation, including configuring cloud-based AEM environments, utilizing Adobe Cloud Manager, and managing AEMaaCS components and services. 6) Basic knowledge of cloud-based infrastructure and services (AWS, Azur...

We want to get...with proper indexes/partitions to allow FTS(Full text search) - Scraping only new cases and not re-scraping previously scraped cases. - Progress on which cases were successfully scraped and which ones were left out. We would prefer having a scraper built from scratch rather than fixing the existing one , unless you can make use of it. Existing repo: and issues: - The CSS selectors and database mapping is correct, as it is scraping data for some cases(needs verification) - It crashes for some cases with the following errors () - Some logic needs to be added to store the total number of cases(per day) along with pass/failed cases so we can retry scraping for specific dates. Budget: 10,000 - 15,000

I am confident that I can assist you in efficiently extracting URLs and images related to Google AdSense from the designated blog. With extensive experience in web scraping technologies like Python, BeautifulSoup, and Scrapy, I will ensure accurate extraction of all URLs across the site and gather images associated with Google AdSense, overcoming any challenges related to dynamic or JavaScript-loaded content. I’ll use advanced techniques such as headless browsers (e.g., Selenium or Playwright) to handle dynamic elements, ensuring a comprehensive data extraction process. All extracted data will be saved in a clean and structured JSON format for easy access and analysis. With my expertise and understanding of Google AdSense protocols, I’m confident I can provide the...

...network connectivity issues. Experience with Java connectivity is a plus. The goal is to restore stable network connectivity and prevent future interruptions. The problem I am encountering is Java programs keep encountering 'The Network Adapter could not establish the connection at ()'. However the issue does not happen when Toad connects to the RAC. The problem happens intermittently when there is heavy load. There are multiple servers which are connected to this 3 node RAC server. Each time we need to reset the firewall and the problem goes away for a while and then comes back on again. Ideal person is one who has installed and administered Oracle RAC version 19c and is familiar with Java network connectivity requirements.