Website scraping howto mysql jobs
...(optional): Inventory management for restaurant staff. Notify customers of their order status (via notifications). Maintain order history for both customers and the restaurant. Technology Requirements: Backend: A robust solution (e.g., Node.js, Django, Laravel, etc.). Frontend: A modern, responsive user interface (React, Angular, Vue.js, etc.). Database: A secure solution to manage orders and payments (MySQL, PostgreSQL, MongoDB, etc.). Online Payments: Integration with secure payment gateways like Stripe, PayPal, etc. QR Code Management: Dynamic generation and management of unique QR codes for each table. Objectives: The goal is to create a complete solution that enhances the customer experience in cafés and restaurants while simplifying order management for the staff. ...
Scrape data from an auto part website and create CSV. You will also get images without copyright. Project must be in Shopify standards and be ready to upload. Scraping may be over 15k sku's
I'm seeking a skilled data scraper who can gather product descriptions and pricing information from a specified auto parts website. Key Requirements: - Scraping data for more than 2000 products - Creating a well-structured CSV file - Formatting product descriptions in plain text Ideal Skills: - Proficient in web scraping tools and techniques - Experienced in data organization and CSV creation - Attention to detail to ensure accurate data collection Please only apply if you have previous experience with web scraping and can provide examples of similar projects.
I am looking for a Python expert who can help me automate sending direct messages on Instagram and other social platforms. Ideal Skills: - Proficient in Python - Experience with Instagram's API or similar automation tools - Understanding of Python libraries for web scraping and data handling Key Requirements: - Create a script that can send pre-defined messages to a list of users at specified intervals to avoid being flagged as spam. - Ensure the script can handle potential errors, such as users with private accounts or those who have blocked the sender. - Provide a user-friendly guide for running the script on a local machine. Please note, adherence to Instagram's terms of service is a must. Your proposal should highlight any relevant projects you've completed in...
Job Posting: Laravel Developer with Laravel Nova Expertise (Freelance, 1 Week) We are seeking a skilled Laravel Developer with experience in Laravel N...(with potential for future collaboration) • Commitment: Flexible hours (up to 30-40 hours) • Scope: • Develop and maintain a Laravel project. • Implement and customize Laravel Nova features. • Ensure clean, maintainable, and optimized code. Requirements • Proficiency in Laravel (5+ projects or equivalent experience). • Hands-on experience with Laravel Nova. • Strong understanding of PHP, MySQL, and REST APIs. • Familiarity with front-end technologies (e.g., Vue.js, TailwindCSS) is a plus. • Excellent problem-solving and communication skills. Compensation • Hourly R...
We already have a MySQL cursor with a loop set up to fetch values and perform certain calculations. We need an experienced MySQL developer to extend this cursor with additional logic to populate more values into the table in the most efficient way possible, with minimal overhead on the database. I will provide an Excel spreadsheet with simple formulas required to replicate the logic. The extension involves implementing approximately 9 additional calculations and updating a different table using simple IF statements based on the calculated values. Key Requirements: • Extend the existing MySQL cursor, which already has a loop set up for fetching values. • Implement about 9 additional calculations based on simple formulas provided in an Excel spreadsheet. &...
...mobile interfaces. - Integration of spot trading for selected markets. - A fully-functional admin panel for overseeing users, resolving disputes, and adjusting system settings. Essential Skills: - Proficient in backend development using Node.js, Python, or PHP. - Experienced in frontend development with React.js, Vue.js, or similar frameworks. - Skilled in database management, preferably with MySQL or MongoDB. - Previous experience with payment gateway integration is a must. - Blockchain development experience is highly preferred for seamless cryptocurrency integration. The ideal candidate for this project is a professional with a solid background in both backend and frontend development, with a special focus on creating secure and efficient systems. Experience in building tra...
...identify profitable wallets worth copying, based on reliable data metrics such as Profit and Loss (PnL), win rate, and performance over weekly/monthly timeframes. The current implementation is plagued by inaccurate or false data, resulting in wallets with near-zero balances being reported as highly profitable. Despite trying multiple APIs (Solana public API, GMGN API, and BirdEye API) and even scraping data from relevant websites, the results have been inconsistent and unreliable. This project requires a solution that not only filters out fake or non-credible wallets but also provides a robust mechanism to analyze and verify real-world wallet performance. Key Objectives: 1. Data Accuracy: - The output data must accurately reflect the true wallet performance on th...
I'm in need of an AI agent tailored for market research purposes. This agent will be responsible for scraping specific product pricing from Australian supermarkets, focusing on household items. The data collected should encompass a comprehensive set of product details including price, promotional price, weight, dimensions, colour, and additional product information. Ideal Skills: - AI/ML Development - Web Scraping Expertise - Data Analysis - Market Research Understanding The AI should collect this data on a monthly basis. Prior experience in developing similar projects would be highly regarded, as well as a deep understanding of market research methodologies and requirements.
...curating and delivering a detailed database of 7,000 US companies. Each company profile must encompass key details like the company name, and its associated emails (e.g CEO email, Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirem...
...to dynamically serve data to our website. Objective To create a cost-effective, highly available, and secure AWS-based backend architecture that ensures seamless data ingestion, transformation, and real-time interaction with our website. Key Responsibilities Data Ingestion Schedule Python scripts using AWS Lambda to fetch data from APIs. Handle API rate limits, errors, and retry mechanisms. Store raw data temporarily in Amazon S3. Data Parsing Clean and structure raw data for further processing. Ensure data validity and store parsed data in S3. Data Transformation Enrich and reshape parsed data for analysis or database upload. Store intermediate results in S3 for staging. Data Upload to SQL Database Save transformed data into Amazon RDS (PostgreSQL/MySQL) with...
I need a skilled programmer to automate login on a specific website. The primary goal is to extract data, with the volume of requests ranging from 20,000 to 100,000 per week. Key Requirements: - The automation script must be able to interact with a website. - The automation must be capable of bypassing DataDoom CAPTCHA challenges. Ideal Skills: - Proficient in web scraping and automation tools - Experience dealing with CAPTCHA bypass solutions. - Understanding of ethical and legal considerations in data extraction. The goal is to extract data systematically and efficiently. Please ensure your proposal outlines your relevant experience and approach to this project.
I need a Python developer to integrate a...messages which are broadcasted to the bot and execute the corresponding command. Key Requirements: - Python programming skills - Experience with Telegram bot development - Familiarity with terminal commands - Knowledge of MySQL for querying The primary goal of this project is to automate the execution of specific tasks via the Telegram bot. The user will interact with the system by sending MySQL queries, which the bot will interpret and respond to. The ideal freelancer for this project should be able to help me with the following: - Executing predefined commands - Using MySQL queries to trigger these commands - Ensuring the system can take messages broadcasted to the bot Please bid only if you have relevant experience and c...
... APIs to support user authentication, business/event data retrieval, and category management. Database: Use MySQL for basic data storage. Include tables for businesses, users, events, and categories. Key Features: Dynamic search and category-based filtering. User registration/login (basic authentication). Add/edit businesses and events (admin only). Deliverables: A functional prototype of the platform with source code. Clear instructions for running the application locally. Initial setup for deployment (e.g., Docker or cloud hosting guidance). Technical Requirements: Frontend: ReactJS, HTML5, CSS3, JavaScript/TypeScript. Backend: Java (Spring Boot), RESTful APIs. Database: MySQL. Budget and Timeline: Budget: Up to 200 NZD (non-negotiable). Timeline: [2-3 weeks]. How ...
I'm looking for a WordPress developer to create a feedback plugin for my site. The plugin should incorporate a star rating system and should allow users to leave written comments along with their rati...WordPress developer to create a feedback plugin for my site. The plugin should incorporate a star rating system and should allow users to leave written comments along with their ratings. However, the feedback should only be visible to administrators, not to the general public. Ideal Skills and Experience: - Extensive experience with WordPress plugin development - Proficiency in PHP, JavaScript, and MySQL - Prior experience creating rating systems or similar functionality - Strong understanding of WordPress's architecture and best practices - Ability to create secure, priv...
...seasoned PHP developer to create a user login system that caters to different user roles - 'seller' and 'buyer'. This system should incorporate essential features such as login, registration, profile editing, and password resetting. Key Requirements: - Use of MySQL as the database for the user login system. - Incorporation of an email verification service for added security and user authenticity. - Design of a modern, graphics and animation infused user interface for the login system. Ideal Skills: - Extensive experience with PHP and MySQL. - Proven track record in developing user login systems. - Proficiency in creating modern, animated interfaces. - Experience with integrating email verification services. Your expertise in these areas will be cruci...
Project Title: Simple To-Do List and Hotel Room Management Application Project Description: I am looking for a skilled developer to create two applications: To-Do List Application: Users can add, edit, delete, and ...Simple reports for room occupancy and revenue. Both applications should have: A modern user interface. Options for desktop or web versions (whichever you specialize in). If you can deliver this project on time and with quality, I am willing to work with you in the future for upgrades or other projects. Preferred Technology: Python for the backend (e.g., Flask/Django). Simple database (SQLite or MySQL). Frontend using HTML/CSS/JavaScript if it’s a web app. Delivery Time: 2–4 weeks. Budget: $200 Skills Required: Python Web development (optional) Database ...
I need an expert in data scraping to create Parsehub templates for extracting product information from a retailer's website. The specific product details I want to be captured include: - Product names and prices - Product descriptions and reviews - Product images and specifications - Product specs The data will be used for catalog comparison. Ideal skills for this job include: - Proficiency in using Parsehub - Experience in scraping data from e-commerce websites - Knowledge in handling product-related data - Ability to create effective templates for recurring tasks Please bid only if you have the relevant experience and skills. Thank you.
Custom PHP Script for Batch Code Update in MySQL Database I am looking for an experienced PHP developer to create a simple and effective script that interacts with a MySQL database for bulk code updates. Requirements: Input Handling: The script should accept a list of codes through a text box, where each code will be pasted on a new line. Database Interaction: For each code input, the script must locate the corresponding record in the MySQL database, where the codes are stored in individual rows. Value Update: Upon finding a match, the script should update the value of that code with a number specified in a second text box. Error Handling: If the script cannot find a code in the database, it should skip that code and display a warning message, rather than throwing an ...
I'm looking for a skilled data scraper who can extract information from exhibitor profiles on a trade website. The specific information I need includes: - State and Local Destination Marketing Organisations Name Contact details (primarily email addresses and phone numbers) I would prefer freelancers with prior experience in web scraping, and who are familiar with data extraction software. Please include examples of similar projects you've completed in your bid. Confirm price and only apply if you can complete by monday 9am GMT
I'm seeking a freelancer to run a Python script that scrapes the entire DataAxle database of 18 million companies. The end goal is a comprehensive spreadsheet that includes all available fields. Example fields include: - Company name and add...database of 18 million companies. The end goal is a comprehensive spreadsheet that includes all available fields. Example fields include: - Company name and address - Industry and revenue - Number of employees and contact details - SIC Code - SIC Code Description The primary purpose of this data collection is for sales leads generation. Ideal Skills: - Proficiency in Python - Experience with web scraping - Familiarity with DataAxle or similar databases - Ability to generate clean and comprehensive spreadsheets - Understanding of sale...
I'm in need of a proficient data collector who specializes in web scraping. The primary focus will be on gathering market data from various e-commerce sites. Target Audience: Ages 18 to 35 years old Office job professionals Followers of global and economic news Interested in cryptocurrencies and trading Previously or currently involved in online work Ideal Skills and Experience: - Extensive experience in web scraping, particularly from e-commerce platforms - Strong understanding of market data and its significance - Proficiency in data analysis and interpretation - Familiarity with data collection tools and software - Ability to deliver accurate and timely data I need the Name and Email just Please provide examples of similar projects you've completed.
...evident. Please apply only if you meet ALL the requirements below. Tech Requirements 1. Fluent English (native speaker preferred). 2. Minimum 4 years’ experience** with PHP/Symfony, including developing complex websites and backend booking systems. 3. Proven experience with **booking systems** involving calculations, GPS tracking, and dynamic graphical displays. 4. Advanced knowledge of **scraping technologies**, including techniques to bypass IP blocking and Captcha. 5. **Independent developer**: I expect you to work solely with me (no outsourcing or staff substitutions). Role Expectations** - Collaborative and technically engaging work environment. - No urgent deadlines—focus is on high-quality code -Knowledge sharing: I expect to learn from you...
I'm seeking a developer who can create a Google Chrome web extension to scrape mobile numbers from various sources such as web pages, social media profiles, and databases. The extension should also be equipped with the following features: - Data Export: The ability to export the scraped data to a CSV file. - Automated Data C...pages, social media profiles, and databases. The extension should also be equipped with the following features: - Data Export: The ability to export the scraped data to a CSV file. - Automated Data Cleaning: The extension should have a feature for automating the cleaning of the scraped data. Ideal candidates should have prior experience in developing web extensions and should be adept at data scraping. Knowledge of data cleaning techniques will be an a...
I am experiencing critical problems with my official website due to MySQL database connection issues. The site is built using PHP, and I need a seasoned professional with extensive experience in PHP and MySQL to get it back on track. ***It should be fix remote access only. *** Key Responsibilities: - Diagnose and fix all database connection issues - Ensure the website is fully operational post-repair Ideal Skills: - Proficient in PHP and MySQL - Strong troubleshooting skills for database issues - Experience working with official or business websites
I'm in need of a proficient web developer who can create a web scraping bot for me. The bot should scrape text data from multiple websites and store it in an HTML file. Key Requirements: - The bot should only scrape text, not images. - It should be capable of extracting data from various websites. - The bot's operation is a one-time task, so it should be efficient and able to complete the task without supervision. Ideal Skills: - Strong experience in web scraping and bot development. - Proficiency in HTML and understanding of its structure. - Ability to work with multiple websites and understand their layout. I'm looking for someone who can deliver a reliable and effective scraping bot. Please include examples of similar projects you've complete...
...ensuring seamless integration with front-end components and databases. ### **Project Requirements:** 1. **Backend Development**: - Design and develop RESTful APIs or GraphQL endpoints. - Implement robust server-side logic and middleware. - Ensure code is optimized for high performance and scalability. 2. **Database Integration**: - Work with relational databases (e.g., MySQL, PostgreSQL) or NoSQL databases (e.g., MongoDB). - Create efficient database schemas and queries. - Ensure secure and reliable data storage and retrieval. 3. **Integration and Security**: - Integrate third-party services and APIs as needed. - Implement best practices for security (e.g., authentication, authorization, data protection). 4. **Real-Time Featur...
 Statement Of Work User App: -  Login o Login with Mobile Number:  Users can enter their registered mobile number to access the app.  Login with OTP: o Users receive a One-Time Password (OTP) on their registered mobile number.  Signup o Signup with Personal Details  Users can create a new account by providing o Name o Email addres...Management o Edit Profile Details: Vendors can update their personal and business information, including:  Business name  Contact information  Notifications Management o Send Notifications  Admin can send important notifications to the admin and vendors  Static Page Management o Manage content such as  Privacy Policy  Terms and Conditions  FAQs  Logout Technologies Used-  PHP for panels  MySQL for database  Flutter for App
Critical requirements : Open AI, Embedding, Vector databases, Scraping *** If you are interested you must be able to show me a previous related (Open AI embedding) project in your portolfio. Please send me a notification with a link to this project**** General Concept We are building a data-driven content creation system for our agency / clients. The project involves extracting content from client websites, structuring it into JSON packets, tagging it with metadata via a user-friendly web interface, and using OpenAI's embedding with a vector database and GPT APIs to retrieve and generate new content. This will be a new independent prorotype project to get the integrations and workflow set up and working correctly. Full-Stack Developer (Preferred One-Dev Solution) Responsib...
...test, and deploy a scalable web application using Laravel. Collaborate with our team to understand the project requirements and provide solutions. Integrate third-party APIs and manage database operations. Optimize the application for speed, scalability, and security. Fix bugs and provide post-deployment support as needed. Requirements: Proven experience in Laravel development. Proficiency in PHP, MySQL, and RESTful APIs. Familiarity with front-end technologies such as HTML, CSS, JavaScript, and frameworks like Vue.js or React (preferred but not mandatory). Strong problem-solving and debugging skills. Ability to communicate effectively and meet deadlines. Proposal Submission Guidelines: Portfolio: Please share examples of your previous Laravel projects. Links to live applications...
I'm seeking an experienced developer to create a comprehensive Library Management System. Key Features: - Book Registration: Input details like title,...create a comprehensive Library Management System. Key Features: - Book Registration: Input details like title, author, publication date, and copies. - Book Search: Search by title, author, publication date, and genre. - Book Borrowing Management: Track loans with due dates for return. - Reporting: Generate reports on borrowed and returned books, and total inventory. - Database: Use SQLite or MySQL for storing book and user information. User Access: - Access is limited to Administrator and Librarian Ideal Skills: - Proficiency in database management - Experience in developing management systems - Ability to implement user ...
...Design and develop the user interface using HTML5, CSS3, JavaScript, and React.js (or other similar frameworks). Ensure cross-browser compatibility and responsiveness for mobile and desktop. Integrate API endpoints to fetch and display data. Backend Development: Build RESTful APIs using Node.js, Express, or other backend frameworks. Integrate and manage databases such as MongoDB, PostgreSQL, or MySQL. Implement user authentication and authorization (JWT or OAuth). Optimize server performance and handle complex logic. Database Integration: Design and optimize database schemas. Implement efficient queries and ensure data consistency. Testing & Debugging: Write unit tests and perform integration testing for the application. Debug any issues and ensure code quality. Collaborat...
I am seeking a talented Full Stack Developer for a full-time engagement. If you're an individual freelancer with expertise in modern web and desktop app technologies, i want to hear from you! Required Skills: - MUI - Tailwind CSS - React.js - - - TypeScript - Node.js - Prisma - MySQL - AWS Work Details: - Schedule: Monday to Saturday - Hours: 8 hours per day - Payment: Monthly basis (10K) Who Can Apply: - Individual freelancers only (no agencies) - Must be able to demonstrate past work or projects in the required tech stack. If you meet the criteria and are passionate about full-stack development, drop your bid with your portfolio and let's collaborate!
...in web scraping and web development, with proficiency in various Python libraries and frameworks such as BeautifulSoup, Requests, Scrapy, and Selenium WebDriver. Responsibilities: -- Build and maintain automated web scraping solutions using Python and Selenium. -- Scrape data from websites and efficiently process it. -- Develop and integrate databases with frontend applications. -- Work closely with the frontend team to ensure seamless integration and functionality. -- Collaborate in building and maintaining the business’s web-based systems. -- Work on web development projects using Python and associated tools. -- Ensure code is scalable, maintainable, and efficient. Required Skills: -- Strong experience in Python (3-5 years). -- Proficient with Selenium WebDriver ...
I'm in need of a Python expert who can help scrape data from various E-commerce websites. The primary focus will be on gathering product details and pricing information on a weekly basis. Key responsibilities: - Scrape product details and pricing information from E-commerce websites - Perform this data extraction on a weekly schedule Ideal skills: - Proficiency in Python and web scraping tools - Experience with data extraction from E-commerce websites - Ability to work on a consistent schedule
I'm looking for a professional who can help me build a database by scraping sales data from a password protected website. I attached an example. I need the dashboard to self populate with the data that is held in the "Clearview" and "TimInsights" tabs. The data in both of these tabs need to be screen scraped from it's respective websites. Once the data is created, i want it to be able to create automated powerpoint presentation with respective data. Key Requirements: - Proficient in screen scraping techniques - Experience with building and managing databases - Ability to handle data from password protected sites I have the necessary login credentials for the website. The data needs to be scraped on a weekly basis. Please reach ou...
I need a Python-based web scraper to collect comprehensive product information from various Australian websites including , , , , and davidjones.com.au. The specific dat...specific data points I need include: - Product names and prices - Product descriptions and reviews - Product availability and stock levels - Images The scraped data should be delivered in a JSON format on a daily basis. Ideal skills and experience for this project: - Proficiency in Python, particularly in web scraping libraries such as BeautifulSoup and Scrapy - Experience in scraping e-commerce sites - Knowledge of JSON and data structuring - Ability to set up a daily automated scraping task Please provide examples of similar projects you've completed in your proposal.
To scrape Plumbers, Electricians, HVAC or Air-Conditioning, Roofers, Mechanics and Locksmiths contacts from yellow pages across below states Sydney Melbourne Brisbane Perth Adelaide Gold Coast Newcastle Canberra Wollongong Sunshine Coast Greater Hobart Townsville Geelong Cairns Toowoomba Darwin Launceston Albury-Wodonga
. Filters Section Enhancement • Filters are limited in functionality and do not provide an optimal user experience. • Add advanced filters for properties (e.g., price range, bedrooms, bathrooms, property type) • Ensure filters work seamlessly on both desktop and mobile devices. • Optimize the backend queries in MySQL for faster filtering results. 2. Map Fixes • The map is necessary interactivity. • Ensure the map updates dynamically when filters are applied. • Add functionality for users to click on map pins to see property details. 3. Update Login Options • Upgrade Requirements: • Integrate OAuth2 for social logins: • Google Login • Apple Login • Facebook Login • Ensure all login methods are secure ...
I'm in need of a skilled developer to scrape phone numbers from www.yellowpages.com.au. The data should be categorized into Plumbers, Electricians, HVAC companies, Roofers, and other trades. Key Requirements: - Delivering the data in an Excel spreadsheet - Including the Company name and Website URL along with the phone numbers - Formatting the phone numbers in International format for easy dialing Ideal Skills: - Proficient in web scraping and data collection - Experienced in using Excel for data organization - Knowledgeable in categorizing trade-related companies
I am in need of a skilled web scraper who can collect product information from 6 to 10 different websites on a daily basis. Key Requirements: - Daily web scraping of product data from multiple websites - Delivery of scraped data in a structured format - Ability to manage and handle data from multiple sources Ideal Skills: - Proficiency in web scraping tools and software - Strong data analysis skills - Experience in handling large data sets Please note, this is a daily task and requires consistency and reliability.
I'm in need of a professional who can create a web-based data entry tool for a MySQL database. This tool will handle mixed data types: text and numerical. The primary functions of the tool will be to facilitate data input and conduct validation checks. See attached file for specifics. Key Requirements: - Proficiency in MySQL database management - Experienced in web-based application development - Prior work on data entry and validation tools - Understanding of both text and numerical data processing Please include examples of similar projects you've completed in your proposal. Thank you.
Hi Moufi K., We just noticed that you posted a project for "Development of a Virtual Employee (AI) for Building and Modifying Systems in Laravel, PHP, and MySQL" (https://www.freelancer.com/projects/php/Development-Virtual-Employee-for/details)
I'm seeking a proficient Python developer with substantial experience in web scraping, specifically in image extraction. - Data Type: The primary focus of this project is scraping images from various online sources. - Sources: The specific sites for scraping can be discussed and will be determined based on your expertise and suggestions. - Output Format: The images will need to be stored in a manner that can be discussed further, depending on the scale of the project. Ideal freelancer should have: - Proficiency in Python and web scraping libraries such as BeautifulSoup and Scrapy. - Previous experience in image scraping. - Ability to suggest optimal sources for image scraping. - Good communication skills for discussing project details and u...
I'm looking for a Python developer who can create a script for me. The script should: - Take a Wayback Machine page url as input - For each feature listed on (), determine if the feature is implemented on the Wayback Mach...all versions of all major browsers. - Output the feature compatibility list as a CSV file with four columns: wayback machine page root url, browser name, browser version, feature implemented yes/no. The freelancer should also provide a short document (1-3 pages) detailing how the script works. The ideal freelancer for this project should have extensive experience in Python scripting and web scraping, and they should understand CSS and HTML. Familiarity with the Wayback Machine and is a plus.
...ticket or product purchases trigger the appropriate commission logic. Testing and Quality Assurance: Thoroughly test the system to ensure accurate commission calculations, smooth integrations, and error handling. Key Requirements: // Expertise in WordPress and WooCommerce development. // Familiarity with Ultimate Affiliate Pro or similar affiliate marketing plugins. // Strong skills in PHP, MySQL, and WordPress plugin customization. // Ability to handle custom logic and conditional workflows. // Experience with dashboard UI customization. Additional Details: Specific details about the business model and affiliate structure will be shared after signing a Non-Disclosure Agreement (NDA). This project involves implementing both standard features and customizations to match uniqu...
I am looking for a skilled Python or JS developer with expertise in web scraping, Selenium, and HTML parsing to enhance and complete a job scraping tool for the Adzuna job portal. Project Goals: code must fetch all job listings from Adzuna for a given search query URL (e.g., ). Handle cases where JSON-LD data is missing by falling back to HTML parsing to extract all relevant details. Current Issues: my code scrapes some job data (titles, descriptions, company names, etc.), but many fields remain blank. Not all job listings are fetched; the script currently stops at ~157 jobs out of ~410 listed. Fallback HTML parsing is insufficient, leaving many fields incomplete. Requirements: Comprehensive Data Extraction: Fetch all job listings from
I am seeking a seasoned Selenium and Python professional who can assist me with automating the scraping of data from various e-commerce sites. Ideal Skills and Experience: - Proficient in Python and Selenium - Strong experience in web scraping - Familiarity with e-commerce websites - Understanding of data extraction and processing - Knowledge of legality and ethics in web scraping Please note, while the primary focus is on scraping product information, the scope may extend to other types of data as needed.
looking for a skilled freelancer to create a dynamic website with the following pages: 1. Home Page: A visually appealing and responsive landing page that dynamically displays content. 2. Contact Us Page: A functional and dynamic contact form where user inputs are saved to a database and can be accessed via an admin panel. 3. Blog Page: A blog section where I can add, edit, and delete posts dynamically using an admin panel. The blog should support categories, tags, and a search function. Key Features Required: • Fully responsive design (desktop, tablet, and mobile). • Admin panel/dashboard for managing content (blog posts, contact form submissions, etc.). • Backend development with database integration (MySQL or similar). • Framework/Platform: [Spe...
I'm in need of a Python expert who can assist me with a web scraping project. The primary focus of this project is to scrape user data from various websites. Skills & Experience Required: - Extensive knowledge and experience with Python, particularly in web scraping libraries such as BeautifulSoup, Scrapy, etc. - Familiarity with handling and parsing user data. - Prior experience with web scraping projects. - Understanding of ethical considerations and legal restrictions related to web scraping. - Ability to deliver clean, well-documented code. Please note that the exact websites from which data needs to be scraped will be determined later, so flexibility and adaptability are key.