Data aggregation scraping php jobs
I'm in need of a skilled web scraper who can collect product details from various e-commerce sites. Key Requirements: - Expertise in web scraping techniques and tools. - Experience with e-commerce sites. - Ability to efficiently extract product details. Ideal Skills: - Proficiency in data extraction and analysis. - Familiarity with Python and libraries such as BeautifulSoup and Scrapy. - Strong attention to detail and ability to work independently.
...application will primarily focus on API scraping app and web aplication . - key scraping api app and web top level and androad app - Web Scraping: The app should have web scraping capabilities, specifically for gathering availability information from different websites. - Session Management: Implement a robust session manager to handle multiple user sessions effectively. - Cookie Management: A cookie manager is necessary for maintaining user states and preferences. - JWT: The application should incorporate JSON Web Tokens for secure data transmission. CAPTCHA solving feature to enhance the web scraping process. Additionally, I require an Android application that can: - Scrape APIs: Decode and interact with internal APIs and functions. - T...
...include comprehensive API scraping capabilities. Key Features: - Token Generation: The application should be able to generate tokens for API requests. - Captcha Bypass: This is a critical feature. The application must be able to bypass captcha prompts seamlessly. - API Scraping: The application should have the ability to scrape data from public APIs. - CODE DECODE: Implement a feature that can encode and decode data. Ideal Skills: - Proficient in C# and .NET framework - Experience with httpclient requests - Proven track record in API scraping - Familiarity with captcha bypass techniques - Able to implement encoding and decoding features. Please note, this project does not require development for Android or Web, its focus is solely on a Desktop appl...
I'm looking for an experienced programmer who can integrate APIs into a Telegram bot using PHP. The specific integration is with the SMS Active system to update prices in real-time. Key Requirements: - Expert in PHP programming language - Proven experience in developing and integrating APIs into Telegram bots - Familiarity with the SMS Active system - Ability to implement real-time price updates within the app Please note, the primary purpose of the bot is to update in-app prices based on real-time changes. Your bid will be considered if you can demonstrate relevant experience and skills.
I'm on the lookout for a dedicated, full-time website scraper and API expert. Currently, I have two projects that require intensive data collection and analysis. Key responsibilities include: - Scraping data related to music and movies from various platforms. - Collecting comprehensive music and movie Ideal candidates should have: - Extensive experience in web scraping and API utilization. - A deep understanding and interest in music and movies will be a plus. - Excellent data analysis skills. Please note, this role is full-time and requires commitment and dedication.
I need a web scraping solution that can take requests from people via messaging apps, scrape text data from a specified website, and then send that information out to people via both WhatsApp and Telegram. Key Requirements: - Web scraping to extract text data from a website. - Ability to receive requests from people through a messaging app. - Sending the scraped information through both WhatsApp and Telegram. Ideal Skills: - Proficiency in web scraping tools and programming languages such as Python. - Experience with WhatsApp and Telegram API. - Understanding of how to build a simple interaction system via a messaging app. If this project sounds like something you can handle, I look forward to your bid.
I'm seeking an experienced PHP and JavaScript programmer to tailor a Codecanyon script to my needs. The modifications will focus primarily on the backend and involve incorporating a third-party payment gateway. Key Requirements: - Altering backend functionality to improve script performance - Integrating a third-party payment gateway seamlessly into the script - Prior experience with Codecanyon scripts is a plus The ideal candidate will be proficient in PHP and JavaScript, with a strong understanding of backend script functionality and API integrations. A knack for making user-friendly interface adjustments will also be appreciated. Please note, the primary task will be customizing the script's backend and facilitating payment gateway integration.
I'm seeking a skilled developer to create a PHP POS system for my retail store like mall php
I am looking for someone to help me set up a readymade PHP script. I already have the script and just need help in getting it live and making some minor changes. Skills and Experience: - Proficiency in PHP - Experience in setting up and configuring PHP scripts - Knowledge of web development and deployment processes
...skilled data scraper to extract information from the Costco mobile app. The task involves multiple locations and specific product IDs. here is the app: I have attached the locations, productids for which data needs to be scraped. I have also attached the sample data for fields which we need. Key Requirements: - Scrape data from the Costco mobile app for various locations and product IDs. - Gather a pre-defined list of information for each product (to be shared in an Excel file). - Output the data in a CSV file. Initially, I need the data for one location. If the first batch is successful, I will require the code used for the scraping as well. Ideal Skills: - Proficient in data scraping and using tools for web and app...
...programmer with a strong background in web scraping, automation, and data analysis. The objective of this project is to develop a personal efficiency optimization tool that can extract and process relevant information from various websites. Key tasks and requirements: - Design and implement a web scraping system capable of gathering diverse data from multiple websites. - Utilize automation to streamline the data collection process and enhance efficiency. - Process the scraped data and present it in a user-friendly JSON format. - Implement data analysis features to extract insights from the collected information. The ideal candidate should possess: - Proficient programming skills with extensive experience in web scraping and autom...
I need a web scraping application to collect product auction data from a specific website: The primary focus of the project is on gathering historical data. The ideal freelancer for this project should: - Have extensive experience in web scraping and data extraction - Be proficient in using web scraping tools and programming languages, such as Python and Beautiful Soup - Have a good understanding of how to collect and store large amounts of data - Be able to create an efficient and reliable web scraping app Please note, this project does not require real-time updates or automated bidding features. The main goal is to track and collect historical auction data for product analysis. Additionally, a database must be created with...
I am experiencing some bugs in my PHP CodeIgniter software that need to be rectified. The issues mainly pertain to the User Interface and some Functional errors. - UI Issues: These are primarily related to the software's interaction with users. - Functional Errors: I'm encountering problems with form submissions and database retrievals. The ideal freelancer for this project should have: - Extensive experience with PHP and CodeIgniter. - A strong background in troubleshooting UI issues and functional errors. - Proven skills in debugging and rectifying software bugs. - Ability to work efficiently and communicate progress regularly. Please reach out if you believe you can assist with these issues.
I...a detailed database of 7,000 US companies. Each company profile must encompass key details like the company name, and its associated emails (e.g CEO email, Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requiremen...
I'm looking for a skilled Python developer with experience in web scraping. The task involves extracting text data from various websites. Ideal Skills and Experience: - Proficient in Python programming - Extensive experience with web scraping - Familiarity with web scraping libraries such as BeautifulSoup, Scrapy, etc. - Good understanding of data handling and processing - Ability to work with a variety of websites
I...a detailed database of 7,000 US companies. Each company profile must encompass key details like the company name, and its associated emails (e.g CEO email, Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requiremen...
I'm in need of a skilled PHP developer to create an e-commerce website. The site should include a shopping cart, user accounts, and payment gateway integration. Key Features: - Shopping Cart: The site should have a reliable and user-friendly shopping cart. - User Accounts: The site needs to allow users to create personal accounts for a tailored shopping experience. - Payment Gateway Integration: The developer will need to integrate secure and efficient payment gateways. Ideal Skills: - Proficiency in PHP and e-commerce website development - Experience with integrating shopping carts and user accounts - Skilled in secure payment gateway integration Please note: Specific payment gateways have not been decided yet, but experience with PayPal, Stripe, and would be bene...
I'm looking for a professional web developer to build a classic and professional PHP website for my travel agency. The site should include a comprehensive package booking system and an admin panel. Key Requirements: - Real-time availability checking: The booking system should be able to show real-time availability of travel packages. - Package customization options: Users should be able to customize their travel packages. The site should have a classic and professional user interface. It needs to be user-friendly and easy to navigate. Please note, I do not require any payment methods to be integrated at this time. Instead, I need an enquiry and booking form. Ideal Skills: - Strong proficiency in PHP and web development. - Experience in creating travel agency websites ...
I'm in need of a bot that can scrape contact details off a specific website and store them into a spreadsheet. Ideal Skills: - Proficient in web scraping and bot development - Familiar with Python and libraries like Beautiful Soup, Scrapy, or Selenium - Experience with data handling and spreadsheet automation Please note: The specific website to be scraped will be disclosed to the selected freelancer. Prior experience with scraping contact details is a plus. Please provide examples of similar projects you've completed.
I'm seeking a skilled PHP developer with experience in working with MySQL and Cassandra. The task involves creating a succinct PHP script that can: - Continuously read user data from MySQL and write it into Cassandra. - Read user data from Cassandra and write it back into MySQL. The environment for testing is already set up locally, and the task is expected to be completed within 2 hours. The data transfer process does not require any transformations; the user data will be directly transferred without adjustments. Given the short time frame and nature of the task, I appreciate freelancers who have prior working experience with this kind of project. Your understanding of both databases and PHP is key to the success of this project. L...
Hi I need a working example in PHP using the libraries Slim and Stripe for pre-authorizing cards and then charge charge them. Max 50 euros.
I need a skilled PHP/SQL programmer to help me troubleshoot and fix issues in my existing code. I'm currently facing a couple of challenges that need immediate attention. 1) PDF Files Preview Issue: I have PDF files that are not previewing properly on three different pages and a 'save to PDF' page. Some PDFs are displaying while others aren't. All these files are stored in a database table. 2) Setting Up New Database Fields: I need assistance in creating three new fields in my database. This will involve integrating these fields in the front-end and back-end of my existing system. Ideally, I would like to complete these tasks within three hours, though I anticipate we could finish sooner. If you're available now and ready to work with me, please respond w...
I'm in need of a web scraping professional to capture social media posts and store them in a database. The ideal candidate will utilize a JavaScript-based Chrome extension scraper, with GraphDB and MongoDB for managing the data. Skills and Experience Needed: - Proficient in web scraping, particularly with social media platforms - Experienced in using JavaScript-based Chrome extension scrapers - Familiar with GraphDB and MongoDB for database management - Ability to comprehend and implement detailed requirements - Prior experience with scraping various types of social media posts is a plus - Knowledge of real-time and periodic scraping techniques Please note, detailed requirements will be shared with the selected candidate.
I need a Windows-based desktop application that automates web logins and fetches data for testing purposes. This application will download a list of data in form of a table, then send them to my broker platform in order to make sell/buy transactions. I use Visual Studio, C#, with Selenium. I can provide you with a small example to show you. You will have the opportunity to ask me for additional information. You also notice that the trading platform credentials are saved locally only Ideal Skills and Experience: - Proficient in desktop application development for Windows - Experienced in web automation and data scraping - Knowledgeable in handling various types of data - Able to ensure the application is stable, efficient, and user-friendly
I'm seeking a skilled PHP Laravel developer with experience in Backpack for Laravel. Most of the work is complete; however, there are approximately 50 outstanding defects primarily related to: - Website (User Panel) - API integrations The immediate priority is fixing these defects to ensure the site and its associated APIs are functioning correctly to support a mobile application. There is potential for long-term work following this project, as I will require support and maintenance. Ideal candidates would also have: - Proficient experience with PHP and Laravel - Previous work with Backpack for Laravel - Not mandatory but Good to have if your team has React Native for mobile development - Payment gateway integration
I need a skilled data scraper to extract information on auto parts from various sources. You will be responsible for collecting the data, organizing it into a CSV file, and ensuring it's properly formatted for Shopify. Key Responsibilities: - Scrape data from retail websites, manufacturer websites, and third-party marketplaces. - Collect product names and descriptions, prices and availability, and manufacturer details and specifications. - Organize and format the scraped data into a CSV file for Shopify upload. Ideal Skills and Experience: - Proficiency in web scraping tools and software. - Experience with Shopify and knowledge of its CSV formatting requirements. - Attention to detail and ability to verify data accuracy. - Understanding o...
I'm looking to create a modern, sleek business website in PHP. The website should encompass essential pages including Home, About Us, and Contact Us. Ideal skills for the job: - Extensive knowledge of PHP - Web design experience with a modern aesthetic - Ability to create user-friendly, responsive layouts Please include samples of your previous work that demonstrate your ability to deliver a website of this caliber. Your understanding of modern web design principles and PHP will be key in successfully executing this project.
Need minor edits to my POS system. Tasks include: - Logo update - Modifying the Scripture - Changing a description to 'Warranty' I have the new warranty information ready to go. Ideal skills and experience: - Proficient in PHP - Familiar with point-of-sale systems - Able to make quick, precise changes - Good understanding of UI/UX for POS systems
I'm looking for an experienced developer who can help me convert my existing PHP project to CodeIgniter. Key requirements: - Expertise in PHP and CodeIgniter. - Ability to understand and work with existing PHP code. - Experience in converting PHP projects to CodeIgniter. - Strong problem-solving skills to handle any issues that may arise during the conversion process. Please note: - The main purpose of the project has not been specified. - The version of CodeIgniter to be used is also undecided. - No additional features or improvements are required during the conversion.
I'm seeking a professional skilled in Natural Language Processing and web scraping. The primary task will be data extraction from various websites, specifically product information. Key Responsibilities: - Design and implement an efficient web scraper to collect product data from e-commerce, manufacturer, and retailer websites. - Utilize NLP techniques to enhance data extraction and processing. Ideal Skills: - Proficiency in web scraping tools (like BeautifulSoup, Scrapy, Selenium etc.) - Strong background in Natural Language Processing. - Experience with data extraction from e-commerce and manufacturer websites. - Familiarity with Python or similar programming languages. Please provide examples of similar projects you've completed.
I'm seeking a data research expert with a strong background in data scraping. Your task will be to gather relevant data on gyms in Qatar. Ideal skills and experience for the job include: - Proficient in data scraping techniques - Able to filter for relevant data - Attention to detail - Prior experience with data research Please note, the specifics of the data types needed (contact details, number of members, available facilities) and the primary source of data (websites, social media, public records) will be determined based on your expertise and the information available. While the preferred format for final data delivery hasn't been specified, previous projects have typically used an Excel spreads...
I'm looking for a skilled PHP Laravel developer who can create a robust vehicle tracking system. The system should be capable of tracking vehicles' locations in real-time. Key Features: - The system should track vehicles, focusing primarily on their location - Real-time updates: The tracking information should be updated in real-time Ideal Skills: - Proficient in PHP 8 and Laravel - Extensive experience in developing GPS tracking systems - Knowledge of TCP server implementation in PHP - No JavaScript skills required for this project Please note that the project should not involve any JavaScript. Your proposal should clearly demonstrate your relevant experience and how you plan to deliver this project.
...professionals find meaningful work. Key Responsibilities - Design and implement job scraping functionality to curate relevant opportunities - Build and optimize job posting features for a seamless user experience - Develop a secure registration system for jobseekers, including payment integration - Implement and maintain Impactribe's branding and design across the platform - Ensure the platform aligns with our mission of descaled, founder-first, and community-led recruitment Required Qualifications - Proven experience in building job sites or similar platforms - Strong full-stack development skills - Eye for design and user experience - Experience with payment gateway integration - Ability to implement web scraping solutions - Understanding of user authentication an...
I'm in need of a data scraping expert who can help me gather information for lead generation. The data should be relevant and useful to my business needs. Key Requirements: - Scraping of contact details, company information, and purchase history. - Experience with scraping data from web pages and social media platforms. - Familiarity with GPT 4.0 for data analysis and interpretation. Ideal Skills: - Proficient in data scraping tools and software. - Excellent understanding of lead generation. - Ability to deliver organized and clean data sets.
...scrapers to pull new announcements and update the database efficiently. This solution will enable seamless data retrieval, analysis, and management for stakeholders. Scope of Work 1. Database Development • Design and implement a scalable, secure relational database (e.g., MySQL or similar) for storing funding and tender listings. • Database structure should accommodate fields such as: • Title of the funding or tender. • Description and eligibility criteria. • Submission deadlines. • Funding amount or programme budget. • Contact details or application process links. • Relevant documents (if applicable). 2. Web Scraping Setup • Develop web scrapers to automatically extract data from: • European Commissio...
I'm in need of a seasoned PHP Laravel 11 and JavaScript developer to enhance my marketplace. The key areas needing customization involve the cart and product variation. Key requirements include: - User Interface (UI) improvements, particularly on the product variation display - Functionality upgrades across the cart and product variations - Enhanced error handling and validation processes The successful freelancer will have a solid background in PHP Laravel and JavaScript, with a keen eye for visual design and user experience.
I need a PHP expert to implement a caching mechanism for my RAND() results. I have 3 PHP files: - The first file contents a list of words. - In the second file, I randomly « echo » one word at a time. In the third file, I want to include the result of the second file in 2 different positions of the page. But the issue is that as I see, without caching, I get 2 different words in the third file. So I need the result of the second file to be cached every 2 or 3 requests and include that cache in the third file to get the same word in all positions. Key Requirements: - Include the cached result in another file. - Refresh the cached RAND() result every second or third request. - Utilize a file-based cache for this purpose. Ideal Skills: - Proficiency in ...
I'm looking for a web developer with experience in integrating Stripe into PHP websites. The project involves creating different payment buttons for various payment methods, including Credit/Debit Card, PayPal, Apple Pay, Google Pay, Giropay, and Klarna, all through the Stripe gateway. Key Requirements: - Integrate Stripe payment system into a PHP website - Develop individual payment buttons for various payment methods - Ensure the design of the buttons is sleek and modern - Prioritize the integration of specified payment methods Ideal Skills: - Proficiency in PHP - Extensive experience with Stripe integration - Strong web development skills - Good understanding of modern design principles - Familiarity with creating custom payment buttons
I’m looking for a skilled developer to help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation. Current Situation: I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached). The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable. What I Need: A robust and reliable solution for faster and more efficient scraping without interruptions. The ability to download HTML files in the required structure....
I have an existing Python script that performs an automation task, primarily integrating with public APIs and scraping specific websites. Key Task: - I need this Python script converted into an N8N workflow. The key functionalities of the original script that need to be replicated include: - API integration and endpoints - Web scraping Ideal Skills and Experience: - Proficiency in Python and N8N - Experience with API integration and web scraping - Understanding of automation tasks - Familiarity with public APIs
New project as already discussed.
...the generated content into new WordPress posts. Content Scheduling & Publishing: Implement an automated scheduling system to publish blog posts at predefined times. Google Indexing Optimization: Integrate with an SEO plugin (e.g., Yoast SEO or RankMath) to optimize post titles, meta descriptions, and on-page elements for better Google search rankings. Optional Enhancements: Integrate RSS feed aggregation to source content from other relevant websites. Consider automated image generation or integration for blog posts. Explore options for generating different content formats (e.g., listicles, how-to guides). Current Manual Process: Manually write blog post content using ChatGPT. Create a new page in WordPress. Add images, header, and footer manually. Manually index the page. D...
I...a detailed database of 7,000 US companies. Each company profile must encompass key details like the company name, and its associated emails (e.g CEO email, Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requiremen...
I need a skilled bug hunter or vulnerability tester for my custom-built PHP website. Your task will primarily be to identify SQL injection vulnerabilities on the site and its APIs. Key details: - The website is custom-built using PHP - Potential for a high payout, as I am willing to pay $300 for each SQL injection vulnerability identified Ideal Skills & Experience: - Extensive experience in vulnerability testing and bug hunting - Proficiency in identifying SQL injection vulnerabilities - Prior experience with PHP-based websites is a plus - Familiarity with API testing Please note, the question regarding specific areas of the website where vulnerabilities might exist was skipped, so a thorough examination of the entire site and its APIs will be required.
I'm in need of a professional data scraper to extract contact information from 1400 profiles on a particular website and import it into an Excel CSV file. Key Requirements: - Scraping of 7 specific fields of contact information from each profile, including: - First name - Last name - Email address - Phone numbers - Social media links - Opponent - Win or loss/method Ideal Skills: - Proficient in web scraping tools and techniques. - Excellent attention to detail to ensure data accuracy. - Experience with data processing and Excel. Please bid if you have prior experience in this type of project.
Purpose: This document defines the requirements for developing a scraping script that extracts data from the website with the aim of storing catalog information in a relational database. This includes categories, subcategories, machine plans, parts of each machine and their respective images.
