Web scraping projects github jobs
...seeking a skilled developer to create a .NET C# desktop application. This application will primarily focus on API scraping app and web aplication . - key scraping api app and web top level and androad app - Web Scraping: The app should have web scraping capabilities, specifically for gathering availability information from different websites. - Session Management: Implement a robust session manager to handle multiple user sessions effectively. - Cookie Management: A cookie manager is necessary for maintaining user states and preferences. - JWT: The application should incorporate JSON Web Tokens for secure data transmission. CAPTCHA solving feature to enhance the web scraping process. Additionally, I requ...
...Development Project Description: I am looking for a freelancer to develop a scraper to collect tender advertisements and documents from various sources within Namibia. The scraper should be capable of the following: Scraping Websites in Namibia: Scrape almost all Namibian websites for tender advertisements and tender documents. Scraping Social Media Platforms: Scrape LinkedIn, Instagram, X (formerly Twitter), and Facebook for tender-related adverts or documents localized to Namibia. Scraping Local Newspapers: Collect tender advertisements published in local Namibian newspapers. Scraping Specialized Websites: Scrape two key websites that focus on advertising tender documents: A government-owned website (URL to be provided). A subscription-based website (...
...Frontend: 14, React 18, TailwindCSS Backend: API Routes, MongoDB Atlas Authentication: Payment Processing: Stripe Identity Verification: ComplyCube Deployment & Cloud Services: Vercel, AWS S3 UI Components: Radix UI, Headless UI State Management: React Context + Hooks Form Handling: React Hook Form Current Features User Features: Multi-provider authentication (Email, Google, GitHub). Service browsing and advanced search. Service booking and payment processing. User profile management and booking history. Expert Features: Expert profile creation and management. Identity verification through ComplyCube. Service listing, scheduling, and booking management. Payment receipts and earnings tracking. Admin Features: Verification of expert profiles. Management of service categorie...
We need to uWe need to update and modify the existing front-end UI code in the following GitHub repository and add new pages along with some development work. The primary front-end framework for this project is React.js, and the backend is built with Golang. The design has already been completed by our design team on Figma, including all required UI updates and interaction details (partial screenshots attached, the complete design file will be shared below). GitHub Link: Please Note: All pages must be fully updated according to the latest Figma design, ensuring no outdated logos, names, or brand elements remain. All elements must reflect the latest design and brand style, ensuring Figma every page in the project is implemented. The updated project
I'm seeking a telemarketer to generate leads for my kitchen and bathroom remodeling services in California. Key Responsibilities: - Conduct telemarketing to reach out to a list of homeowners interested in remodeling their kitchens and bathrooms. - Generate quality leads that can convert into potential clients. - Able to work 6 hours continuously a day preferably 12nn to 6pm PST - Has own computer, fast speed internet and headset Ideal Skills and Experience: - Prior experience in telemarketing, preferably in the home improvement sector. - Excellent communication skills and persuasive abilities. - Understanding of the kitchen and bathroom remodeling industry. - Ability to generate quality leads. Please provide a proposal detailing your relevant experience and how you can help me ach...
...capable of monitoring the website around the clock for available slots. The slots open for very short period of time like 10 seconds You must be super fast. Ideal Skills and Experience: - Proficient in programming. - Experience in web scraping and automating tasks. - Familiarity with handling Cloudflare challenges. - Knowledge of server-side scripting and executing scripts on Windows servers. - Strong problem-solving skills to ensure consistent performance of the script. - I understand that developing such a script requires a comprehensive understanding of web scraping, automation, and possibly interaction with the VFS website's API. If you have experience in these areas. - Implement a user-friendly interface for easy operation - Integrate functionali...
...Frontend: 14, React 18, TailwindCSS Backend: API Routes, MongoDB Atlas Authentication: Payment Processing: Stripe Identity Verification: ComplyCube Deployment & Cloud Services: Vercel, AWS S3 UI Components: Radix UI, Headless UI State Management: React Context + Hooks Form Handling: React Hook Form Current Features User Features: Multi-provider authentication (Email, Google, GitHub). Service browsing and advanced search. Service booking and payment processing. User profile management and booking history. Expert Features: Expert profile creation and management. Identity verification through ComplyCube. Service listing, scheduling, and booking management. Payment receipts and earnings tracking. Admin Features: Verification of expert profiles. Management of service categorie...
Web Scraping Expert for Automotive Marketplaces Project Overview: We are seeking experienced web scraping experts to develop robust and reliable scraping scripts for second-hand automotive marketplaces. An example of a platform we already scrape is AutoScout24. The goal is to build scripts that we can integrate into our existing systems to run daily, ensuring high-quality data extraction with minimal downtime. Key Requirements: 1. Script Development: * Create efficient web scraping scripts for various automotive marketplaces. * Ensure the code is clean, well-documented, and easy to maintain. * Deliver the source code, as we will be running and integrating the scripts within our existing infrastructure. 2. Anti-Bot Detection and CAPT...
I'm running a marketing campaign and I need someone to extract names and email addresses of chiptuning companies for me from google or other search engines. Specific ...extract names and email addresses of chiptuning companies for me from google or other search engines. Specific Requirements: - Data should focus on performance tuning companies only - Target regions include: Asia, Central America, Mexico, Panama, Columbia, Chile, Argentina, Brazil, Japan, Singapore, Australia, South Korea, China, Taiwan, Thailand Skills and Experience: - Data extraction and web scraping - Familiarity with chiptuning industry is a plus - Email and contact management - Knowledge of the specified regions The goal is to create a comprehensive database of potential business partners for ...
...skilled data scraper who can help gather wedding services reviews from various websites. The main task will involve scraping websites and extracting relevant information such as ratings, comments, and contact details for the service provider that was reviewed. ( Example: XYZ photographer is reviewed on Wedding Wire website. My website will list XYZ, with the publically available information, comments and reviews. If possible, I want all the information combined into a single review that combines the other reviews into an average review. The individual reviews can be viewed with clicking a "details" button revealing the specific individual reviews and the website source. ) Scraping will take place ongoing, but at least weekly. This project requires attention t...
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design【】 prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is React.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here:
...includes shop details, scores, and monthly sales trends for three stores. The developer will work with this data for implementation. Deliverables: • A fully functional React-based tool. • Clean, well-structured code hosted in a GitHub repository. • A visually appealing, responsive design. Required Skills: • Proficiency in React and Node.js. • Experience with data visualization libraries (e.g., , D3.js). • Strong understanding of CSS and UI/UX principles. • Familiarity with JSON data integration. Submission Guidelines: • Upload the completed project to a GitHub repository and share the link. Deadline: Provide an estimated timeline and availability for this project. If you are a motivated developer with a passion for clean...
I'm looking to scrape a website using the python package requests. 1) you'll have to login to get token 2) once you do that they make POST request behind the scenes that has page number in the payload 3) the return result is json - you have have to save that json to a text file
I'm in need of a skilled web scraper who can collect product details from various e-commerce sites. Key Requirements: - Expertise in web scraping techniques and tools. - Experience with e-commerce sites. - Ability to efficiently extract product details. Ideal Skills: - Proficiency in data extraction and analysis. - Familiarity with Python and libraries such as BeautifulSoup and Scrapy. - Strong attention to detail and ability to work independently.
I am in need of a comprehensive Arduino library for the AMC131M03 ADC that is compatible with the SAMD core (like the Arduino Zero). This library should support all possible features of the ADC, including reading values, calib...- Proficiency in Arduino library development - Strong understanding of the SAMD core - Experience with 24-bit ADCs - Excellent debugging and error handling skills - Previous work with AMC131M03 ADCs is highly desirable Many libraries already existt on Github, ADS131M04 Arduino libraries are fully compatible with just small changes: Library in C for the AMC131M03 for Mikroe Compilers
...comprehensive API scraping capabilities. Key Features: - Token Generation: The application should be able to generate tokens for API requests. - Captcha Bypass: This is a critical feature. The application must be able to bypass captcha prompts seamlessly. - API Scraping: The application should have the ability to scrape data from public APIs. - CODE DECODE: Implement a feature that can encode and decode data. Ideal Skills: - Proficient in C# and .NET framework - Experience with httpclient requests - Proven track record in API scraping - Familiarity with captcha bypass techniques - Able to implement encoding and decoding features. Please note, this project does not require development for Android or Web, its focus is solely on a Desktop application. - key...
I'm on the lookout for a dedicated, full-time website scraper and API expert. Currently, I have two projects that require intensive data collection and analysis. Key responsibilities include: - Scraping data related to music and movies from various platforms. - Collecting comprehensive music and movie Ideal candidates should have: - Extensive experience in web scraping and API utilization. - A deep understanding and interest in music and movies will be a plus. - Excellent data analysis skills. Please note, this role is full-time and requires commitment and dedication.
I need a web scraping solution that can take requests from people via messaging apps, scrape text data from a specified website, and then send that information out to people via both WhatsApp and Telegram. Key Requirements: - Web scraping to extract text data from a website. - Ability to receive requests from people through a messaging app. - Sending the scraped information through both WhatsApp and Telegram. Ideal Skills: - Proficiency in web scraping tools and programming languages such as Python. - Experience with WhatsApp and Telegram API. - Understanding of how to build a simple interaction system via a messaging app. If this project sounds like something you can handle, I look forward to your bid.
Job Assignment: Automated Deployment of Cosmos RPC Node and Monitoring Stack We are seeking experienced professionals with st...for replicating the setup. Additional Notes Tooling: Focus on Ansible, Bash, and Helm. If necessary, include minimal use of other tools or techniques to enhance the deployment. Open-Source First: Prefer open-source Helm charts and repositories whenever possible. Extensibility: Optionally demonstrate advanced features like CI/CD pipelines or scaling configurations, if time allows. Deliverables A GitHub repository containing: Ansible playbooks and roles. Helm charts (or references to open-source charts used). Bash scripts (if any). A README with detailed documentation and instructions. A summary describing your approach, decisions made, and any challenges en...
i only hire those who dont have review. because i pay low to help you kickstart your career here and you help me with low budget each USD 2 bug fixing fix and teach me usd 5 per bug fixing. type 232 prove that you read my message or all i will just reject. you can find the bug and tell me to fix. give me username of github and email for firebase to share user permission. if you need claude ai account from me to use free just tell me.
Job Assignment: Automated Deployment of Cosmos RPC Node and Monitoring Stack We are seeking experienced professionals with st...for replicating the setup. Additional Notes Tooling: Focus on Ansible, Bash, and Helm. If necessary, include minimal use of other tools or techniques to enhance the deployment. Open-Source First: Prefer open-source Helm charts and repositories whenever possible. Extensibility: Optionally demonstrate advanced features like CI/CD pipelines or scaling configurations, if time allows. Deliverables A GitHub repository containing: Ansible playbooks and roles. Helm charts (or references to open-source charts used). Bash scripts (if any). A README with detailed documentation and instructions. A summary describing your approach, decisions made, and any challenges en...
...a developer to integrate the jstree-table plugin (a plugin for JSTree) into my current solution that uses both JSTabulator and JSTree. I have two working versions on CodePen – one for JSTabulator + JSTree and another for JSTree with jstree-table: - JSTree with jstree-table: - JSTabulator + JSTree: GitHub references: - JSTabulator: (excellent docs!) - JSTree: (excellent docs!) - JSTree-table: The task: Integrate the jstree-table plugin into my existing JSTabulator + JSTree solution without losing any of the current features, including sorting, filtering, editing
We have transitioned from using collection names to using collection UUIDs for improved flexibility. However, we are experiencing some issues with the database and require assistance to rectify these problems so...with collections in the GUI is manageable once again. Key Tasks: - Troubleshoot and fix the display and saving of Collections. - Check and update all collections API routes. - Update the following components: Collections Builder, , , Fields.svelte. Please refer to the branch "valibot2" on our GitHub repository at for more context. Ideal Candidate: - Proficiency in Svelte and familiarity with GitHub. - Previous experience with database management and API routing. - Ability to commit fixes via a Pull Request.
I'm looking for a skilled data scraper to extract information from the Costco mobile app. The task involves multiple locations and specific p...from the Costco mobile app for various locations and product IDs. - Gather a pre-defined list of information for each product (to be shared in an Excel file). - Output the data in a CSV file. Initially, I need the data for one location. If the first batch is successful, I will require the code used for the scraping as well. Ideal Skills: - Proficient in data scraping and using tools for web and app data extraction. - Experience with Python or similar programming languages for scraping and coding. - Ability to deliver data in a specified format (CSV). Please let me know if you can assist with this project, we can...
Custom AI System Developer for Fitness Brand I’m looking for an experienced AI developer to build a custom AI...content creation and editing assistance Key Requirements: • Integration of tools like ChatGPT API, Canva AI, Synthesia, or similar for content generation. • Incorporation of relevant GitHub tools to enhance efficiency (e.g., video editing frameworks, auto-schedulers, AI content upscaling, etc.). • A user-friendly interface for generating social media posts, workout plans, and motivational captions. • Automated prompts for retrieving data and creating polished content quickly. Deliverables: • Fully functional and intuitive AI system. • Documentation on how to use the system efficiently. • Suggestions for GitHub tools...
...seeking a skilled programmer with a strong background in web scraping, automation, and data analysis. The objective of this project is to develop a personal efficiency optimization tool that can extract and process relevant information from various websites. Key tasks and requirements: - Design and implement a web scraping system capable of gathering diverse data from multiple websites. - Utilize automation to streamline the data collection process and enhance efficiency. - Process the scraped data and present it in a user-friendly JSON format. - Implement data analysis features to extract insights from the collected information. The ideal candidate should possess: - Proficient programming skills with extensive experience in web scraping and a...
I need a web scraping application to collect product auction data from a specific website: The primary focus of the project is on gathering historical data. The ideal freelancer for this project should: - Have extensive experience in web scraping and data extraction - Be proficient in using web scraping tools and programming languages, such as Python and Beautiful Soup - Have a good understanding of how to collect and store large amounts of data - Be able to create an efficient and reliable web scraping app Please note, this project does not require real-time updates or automated bidding features. The main goal is to track and collect historical auction data for product analysis. Additionally, a database must be created with the ex...
I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...
I'm looking for a skilled Python developer with experience in web scraping. The task involves extracting text data from various websites. Ideal Skills and Experience: - Proficient in Python programming - Extensive experience with web scraping - Familiarity with web scraping libraries such as BeautifulSoup, Scrapy, etc. - Good understanding of data handling and processing - Ability to work with a variety of websites
I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...
I am seeking a skilled virtual deal closer with a strong background in architecture to assist with securing deals on a wide range of architectural projects, from residential to commercial and industrial. This role encompasses client outreach and follow-ups, proposal and contract creation, and negotiating terms and closing deals. The ideal candidate will have an understanding of architectural projects and markets on a local, national, and international scale. Key Responsibilities: - Client outreach and follow-ups - Proposal and contract creation - Negotiating terms and closing deals Ideal Skills and Experience: - Strong background in architecture - Experience with client outreach and follow-ups - Proficient in proposal and contract creation - Skilled in negotiating terms an...
...you can replicate it and I also have created a video showing what it does. I want this done quickly, 2 weeks ideally. Here is the video: Required Skills & Experience: 3+ years of React Native development experience Proven track record of publishing apps to both Apple App Store and Google Play Store Experience using AI coding tools (GitHub Copilot, Claude, ChatGPT, etc.) Strong understanding of mobile UI/UX principles Proficiency in JavaScript/TypeScript Experience with state management (Redux, Context API) Knowledge of mobile app security best practices Experience with local data storage and cloud synchronization Familiarity with push notifications and background processes Technical Requirements: React Native Native iOS and Android
I'm in need of a bot that can scrape contact details off a specific website and store them into a spreadsheet. Ideal Skills: - Proficient in web scraping and bot development - Familiar with Python and libraries like Beautiful Soup, Scrapy, or Selenium - Experience with data handling and spreadsheet automation Please note: The specific website to be scraped will be disclosed to the selected freelancer. Prior experience with scraping contact details is a plus. Please provide examples of similar projects you've completed.
...for manual input or tweaking. - It should have a customizable loop duration feature, allowing me to adjust the timing as needed. - The bot needs to be equipped with a Web-based Interface (WBI), making it accessible from any device with internet connectivity. Ideal Skills and Experience: - Proficient in Javascript with demonstrable experience in bot development. - Previous experience with game bots, especially for strategy games like Ikariam, will be highly regarded. - Strong understanding of proxy usage and account management. Simillar bot for same game Ikariam from where you can take piracy code > Telegram
I HAVE CODE IN TEXT FILE - BUT ALSO HAVE GITHUB. So this is testing and troubleshooting I'm developing a Flutter app that will use native IOS AVFoundation for camera code. Below are the items i'm looking to add to my Existing starter project. Looking for someone to collaborate with me closely on the project. 1. **Video Capture** - **AVCaptureSession**: Use `AVCaptureSession` to manage the flow of data from input devices (like the camera) to outputs. - **AVCaptureDevice**: Select and configure the camera as the input device. - **AVCaptureVideoDataOutput**: This output allows you to access each frame of video data as it's captured. You can use a delegate method to process each frame. 2. **Buffering Frames with DispatchQueue** - **CMSampleBuffer**: Each frame is cap...
I'm seeking a professional with extensive experience deploying Kubernetes services on Azure. The project involves several key steps: - Setting Up: Acquire a new domain name and Azure cloud service. - Dockerizing Services: Dockerize specified services, and deploy them to DockerHub. - Database Management: Create and deploy a database management s...and subdomains for Portainer, Adminer, and the Traefik dashboard. A good candidate for this project should have: - Proficiency in Azure cloud services. - Strong skills in Docker and Kubernetes. - Experience with Traefik and Portainer. - Ability to create and manage domain names. I will need suggestions for the new domain name. Please note that the services to be Dockerized are listed in this GitHub repository:
I have an existing project and looking for an additional developer. I provide pdf's like the ones attached and you use FlutterFlow and custom Flutter/Dart where needed. 1) We use Github for the project. 2) Must have experience deploying FlutterFlow apps to App and Play stores 3) Must overlap at least 3 hours/day with Eastern Standard Time zone between 8am to 6pm 4) bid your hourly rate - if you tell me your hourly rate is different than what you bid i will not hire you
I'm in need of a web scraping professional to capture social media posts and store them in a database. The ideal candidate will utilize a JavaScript-based Chrome extension scraper, with GraphDB and MongoDB for managing the data. Skills and Experience Needed: - Proficient in web scraping, particularly with social media platforms - Experienced in using JavaScript-based Chrome extension scrapers - Familiar with GraphDB and MongoDB for database management - Ability to comprehend and implement detailed requirements - Prior experience with scraping various types of social media posts is a plus - Knowledge of real-time and periodic scraping techniques Please note, detailed requirements will be shared with the selected candidate.
I need a Windows-based desktop application that automates web logins and fetches data for testing purposes. This application will download a list of data in form of a table, then send them to my broker platform in order to make sell/buy transactions. I use Visual Studio, C#, with Selenium. I can provide you with a small example to show you. You will have the opportunity to ask me for additional information. You also notice that the trading platform credentials are saved locally only Ideal Skills and Experience: - Proficient in desktop application development for Windows - Experienced in web automation and data scraping - Knowledgeable in handling various types of data - Able to ensure the application is stable, efficient, and user-friendly
I need a skilled data scraper to extract information on auto parts from various sources. You will be responsible for collecting the data, organizing it into a CSV file, and ensuring it's properly f...ensuring it's properly formatted for Shopify. Key Responsibilities: - Scrape data from retail websites, manufacturer websites, and third-party marketplaces. - Collect product names and descriptions, prices and availability, and manufacturer details and specifications. - Organize and format the scraped data into a CSV file for Shopify upload. Ideal Skills and Experience: - Proficiency in web scraping tools and software. - Experience with Shopify and knowledge of its CSV formatting requirements. - Attention to detail and ability to verify data accuracy. - Understandi...
I'm in need of a skilled web scraper capable of extracting data from a webpage with 5,500 products. These products do not have variants, which should simplify the task. Data to be scraped: - Product name - Product Part Number - Product description (The product descriptions aren't formatted the same way for each product. They are inconsistent but similar.) The final deliverable should be an Excel/CSV file containing all the scraped data, sorted by product name. Ideal skills for this project include: - Proficient in web scraping - Proficient with AI - Experienced in data organization and Excel/CSV Please, only bid if you can deliver quality work in a timely manner. Thank you!
I'm seeking a professional skilled in Natural Language Processing and web scraping. The primary task will be data extraction from various websites, specifically product information. Key Responsibilities: - Design and implement an efficient web scraper to collect product data from e-commerce, manufacturer, and retailer websites. - Utilize NLP techniques to enhance data extraction and processing. Ideal Skills: - Proficiency in web scraping tools (like BeautifulSoup, Scrapy, Selenium etc.) - Strong background in Natural Language Processing. - Experience with data extraction from e-commerce and manufacturer websites. - Familiarity with Python or similar programming languages. Please provide examples of similar projects you've completed.
I'm looking for a skilled DevOps developer to configure my Node.js application on my Ubuntu/Linode server. The configuration should be for a production e...looking for a skilled DevOps developer to configure my Node.js application on my Ubuntu/Linode server. The configuration should be for a production environment and involve setting up a GitHub Actions pipeline. Key requirements: - Configuration of my Node.js app on a production server. - Setting up a GitHub Actions CI tool. Tasks to be included in the GitHub Actions workflow: - Running tests - Building the application - Deploying to the server Ideal candidates should have: - Extensive experience in DevOps and Node.js - Proficiency in configuring Ubuntu/Linode servers - Strong expertise in setting up and manag...
I'm seeking a data research expert with a strong background in data scraping. Your task will be to gather relevant data on gyms in Qatar. Ideal skills and experience for the job include: - Proficient in data scraping techniques - Able to filter for relevant data - Attention to detail - Prior experience with data research Please note, the specifics of the data types needed (contact details, number of members, available facilities) and the primary source of data (websites, social media, public records) will be determined based on your expertise and the information available. While the preferred format for final data delivery hasn't been specified, previous projects have typically used an Excel spreadsheet or a CSV file. A familiarity with Google Sheets wou...
...professionals find meaningful work. Key Responsibilities - Design and implement job scraping functionality to curate relevant opportunities - Build and optimize job posting features for a seamless user experience - Develop a secure registration system for jobseekers, including payment integration - Implement and maintain Impactribe's branding and design across the platform - Ensure the platform aligns with our mission of descaled, founder-first, and community-led recruitment Required Qualifications - Proven experience in building job sites or similar platforms - Strong full-stack development skills - Eye for design and user experience - Experience with payment gateway integration - Ability to implement web scraping solutions - Understanding of user authentica...
