Web data scraping jobscông việc

...detail-oriented developer to build an automation tool that will facilitate the extraction of real estate data from multiple platforms, including Zillow, Redfin, StreetEasy, and others. This tool will allow users to download property listings and seamlessly extract additional zoning and building-related data from Zola NYC and NYC Open Portal, all within an easy-to-use Excel interface. Responsibilities: Download Listings: Create a system that can pull real estate listings data from sources such as Zillow, Redfin, StreetEasy, and other relevant platforms. Enable users to paste or upload property listing data into an Excel sheet for further processing. Data Extraction: Automate the extraction of zoning data for each property from Zola NYC and NY...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data colle...

I'm in need of a skilled web scraper and automation expert to assist with a unique project. The task involves scraping phone numbers from a specific directory site. The project requires: - Proficient skills in web scraping, specifically targeting directory sites. - Experience with automation, particularly sending messages via WhatsApp. - Ability to create a system that triggers a WhatsApp message whenever a new phone number is detected. The ideal candidate would have a keen eye for detail, understand the importance of data privacy, and be able to deliver a seamless, efficient system.

I'm looking for a proficient web scraping expert skilled in Javascript, Node.js, and Python. Your main tasks will include: - Scraping profile information from various social media platforms - Data mining from Shopify Ideal candidates should be well-versed in data extraction techniques, have a keen eye for detail and able to handle large datasets.

Project Title: ? Python Developer Needed for Script ...per task: Small fixes/modifications: $5-$10 Medium feature additions: $15-$30 More complex tasks: Higher rates possible ? First task will be a $5 paid test to check work quality. Requirements: ✔ Python scripting experience (loops, functions, API calls) ✔ Basic understanding of web scraping or automation ✔ Ability to follow instructions and deliver clean code ✔ Clear communication in English ? To apply, answer these questions: 1️⃣ How many years of Python experience do you have? 2️⃣ Have you worked with web scraping or automation before? (Yes/No, provide an example if yes) 3️⃣ What is your estimated turnaround time for small tasks (5-10 lines of code modifications)? ⏳ Ongoing work available for the right c...

...organized by categories (Real Estate, Cars, Jobs, etc.). Advanced internal search engine with various filters. User dashboards to manage ads and updates. Rating and review system for users and sellers. UI/UX Design: Responsive and attractive design compatible with all devices (Desktop and Mobile). Simplified and user-friendly navigation. Mobile Applications Development: Fully integrated mobile apps for iOS and Android. Features such as push notifications, location-based services, and direct image uploads. Hosting and Infrastructure: Cloud hosting with fast and secure servers. Integration with scalable databases. Regular backup system. Additional Features: Multilingual support. Integration with payment gateways (e.g., PayPal, Visa, etc.). High-level data security to pro...

...Access (SSH) - Obsolete Server Operating System - Lack of Log Rotation - Presence of Personal Data in Log Files - Non-Encryption of Personal/Sensitive Data in the Database - Cron Jobs Run from the Same Server - Lack of "GitIgnore" File - Lack of code documentation - No Git History of the Code - Presence of Hardcoded Variables in the Code - Presence of Secrets/Sensitive Information in the GitHub Repository - Showcase Website Integrated into the Platform - Presence of Variables in Multiple Locations in the Code - Security of User Accounts - User Account Creation All of these issues are top priority. The platform's security is a significant concern, especially: - Non-Encryption of Personal/Sensitive Data in the Database - Presence of Secrets/Sen...

I'm seeking a developer who can create different micro bots for me. The main purpose of these bots will be to automate various actions, primarily data scraping tasks. Key Responsibilities: - Develop around 5 bots each month, focusing on web scraping and APIs data extraction. - Ensure long-term, reliable performance of the bots. - Adapt to potential new tasks and requirements over time. Ideal Skills and Experience: - Proficiency in Python and AI technologies. - Strong experience in creating micro bots for data scraping. - Ability to understand and adapt to different data sources. Please note, the specific websites or APIs to scrape data from will be discussed and decided together. I'm looking for a long-term collabo...

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent and reliable data colle...

I am looking to extract product information from a website into an Excel sheet. I just need the product name, description, and price from the product listings on the site. Please let me know if you're experienced with web scraping and can finish this task. I just need an Excel Sheet and not a tool. Thank you!

...Creation: Workers should be able to create detailed profiles showcasing their skills, experience, and availability. - Job Notifications: The app should send notifications about relevant job opportunities based on the worker's profile and location. - Skill Verification: There should be a feature for skill verification to ensure that workers' claimed skills are validated. Key features for clients: - Post Jobs: Clients should be able to easily post job listings. - View Worker Profiles: Clients should have the ability to browse and view workers' profiles. - Rate Workers: After a job is completed, clients should be able to rate workers based on their performance. Ideal skills for this project include Android app development, backend server management, UI/UX design, an...

I'm looking for a web scraping expert who can extract data on clothing products from various ecommerce platforms. Ideal skills: - Proficiency in web scraping tools and software - Experience with ecommerce platforms - Understanding of data analysis The scope of the project includes: - Scraping clothing items' data - Providing insights and trends from the scraped data

...looking for an experienced developer to enhance an existing desktop application. The primary focus will be on implementing printer load balancing and improving system communication. The application is partially developed, and additional features need to be integrated. Responsibilities: Implement printer load balancing: Assign specific printers for black-and-white or color jobs. Reroute print jobs to available printers based on defined conditions. Develop and enhance communication between the application and external systems. Refine and optimize existing workflows for better performance. Add additional features as needed during development. Ensure the software is efficient, scalable, and user-friendly. Requirements: Strong expertise in and Node.js. Proficiency in JavaS...

...hire a developer specifically for fetching option chain stocks and index data using the Dhan API for your Tredex View project: ### **Responsibilities:** - **API Integration:** - Integrate with the **Dhan API** or other relevant financial APIs. - Develop and manage API calls to retrieve real-time stock, option chain, and index data. - **Data Handling:** - Write scripts or software to format and store the fetched data appropriately. - Ensure data is saved in preferred formats such as CSV, JSON, or directly into databases. - **Automation:** - Set up cron jobs or schedulers to automate the data fetching process. - Ensure regular updates and timely retrieval of data. - **Data Storage:** - Store fetched data...

I'm looking for a freelancer to help me with extracting data from a website. The data is spread across different web pages, and I need it to be exported into separate Word documents for each page. Only bid if you can do the job. Data to Extract: - Text content - Images (to be saved in JPEG format) all in one document each Document Organization: - Each Word document should have separate sections for text and images. Ideal Skills and Experience: - Prior experience with web scraping. - Proficiency in creating and formatting Word documents. - Attention to detail for data accuracy and organization.

I need a scraping expert to debug my Python script that's supposed to be fetching financial data from APIs. Currently, the script is failing to retrieve some data. Ideal Skills and Experience: - Proficient in Python and data scraping - Experienced with financial data APIs - Strong debugging skills - Knowledge of data parsing and handling - familiar with yahoo finance data

I'm seeking a freelancer to compile a detailed, monthly updated database of USA credit cards for a public website or app. Key Requirements: - image of the card. - Information on Interest Rates and Fees: Understand and gather data concerning the cost of owning the card. - Rewards and Benefits: Identify the perks associated with each card including cash back, travel points, etc. - Eligibility Requirements: Document what is needed to qualify for each credit card. Ideal Skills: - web scraping, cleaning and storing data - Familiarity with web/app data requirements Please note: This project will require a commitment to quarterly updates.

¡Desarrolla la Plataforma E-commerce Líder para Envíos a Cuba! Descripción del Proyecto: ¿Eres un experto en desarrollo web con pasión por el e-commerce y la innovación? ¡Esta es tu oportunidad! Buscamos un equipo de desarrolladores talentosos para crear una plataforma de comercio electrónico de vanguardia que revolucione la forma en que los cubanos adquieren productos desde Estados Unidos. Imagina una plataforma que permita a los usuarios en Cuba acceder a una amplia gama de productos de tiendas online estadounidenses, realizar compras de forma segura y recibir sus pedidos directamente en su puerta. ¡Eso es lo que construiremos juntos! ¿Por qué este proyecto es único? Impacto social: Facilit...

I need a skilled web scraper who can extract data from a members area of a website. The data should be compiled and delivered in an Excel file. Website Scraping of Members Area Ideal Skills: - Web scraping expertise - Proficiency in Excel - Attention to detail

...three Python scripts for an analysis project involving NASDAQ data . These scripts will scrape stock prices and dividends from free stock data site (i.e., ), place the data in a single-sheet Excel file, and create a line graph similar to an attachment I will provide (). Script 1: Download stock prices (for a year - Download Historical ) and dividend data (for a year) for a given stock Script 2: save data to a single-sheet Excel file Script 3: Create a chart in the Excel file The ideal freelancer for this project should have: - Extensive experience with Python, particularly with libraries for web scraping and data analysis. - Proficiency in creating and manipulating Excel files with Python. - Skills in data visualization, p...

I'm in need of a skilled programmer who ...skilled programmer who can create an independent bot for me. The bot's main task will be to retrieve certain information from a secure website. Key Requirements: - The bot should be able to log into the site with provided credentials. - It should collect specific user data, particularly user activity and user messages. Ideal Skills: - Proficiency in programming languages such as Python, Java, or similar. - Prior experience in web scraping and bot development. - Understanding of data security and ethical considerations in data retrieval. - Ability to deliver a reliable, efficient, and independent bot. Please note: The target website is secure and requires login credentials. The successful freelancer...

...to scrape oddsportal for game results,closing and opening all odds import them into excel. I am interested in soccer matches. The scraper should be able to scrape data according to date i.e. I would like to input a date range and sport (soccer) and get the match details for those matches. Further details will be discussed with bidder. I should also mention that date range for scrapping data could be quite long (i.e. months) so the output xls could be quite big. It is very important to me that scraping is done as quickly as possible (seconds) with as less clicks as possible and without hanging-up or crippling my PC while scraping. PROJECT DETAILS: Sport:----------------------Football Bookmaker:------------------Bet365, BWIN, Pame Stoixima, Stoiximan, Inte...

I'm looking for an expert in AI tools to scrape a website for me. The goal is to extract specific contact information and organise it neatly in an Excel sheet. Data to be Scraped: - Email addresses - Phone numbers - Names - Zip Codes The ideal candidate should have prior experience in web scraping and data management. Proficiency in using AI tools for this task is crucial. Data Formatting: - I need the data to be sorted into separate sheets for each type of information. Please provide examples of previous similar tasks you have completed successfully.

I'm seeking a proactive recruiter to assist me in finding and applying for mid-level automated testing QA jobs. Key Responsibilities: - Search for mid-level automated testing QA jobs - Tailor my skills to match each job requirement - Submit applications on my behalf - Handle recruiter calls and arrange interviews The ideal candidate will have: - A strong understanding of automated testing - Experience in recruiting for QA positions - Excellent communication skills

I am looking for an expert in automation and data scraping to set up scenarios in MAKE that link with my social media accounts and chat GPT. The goal is to have CSV files automatically publishing across all platforms with AI generated lifestyle images featuring my product. Additionally, I need assistance with data scraping for emails in my group. Ideal Skills: - Proficiency in using MAKE for automation - Experience with social media management - Ability to work with CSV files - Familiarity with AI image generation - Skills in data scraping Social Media Platforms: - Facebook - Instagram - TikTok CSV File Format: - Comma-separated values Type of AI-Generated Images: - Lifestyle images with my product

I'm seeking an experienced data analyst for 2 months. The project will primarily involve: - Scripting with Python to automate data pipelines and manipulate data. - Utilizing SQL for query optimization, managing joins, and performance tuning. - Employing Postgres for relational data modeling and management. - to produce clear reports or dashboards showcasing insights and progress. The ideal candidate will also be able to: - Understand or utilize AI-based techniques for data scraping. - Conduct exploratory data analysis, performing data cleaning and feature engineering as necessary. A critical part of the role will be translating business objectives into technical requirements. Hence, strong verbal and written communication skil...

...integrations, web scraping, and webhooks to work on a complex recruitment automation project. The core of this project involves integrating with the Manatal recruitment platform API, processing data from external services like OpenAI, and automating workflows to enhance candidate evaluation. This includes fetching candidate data, dynamically associating job descriptions, processing resumes via OpenAI's API, and updating scores and custom fields directly in the Manatal platform. Additionally, the project requires monitoring assessment completion through webhook events and triggering automated reminders or updates based on specific conditions. The ideal candidate must have strong experience with RESTful APIs, managing authentication (e.g., API tokens), an...

...responsibilities for this role include: Posting Jobs: You will receive job titles and descriptions from me, and your task will be to post these jobs on Indeed using your employer account. Managing Applications: Once candidates apply to the posted jobs, you must export their information and send it to me. Requirements: Indeed Employer Account: You must have your Indeed employer account, as I will not provide one. Experience: Ideally, you have experience posting jobs and managing applications on Indeed. Ongoing Availability: This is an ongoing project, so availability for continuous collaboration is essential. Next Steps: To ensure that you have the necessary experience and resources, please send a screenshot of your existing Indeed employer account, showcas...

...progress for fixed-price engineers, update project budget and schedule, report update in a minute of meeting - Review the internal project folders and check if they are aligned with quality standards (the order is in the right subfolder, requirements, technical documentation) - update this list of routine and on-demand routine Support for HR is required - Recruiting on online platforms - Opening jobs, - making interview and tests ( We will share a technical test to be done), - first selection - Payments and follow up document template creation (Word, Excel), Marketing material, like power point presentation, brochures, business proposal lead verification and generation from Linkedin, mail and follow feedbacks Required skills - SELF SUFFICIENCY in completing required technical t...

...platform reads, parses, and populates information from uploaded CVs. - Manual editing options for all auto-populated data to ensure accuracy and completeness. - Control over CV visibility settings (public, semi-private, private). 2. **Automatic CV Parsing:** - Upon CV upload, the system should: - Extract contact information, work experience, education, skills, certifications, etc. - Automatically populate the job seeker's profile with this data. - Provide an intuitive interface for job seekers to review and correct the parsed information. 3. **AI-Driven Job Matching:** - Use AI/ML algorithms to analyze JDs and match them with parsed CV data based on skills, experience, and keywords. - Continuous learning to improve matching a...

I'm looking for a web scraper to help my asphalt sealing company find leads. The ideal freelancer would be able to extract information from Google, Zillow, and Chamber of Commerce websites to find both residential and commercial properties with driveways or parking lots in my local area. Key Requirements: - Ability to find and extract pertinent information from web sources, including the name, address, email, and phone number of property owners or managers. - Prior experience with web scraping and lead generation. - Capacity to prioritize the search for properties on the specified websites. Ideal Skills: - Proficient in web scraping tools and software. - Excellent data collection and analysis skills. - Familiarity with Google, Zillow,...

I'm in need of a skilled data scraper who can extract phone numbers from various websites. Key Requirements: - Expertise in web scraping techniques and tools. - Proficiency in data sorting and filtering. - Prior experience in extracting contact details. Ideal Skills: - Web Scraping - Data Analysis - Python/Scraping Tools (like BeautifulSoup, Selenium, etc.)

I looking for dreelancer who make for me changes in actual code from Github. What I need: - filtering some IDs from CAN1->CAN2 - filtering some IDs from CAN2->CAN1 Clear lines in code, where I can put IDs to filtering/cover from whole canbus data I can test on STM32F407, but finaly program for STM32F105 Github link --> Project for freelancers with good rating on Freelancer, who maked similar jobs before. NOT FOR NEW FREELANCERS !!!

I'm in the process of launching a new enterprise and I need assistance exploring job opportunities in Egypt. - Please include in your application a portfolio of your past work that you believe is relevant and can demonstrate your capability for this task. There is no immediate deadline for this project. The focus is on quality and thoroughness over speed.

...**Efficiency and Speed**: - Ensure that the bot processes data quickly to deliver alerts **as soon as possible** without significant delay. - Optimize the bot to avoid rate-limiting issues and ensure it performs consistently without failure. - **Avoid Paid Tools**: - Develop the bot using **free or open-source tools** to avoid any paid X developer tools or third-party APIs. - Utilize **unofficial X API libraries** (e.g., Tweepy) or other methods to interact with X. - **Maintainability**: - The bot’s code should be **well-documented** and easy to maintain or extend in the future if needed (e.g., adding new profiles or improving detection logic). #### Requirements: - **Experience with X API or Web Scraping**: - Familiarity with using ...

... Fixed Monthly Payment: ₹5,000 (negotiable based on experience) Per Lead Bonus: ₹100 per qualified lead Key Responsibilities: Generate high-quality leads for our PPC services through your preferred methods. Identify and connect with potential clients using tools like LinkedIn, email campaigns, or data scraping. Maintain accurate records of leads generated and status updates. Collaborate with our team to ensure lead qualification. Requirements: Proven experience in lead generation, data scraping, or LinkedIn outreach. Strong communication and organizational skills. Ability to work independently and deliver results. If you have a track record of successfully generating leads in a competitive market, we’d love to hear from you! How to Apply: Send us you...

I am seeking assistance to start an online freelancing career focused on writing and translation. Key Responsibilities: - Help establish my profile on various freelancing platforms. - Provide guidance on best practices for securing jobs. - Share insights on how to improve writing and translation skills. - Assist in finding and applying for relevant job postings. Ideal Skills: - Expertise in writing and translation. - Proven experience in freelancing. - Knowledge of various online freelancing platforms. - Good communication and teaching skills.

I need a quality script to develop our Home Maintenance Services website for property owners and servicemen that must pay to apply for jobs .. We want a script with all quality features for a GLOBAL OPERATOR We want to pay up to $100 maximum for this project. We will pay a BONUS to whoever takes time to help us find the best available.

I am looking for a data scrapper who can scrap the reviews and product ratings for the few product categories from Amazon. Product Categories: - Electronics Specific Products: - Personal Audio - Large Audio (home speakers) - Wireless Speakers - Smartwatches - Smart Rings - Activity Tracker Ideal Skills: - Expertise in web scraping - Experience with data analysis - Familiarity with Amazon's platform and its product categories Please note, I only require data from Amazon, not Flipkart. Your bid should reflect your understanding of this project scope.

I need a skilled data scraper who can efficiently extract text from JPEG images and organize it into a Google Sheet. Key Project Details: - Source Format: The images are in JPEG format. - Data Type: The data to be extracted is purely textual. - Organization: The extracted text needs to be placed in multiple columns in the sheet. Ideal skills for this task include: - Proficiency in data scraping - Experience with image data extraction - Familiarity with Google Sheets and its functionalities Please provide examples of your previous work, specifically any similar data extraction projects you've completed.

I'm looking for a freelancer who can help me parse the entire database from the website. The data needed includes: - Name of the institution - Founder’s name - Email - Authorized capital - Taxpayer Identification Number (TIN) - Address - Phone number The parsed data needs to be delivered in an Excel format, as I plan to use it for marketing purposes. This is a one-time task, so I do not need the parsing to be done periodically. Ideal skills for this project include: data parsing, data entry, and Excel proficiency. Experience with web scraping and handling large datasets is a plus. Please ensure that your bid reflects your ability to deliver this data accurately and efficiently.

I need assistance extracting some information from a website. The data to be extracted is specific. The extracted data should be formatted as a CSV file. This is a one-time extraction task, so no ongoing work is required. Ideal skills for this job include web scraping, data extraction, and CSV file management. Experience with handling diverse types of data is a plus. Please ensure you can deliver a clean, well-structured CSV file. I need python script which i can run when i need to extract data. i script should take list of symbols which to use to go to site.

...quotes: "In Progress," "Allocated," "Completed," etc. Subcontractor Communication: Generate and send PDF quote requests to subcontractors, including attached photos and client details. Work Order Management: Track work orders and their status throughout the workflow. Scheduled Maintenance Tracking: Organize and manage scheduled maintenance tasks. Automatic reminders to subcontractors for allocated jobs. This are some basic option we need but we can disuss more in details upon acceptance of the project. Integration with Accounting Software (If possible): Integration with Xero for invoicing and quoting purposes. The software should include a user-friendly back-office interface to allow me or my team to make minor changes without requiring IT expe...

I'm in need of a skilled professional who can scrape B2B data from Google Maps and other sources, specifically targeting the Australian market. The focus is primarily on the commercial and industrial sectors, including industries such as manufacturing, logistics, production, engineering, refrigeration, meat wholesalers, food wholesalers and mechanical. Key Responsibilities: - Scrape B2B data from various platforms - Enrich the scraped data using Clay and other AI tools to get comprehensive company details - Capture the main contacts and their details, including mobile numbers and email addresses Ideal Skills: - Proficient in data scraping and data enrichment - Familiar with Clay and similar AI tools - Understanding of the Australian commerci...

Automatic Customizable Table or Report by Scraping, especially stock market fundamental data Do you want to have data to help you make more infromed decisions? demo: the table can be downloaded from website price: 70 USD per month per table, billed quarterly Affiliate Marketing: You help me find customers, I pay you 30% of the revenue for the first 3 months

...an experienced email marketer, proficient with mailchimp and data scraping, to help me develop relationships with service providers for eCommerce. The ultimate goal of this campaign is vendor development in Canada, focusing on all types of service providers in Canada, including but not limited to IT, marketing, and consulting services. Key Responsibilities: - Design and execute an email marketing campaign aimed at engaging potential service provider vendors. - Utilize data scraping techniques to identify and reach out to relevant service providers. - Employ Mailchimp for effective campaign management and monitoring. Ideal Skills: - Extensive experience in email marketing, particularly with Mailchimp. - Proficient in data scraping for vendor id...

...responsible for backend and frontend tasks, integrating APIs, enhancing scraping pipelines, and preparing the app for beta testing. This role requires expertise in Node.js, Python, React, and MongoDB, as well as excellent communication and teamwork skills. You will play a critical role in completing the app, ensuring a smooth user experience, and implementing efficient backend processes. The app will eventually integrate AI and deep learning algorithms for advanced repricing. Responsibilities: Backend Development (Node.js, Python): • Collaborate on API development and integration to connect the backend with the frontend. • Assist in enhancing the scraping pipelines written in Python for competitor and pricing data retrieval. • Optimize the datab...

** Clarification Information - post inquiries by providers ** I'm seeking an expert in MS Access to revise my current database for better functionality and to assist with web data population. This project has two key phases: 1) Revision of the existing MS Access Database - Correcting Form view fields: There are some fields in form view that are incorrect or incomplete, such as: **Fields to be added: "Contact 4" information - Name, Title, Phone, Email, Disposition. A "Status" field should be added on the header that will align to Active, Deleted, Archived PE Info field to be added ** Fields to be corrected: "Ownership" should be select list (Private, Public, PE Support, Unknown). Notes field to be split to allow for multiple no...

We use Skyvern OSS project and I need an experienced Playwright developer to update my browser automation tool. Need to add support for the following: - Inserting session cookies manually or via API calls - Able to debug automation instructions not working The primary purpose of this tool is for web scraping. Ideal candidates should have a strong background in Playwright, API integration, and web scraping. Please share your relevant experience when bidding.

I'm looking to scrape 10000 websites in Australia to analyze their payment gateways. The primary purpose of this tas...primary purpose of this task is to conduct competitor analysis. I also need to gather the contact information from these sites. The ideal freelancer for this task should be skilled in web scraping, data analysis, and have a keen eye for detail. Requirements: - Extensive experience in web scraping - Proven track record in data analysis - Ability to gather and organize contact information - Skills in competitor analysis - Attention to detail The scraped data should be provided in Excel format. Please ensure that the payment gateway details are included as part of the contact information. Please organize the scraped ...