Data scraping using trabalhos

Description over freelancer and Video Call

We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximity to transport, scho...

Transform Excel Sheet Data to Charts and Stats using Power BI, we need interpretation for each chart.

I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated

I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.

...platform's limits. The goal is to create a 24/7 with near realtime data and create either an application dashboard or simple csv with pivot/histogram for an easy visualization. Someone who already worked on similar request is preferred to avoid number being blocked so scheduled breaks are required in the code. Request is only to get the content and put in the easy readable format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless for real-time or near realtime data viewing Key Data to be Scraped: - Conte...

...- ein minimalistisches und klares Design verstehen und umsetzen. - Beispiele früherer ähnlicher Projekte liefern. Wir sprechen Deutsch, Englisch und Spanisch und freuen uns auf Ihr Angebot. Michael --- Hey Freelancer, I hope you had a good start to the new year. We are looking for an experienced WordPress developer to create a modern, clean, and minimalist e-learning platform using the Lifter LMS plugin. Project 1: A new e-learning website: Menu: Home. About us. Blog. Search function. Shopping cart. Login. Requirements: Book appointments for a consultation call on the website with immediate confirmation. Book and pay for individual seminars and seminar series from a catalog on the website (credit card, Klarna, and PayPal) with immediate...

A need a content writer to write content for DATA SCIENCE COURSE using R programming and Python programming. Reference websites 1. Acte 2. Besant technologies 3. Simpli learn 4. I need to know the budget and timeframe. It should be pragarism free. No chatgpt no ai tools. Proper content writers alone with technical knowledge apply.

I need a skilled web scraper to assist with my real estate business. This involves scraping a real estate website that updates daily with 2,000–3,000 listings. The goal is to extract and match the data with realtor needs from my internal database. Requirements: - Daily scraping of 2,000–3,000 listings. - Extract relevant data such as price, property type, location, realtor name, contact info, and more. - Basic matching for a specific region. Budget: I’m ready to pay $40/month for this service. Ideal Skills: - Proficient in web scraping techniques and tools. - Experience in data extraction and analysis. - Familiarity with real estate data is a plus. - Able to perform basic data matching. Note: Please be aware tha...

I'm looking for a data scraping expert to help me gather product information from three websites. The specific data I need includes product names and prices as well as product descriptions and specifications. The task is a one-time requirement, so I don't need ongoing updates. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience in extracting product information from e-commerce websites - Strong attention to detail to ensure accurate data collection

I'm looking for a creative designer who can craft 6 PowerPoint slides for a business pitch. The slides should embody an innovative tone and effectively utilize images and icons, as opposed to graphs and charts or diagrams and flowcharts using the provided inspiration images Key Responsibilities: - Design 6 engaging PowerPoint slides that act as a template 1 x opening page with logo and title 1 x image on the right, text on the left 1 x image on the left, text on the right 1 x full scape image with text image 1 x 8 tile images 1 x closing slide - Black background with the space (stars background as per image) - Incorporate provided design elements including Logo and ancient greek symbols - Use of images and icons for visuals Ideal Skills and Experience: - Proficiency in Powe...

...metadata - Additional metadata Currently, all the scraped data is stored in a CSV file. I am looking for a developer who has expertise in python / scraping and postgres to do the following: [Phase / Milestone 1] 1. Convert the existing scraper (code attached - /site-packages removed for space) to load the data in a postgres database. 2. Scrape reviews of products from the (CWH) website and store them in the database. 3. Look up the availability of the product in specific stores and write the boolean value in the postgres database. (code attached - ) [Phase / Milestone 2] 4. Once this data is scraped, I then move it to a Google Sheet where I run a script to enrich the data using ChatGPT. I want to reduce these steps or make them effici...

I'm in need of a Python script that can download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from ...download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from a public website every hour. - Upload the report to a specific portal folder without any modifications. Ideal Skills: - Proficient in Python programming. - Prior experience with web scraping and automating tasks. - Familiarity with working with Excel files in Python. - Knowledge of file upload protocols...

...Need to migrate an existing website and add proper structure, access control, admin section. Basically need a proper skeleton created to be able to add additional functionality later. # Software Requirements Specification for Online Worksheet Practice Website Structure ## 1. Overview This document outlines the software requirements for an online worksheet practice website to be developed using CodeIgniter 4. The website will provide educational resources in the form of worksheets, categorized by grade level and subject, similar to and education.com. It will include features for various user access levels, content organization, and administration. A simple working version of this website is already available (). The developer can choose

I'm in need of a versatile professional skilled in Squarespace and Canva. Your primary t...integrating local delivery options and managing courier charges. You will also be tasked with creating a series of Canva social media posts and setting up an e-learning course in Squarespace (I will provide the written content). Additional responsibilities will include various general marketing tasks, such as scraping email addresses. Ideal Skills: - Proficiency in Squarespace and Canva - Experience in e-learning course setup - Knowledge of basic marketing tasks - Skills in data scraping Understanding of product fulfillment and delivery integration on e-commerce platforms is crucial for this role. Looking forward to your bids. Looking for ongoing person who ...

HM Interface Designed by Matlab program will send step motors data from Matlab to Arduino. Control a stepper motor connected to Arduino through Matlab. Arduino sketch file communicates will Matlab program. Program Interface will show and control current angle/step, degrees to Jog, motion jog +/- and X Y Z current position each of joints. On the program Human Machine Interface will have buttons for Teach New Position, Modify Position, call program and delete program, etc. . Program will make Auto Calibration, Manuel Calibration and Show Calibration values for each joints. Program section will be inputs and outputs toggle buttons for entering values servos and digital outputs. MATLAB Program will provide us as design view with written codes not just as .exe file. Program will be ope...

Seeking a freelancer to generate B2B leads targeting the Tech sector in Malaysia. Source: Leads from Linkedin. Most important is EMAIL ADDRESS. No Free email account. Targeting 1000, 5000 & 10,000 leads . PM for discussion

...Responsibilities Design and implement email automation strategies, including: 1. Journey Emails (Pre-Delivery, Trip, Post-Booking/Review, Re-engagement). 2. Monthly Newsletters and Seasonal Campaigns. 3. Seasonal Campaigns / Promotional Emails Key task: 1. Manage and segment subscriber lists for targeted messaging. 2. Monitor email performance and optimize for engagement. 3. Create visually appealing assets using tools like Figma. Requirements: 1. Proficiency in Mailerlite or similar tools. 2. Strong copywriting and visual storytelling skills. 3. Understanding of the customer journey and behavior segmentation. 4. Familiarity with Figma for creative design. 5. Analytical mindset to track and improve performance. Why Join Us? 1. Flexible working hours to suit your schedule. 2. P...

I'm looking for an experienced WordPress developer who has previously worked with the Travel Tour - Travel Booking WordPress theme. The task involves building a new site for my travel agency, which operates land transfers and tours, using this theme. Content from an existing website will need to be migrated to the new one, including text, images, and customer reviews. Key Responsibilities: - Building a new travel agency site using the Travel Tour theme - Migrating content from an existing website - Providing links to other websites built with this theme Ideal Candidate: - Previous experience with the Travel Tour - Travel Booking WordPress theme - Strong WordPress development skills - Ability to provide links to prior work with this theme Please only bid if you have e...

I'm looking for a skilled PHP developer to create a dynamic web scraper for trading data. The scraper needs to collect price data from various sources, namely: - Stock market websites - Cryptocurrency exchanges - Forex trading platforms The data should be collected in real-time, so experience with PHP and web scraping is a must.

We need someone to scrape website data and social media posts. Please download every Tiktok post from Return Home: @returnhomenor?lang=en We will need the videos, text description, hashtags, and all comments (and their associated data). In doing so, we ask that you create an Excel spreadsheet, a folder with video downloads, and a folder of Word documents that include the comments on each video. We provide a detailed description below. 1. Excel Spreadsheet: Please create an excel spreadsheet with the following columns. Column A: Label: “Video title” In this column, please provide the video title to match the title of the video download. For example, if you look at this TikTok video (@returnhomenor/video/7164090596796157230?lang=en), you would

I'm in need of a freelancer who can assist me with data entry of realtor information (name, company name, phone number, email, city) from multiple websites onto an excel sheet. This data needs to be formatted in a way that it can easily be imported into my CRM. Key Tasks: - Source realtor information from multiple websites - A combination of web scraping and manual data entry - Processing of more than 500 entries Ideal Skills & Experience: - Proficient in Excel - Experience with web scraping - Detail-oriented to ensure data accuracy - Able to work independently and efficiently

...dashboard that consolidates data by scraping three specific webpages and processing files from an online consultation system with restricted access (user and password protected). The dashboard must include the functionality to download PDF reports and present the data in a user-friendly and analytical format. A detailed explanation of the webpages to be scraped is provided in the attached PDF. 1. Key Responsibilities: Design and implement an online dashboard with secure user authentication and restricted access. Scrape data from three specified websites, utilizing anticaptcha to bypass CAPTCHA requirements. Integrate uploaded files from an online consultation system. Enable the generation and downloading of PDF reports directly from the dashboard. Perform ...

Por favor, Cadastre-se ou Faça Login para ver os detalhes.

I'm looking for a skilled WordPress developer to create a custom plugin for related posts. The plugin should be able to: - Search external websites based on a list I provide - Identify similar articles using the keywords in my site's post titles - Automatically posting 3-5 related titles with hyperlinks on the original site The ideal freelancer for this project should have a solid understanding of WordPress plugin development, web scraping, and SEO practices. Experience with creating similar plugins in the past will be a big plus. The objective is to increase my site's interactivity and improve its SEO ranking through relevant external links.

I need a software engineer to create a Python SDK/package for scraping Reddit data. The package should accept either an email address or a LinkedIn profile URL as input to identify and retrieve data from a person's Reddit account. Key Responsibilities: - Build a Python package that takes a person's identifier (an email address or LinkedIn profile URL, both are suitable as options) as input. - Implement logic or utilize third-party APIs to identify the person's Reddit account. - Scrape the person's Reddit activity, including posts, comments, and likes. - Structure the retrieved data for easy access by the package user. The choice of third-party APIs for identifying Reddit accounts is open. The freelancer may choose whatever they think is mos...

...assistance with migrating product data from my existing website hosted on City Hive () to Shopify. Since City Hive lacks a direct export feature, this project requires scraping the product data and preparing it for import into Shopify, ensuring all essential details are included. Key Project Requirements: Data Extraction: Scrape or extract product data from the website, including product titles, descriptions, pricing, images, categories, brands, and options/variants. Example product page: Legend Vineyard Exclusives LVE Cabernet Sauvignon. Ensure that product categories (e.g., Wine, Spirits), brands (e.g., John Legend), and relevant attributes (e.g., Cabernet Sauvignon, Red Wine, Napa Valley) are captured. CSV File Preparation for Shopify: Format th...

Create a Simple Octoparse Template for Web Scraping Job Description: I need someone familiar with Octoparse to create a simple template that I can use to scrape a local copy of a website. This is an older website with no dynamic content, logins, or complex elements—it’s straightforward and static. Scope of Work: Set up the Octoparse template to start on a page listing all business categories. Configure the template to navigate into each category, extract business listings, and handle pagination if applicable. Capture basic business details like name, address, phone, and website (if listed). Key Information: The site is hosted locally on my computer, so I’ll run the template myself. The template should be reusable and easy for me to use without needing extra s...

I'm looking for a skilled developer to help with two tasks. Firstly, I need an information scraper built or fixed to pull numerical values from a specifi...developer to help with two tasks. Firstly, I need an information scraper built or fixed to pull numerical values from a specific source and store them in my database. Secondly, I am experiencing issues with my billing. Card bills are being generated, but my database doesn't update on recurring charges. This issue needs to be fixed promptly. Ideal Skills: - Proficient in web scraping tools and techniques - Strong knowledge of database management - Experienced with and troubleshooting payment gateway issues - Good understanding of recurring billing systems - Ability to deliver prompt and efficient solutions

I'm looking for a data scrapper who can extract specific information from Twitter and Facebook for me. Twitter Data: - I need the Username and bio, Number of followers, and Name of Twitter users. - I want this information from both personal and business profiles. Facebook Data: - I want to scrape Business profile follower links from Facebook. Ideal Skills: - Prior experience in data scraping from social media platforms - Proficiency in data analysis - Familiarity with Python or other scraping tools - Knowledge of ethical data scraping practices 800K records / 2 days delivery

I need a freelancer who can extract text content from a specific website - Google Trends. Key Responsibilities: - Extract relevant search terms from Google Trends - Organize the data in a systematic and easily understandable format Ideal Skills: - Proficiency in web scraping and data extraction - Familiarity with Google Trends - Excellent data organization skills Experience: - Previous work related to web data extraction is preferable - Experience with Google Trends is a plus

...WordPress store with a specific e-commerce site. Currently, I manually add products and check stock status but I'm looking to fully automate this process. Key Responsibilities: - Web scraping product information from a specified e-commerce site, not via API. - Daily synchronization of prices and stock status. - Importing various product details including Title, SKU, Price, Stock status, Attributes (options to pick), Description, and Images. Tools & Plugins: - The integration with my WordPress store should be done using the WP All Import plugin. Ideal Skills & Experience: - Proven experience in web scraping. - Strong knowledge of WordPress and WP All Import. - E-commerce and inventory management experience is a plus. - Excellent problem-solving skills...

Project Background and Objective is a "Website as a Service (WaaS)" platform aimed at online teachers/trainers, coaches, consultants, e-commerce entrepreneurs, event organizers, and SMEs. The service enables users to quickly and easily create sales funnels via an intuitive interface, offering advanced customization options and integrated hosting. The site is already configured with WordPress Multisite and the main required plugins. We are seeking an experienced freelancer to finalize the configuration, enhance the design, and ensure an optimal user experience. Project Details 1. Main Objectives - Finalize the configuration of plugins and extensions. - Create an intuitive and visually appealing user interface. - Ensure mobile compatibility (mobile-first design). 2. Deliverab...

I need assistance with a data scraping project focused on Facebook profiles from the Netherlands. Requirements: - Simply the name and profile link of each individual. - No specific criteria for the data points. The project is open to all profiles. - A small sample of the data before the full scrape is not necessary, I am fine with receiving the full dataset directly. Ideal skills for this job: - Proficiency in data scraping techniques and tools. - Familiarity with Facebook's data privacy policies and ethical standards. - Ability to deliver clean, organized data in a timely manner.

I'm looking for a skilled data extractor who can help me collect information about brokers, consultants, and agents from the SquareYards website. Key Details: - The data should be compiled into a CSV file. - The website is publicly accessible, so no login credentials are needed. - Ideally, you have experience with web scraping and data processing. Your task will be to systematically extract the relevant information and deliver it in the specified format. Please provide examples of similar projects you've completed in your bid.

I need a Python script that scrapes articles from the CoinMarketCap community section (https://coinmarketcap...section (), with dates being configurable. Key Requirements: - Store scraped data in the filesystem - Store metadata as JSON and content as text - Extract all possible metadata from the articles, with a focus on Author name, Published date, and Tags/categories - Ensure articles are not scraped more than once if the script is run again - Ensure the script isn't aggressive enough to warrant a blacklist from coinmarketcap servers Ideal Skills: - Proficient in Python - Experience with web scraping - Knowledge of CoinMarketCap and its community section is a plus - Familiarity with data storage in JSON and text format

I need a selenium-style program that extracts data from regarding past odds from Bet365, Unibet, and Betway. The data must be formatted in XML before I convert it into an Excel file. Data Requirements: - Odds history - Match results - Betting trends Sports: - Football Ideal Skills and Experience: - Proficiency in Python and Selenium - Previous experience in web scraping, particularly from betting sites - Familiarity with XML formatting - Understanding of football betting data. Please note, I can manually download the necessary pages. Your task is to write a program that automates the data extraction process.

I'm seeking a skilled web developer to execute bug fixes and implement quality improvements on my website, salesmonk.ai. The primary focus will be on user interface enhancements. Here is the detailed list of required changes: Key areas of improvement: - Buttons and icons - Headings - Text sizes, font, color The main objective for enhancing these UI elements is to improve their aesthetic appeal. Therefore, a keen eye for design and experience in UI/UX would be highly beneficial for this project. Skills and experience needed: - Proficiency in web development tool: Framer. - Prior experience in UI/UX design - Ability to identify and fix bugs - Strong attention to detail - Ability to work independently and meet deadlines. - Would be great if you do graphic designing gas well (Figma).

...the scraper to filter data by brandname - Implementing a function that allows the scrape to resume from the last point - Adding an option for image download: yes or no Post these updates, I need my current Python scrapers to be either fully transformed or seamlessly incorporated into Winautomation. My objective is to have all scrapers consolidated within a single platform. The data I typically scrape includes: - Brand, SKU, price - Text data (HTML, descriptions, name, tags, etc.) - Image-URL - Download image: yes/no, etc. As part of the scraping process, I need to log in to the supplier sites in order to access the correct pricing. Ideal candidates will have: - Extensive experience with Winautomation - Proficiency in Python - Previous experience with web...

I'm seeking a professional email scraper who can help me collect email addresses from specific social media platforms, particularly Facebook and Instagram. The goal is to gather emails from accounts related to a particular band. Ideal Skills: - Proficient in data scraping techniques - Familiar with social media platforms, especially Facebook and Instagram - Experience in identifying and extracting relevant data from social media - Knowledge of ethical and legal considerations in data scraping Please note that it's crucial to respect the privacy of individuals and adhere to the terms of service of the respective platforms.

I am looking for a seasoned professional with extensive experience in Winautomation and Power Automate. The project involves updating and refining my existing web scraper, with a specific focus on a supplier's website. This includes: * Implementing a brand name-based scraping filter * Adding functionality to resume scraping from the last point * Including an option to download images or not Additionally, I require the conversion of existing Python scrapers to Winautomation. The goal is to unify all my scrapers within the same software program for streamlined operations. I primarily scrape supplier sites for various product details including but not limited to: Brand, SKU, price, HTML descriptions, tags, image URLs, and whether to download the corresponding images. Pl...

I'm in need of a professional data scraper who can extract text content and images from a specific website and save it into a CSV file. This is a one-time project with no need for data processing or cleaning before saving. Ideal Skills: - Web scraping - Data extraction - CSV formatting - Image handling Please note, I require the raw data to be saved without any modifications. please save; URL LINKS and all item information into columns / tabs in a csv excel file, or google spreadsheets file. we are scraping from here; in Japanese. CARDLIST｜ONE PIECEカードゲーム公式サイト｜ワンピース

Need to implement 4 motorized faders using Atmega 328P to existing esp32 project. I'm looking for a professional skilled in embedded systems and motor controls. The task is to implement 4 motorized faders in an existing ESP32 project, using an Atmega 328P microcontroller. Key Requirements: - The motorized faders will primarily be used for audio mixing, so previous experience with audio-related projects could be beneficial. - The faders need to be synchronized with software, so proficiency in software integration is necessary. Ideal Skills: - Extensive knowledge of Atmega 328P and ESP32 - Experience with motorized faders - Proficiency in software integration - Background in audio mixing hardware would be a plus.

...a custom tool to assist with business origination. The tool should enable efficient data scraping from True Local Australia () and include features for data collection. Key Requirements 1. User Inputs in Python: - Industry/Business type. - Location (e.g., New South Wales). 2. Functionality: - Automate input of specified criteria into (). - Scrape business information from multiple result pages, including: - Business name, location, website, phone number, and email address. - Click into each result to capture additional details: - Business description - Year established. - Number of staff. - ABN and ACN (if available). 3. Output: - Save scraped data into Excel/CSV format. 4. Advanced Capabilities: - Handle scenarios where information

We are looking for a Python Developer with strong experience in Django and web scraping to help build and enhance chatbot applications. You will develop backend services, integrate web scraping tools, and manage data to improve chatbot functionality. Responsibilities: Develop and maintain backend services using Python and Django. Implement web scraping techniques to gather data from external websites. Integrate scraped data into chatbot systems for improved responses. Work with databases (SQL/NoSQL) and APIs to support chatbot features. Collaborate with frontend developers to ensure smooth integration. Requirements: Strong experience with Python, Django, and web scraping tools like BeautifulSoup or Scrapy. Familiarity with database...

My project involves extracting specific CAD data using a LISP routine in ZWCAD. The data to be extracted primarily consists of attribute data from 2D drawings, 3D models, and BIM data. Key Responsibilities: - Use LISP to extract attribute data from CAD files - Work with 2D drawings, 3D models, and BIM data Ideal Skills: - Proficiency in ZWCAD - Experience with LISP programming for CAD data extraction - Ability to work with various CAD data types Please provide examples of similar past projects when bidding.

I'm seeking a skill...individually. Tasks to be Automated: - Data Processing: Handling and analyzing numeric data efficiently. - Web Scraping: Gathering necessary information from the web. - Report Generation: Creating insightful reports based on processed data. Typical Data: - Primarily numeric data, so experience with handling and analyzing numeric data is crucial. Data Sources: - Primarily sourced from emails, web pages, and documents. Ideal Skills and Experience: - Proficiency in Python with a strong portfolio of automation scripts. - Experience with data processing and web scraping. - Ability to generate comprehensive reports. - Familiarity with extracting and processing data from emails, web pages...

...of collecting property tax delinquent data from public property records. The solution will allow for filtering and sorting between different property types (houses and land) and should extract specific property-related information including owner names, addresses, APN (Assessor’s Parcel Number), delinquency status, county details, lot size, assessed value, and market value. The ideal candidate should have experience building web scrapers, APIs, or data collection tools, with strong programming skills and a focus on extracting and organizing real estate data efficiently. Test Target Area: Iredell County, NC (would like to make this National over time) Key Responsibilities: Develop a software tool/web scraper/app that extracts property tax delinquent data...

...Shopify. Advanced knowledge of Excel (CSV database manipulation). Familiarity with Python for data extraction and processing. Project Description --------------------------- We are seeking a freelancer to automate the process of updating our Shopify inventory. This project involves adding approximately 8,000 new products from a supplier while ensuring compatibility with the existing catalog of 7,000 products already on our platform. The supplier’s inventory data is provided in an Excel file and must be adjusted to match our current Shopify format. Tasks to Complete Data Structure and Formatting: ------------------------------------------ Align the supplier's data to match the format of existing product listings. E...

I'm seeking a professional with expertise in malware detection and classification to leverage the MalConv architecture for my project. The primary objective is to classify known malware types using a publicly available malware dataset. Key requirements: - Proficiency in machine learning and specifically in the application of the MalConv architecture for malware classification. - Experience with publicly available malware datasets. - Ability to deliver a robust and efficient classification model. Please note that the specific types of malware to be classified have not yet been determined, so flexibility and a broad understanding of different malware types will be beneficial.