Data Extraction Web Scraping Data Miningpráce
In order to understand the real estate market in a specific city (Praha) in a small European country (Czech Republic), I woul...~5000 listings of apartments for rent, and ~7000 listings of apartments to buy. Goal is to scrape all the listings including its details, categorized correctly in Excel, to enable comparison of apartments by their size, condition, location within the city, etc. The website is in Czech language and I will happily translate anything you need. It is a one-time scraping, but please consider also the option of continuous scraping. The web scraping could potentially be expanded to other cities (within the same real estate website) Apartments to buy: Apartments to rent:
I'm in need of a web scraping professional adept in Python and familiar with tools like Scrapy, BeautifulSoup, Requests, Selenium, or Playwright. The job involves extracting real estate agent data from Realtor.com. Key responsibilities will include: - Scraping agent names and contact information from the site. - Successfully navigating and handling dynamic content. - Implementing measures to circumvent potential anti-scraping protocols. The extracted data should be delivered in a CSV file. This project is a one-off task, and I don't require ongoing updates or data scraping. Ideal skills and experience for the job include: - Extensive knowledge and practical experience in web scraping. - Proficiency in Pytho...
I'm seeking a proficient data scraper who can collect personal identification information from County Sites. The task involves extracting full names, addresses, and phone numbers, then cross-referencing this data with to find clients' contact and property information. The final data should be delivered in a neatly organized CSV file. Ideal Skills: - Experience with web scraping tools and techniques - Familiarity with - Proficiency in data organization and analysis - Attention to detail to ensure accurate data collection and cross-referencing
I'm seeking assistance with web scraping for daily job openings in the technical field, specifically for Software Developer roles. The ideal freelancer will help me send my resume to these positions and get me interview calls for both national and international opportunities. Key Responsibilities: - Daily web scraping for Software Developer job openings - Assisting with sending my resume to these positions - Facilitating discussions before meetings - Aiming to get interview calls Skills Required: - Proficiency in web scraping - Experience in the technical job market - Good communication skills - Understanding of Software Developer roles
I'm looking for a Python expert who can help me scrape data from a specific website and store it efficiently. Ideal Skills: - Proficient in Python - Experienced in web scraping - Knowledgeable in data storage solutions - Familiar with various website structures and data formats Please note, the precise type of data to be scraped has yet to be determined. This could potentially include text, images, or numerical data. Therefore, flexibility and a keen eye for relevant information will be crucial.
I am looking to have an advanced form set up on my website built on crazydomains. The form must be able to extract data and then automatically propagate/fill out other forms. For reference, the form set up would be something like this process: :hl:psr1_2112:startn: The online website form will propagate the data into is the 9 page pdf "Application form 2024". If you can do this, the workflow on the specifics will be provided as not all data is required to be set up for extraction and propagation.
want to build a automated setup that on google app script fetch data / download csv file from website and save to google directly to google drive folder
I'm looking for a C# developer to create a small application. This application will use the spaCy NLP library (or any other library that fits the requirements) for data extraction and parsing from simple user-input sentences. Key Requirements: - The app should extract machine names, components, and point numbers from user-input sentences. - It should handle three scenarios: Create a machine, Delete a machine, and Duplicate a Machine. - The application needs to be built on Visual Studio 2019 or 2022 and should run without any external API usage or dependencies. Everything should be embedded within the app, allowing it to run just by copying the Debug folder. - A simple graphical user interface (GUI) is required for the application. (Very simple, Mockup provided) - The co...
I'm looking for a fast Waze scraper that covers all of Australia. The scraper should not rely on Georss. It needs to collect data on traffic incidents and submit it to a provided API endpoint in real-time. Ideal Skills: - Data scraping - API integration - Python or similar programming language expertise Experience: - Previous work with Waze data is a plus - Demonstrated ability to build real-time data scrapers - Experience with large scale data collection
I'm running a furniture store on Shopify and need assistance with parsing data from my vendor's webpage. The main focus is to keep track of the inventory status. Key Requirements: - Monitor inventory status from vendor's webpage - Integrate this data directly into my Shopify store's database Skills and Experience: - Proficiency with Shopify platform - Experience in web scraping and data parsing - Knowledge of database management and integration This project is crucial to ensure my store is always up-to-date with the vendor's inventory. Looking forward to your proposals. The inventory data should be updated daily.
...process by: Fetching company data (milestones, benchmarks, achievements) to personalize emails dynamically. Integrating FluentCRM to automate email sending and tracking. Project Scope: 1. Automate Company Research & Data Extraction Use APIs (Google Custom Search, LinkedIn, Crunchbase, Clearbit, etc.) to pull relevant company insights. Extract key milestones, funding rounds, partnerships, product launches, and notable achievements. Format extracted data cleanly (JSON or text) to inject into AI-generated emails. 2. Enhance AI Email Generation in Flowise Ensure company insights are seamlessly integrated into OpenAI-generated email prompts. Optimize prompt structure for concise, personalized, and compelling messaging. Implement quality filtering to prevent i...
...are looking for an experienced freelancer or team to extract data from a large volume of PDF files. Due to the scale of this task, we prefer candidates who can develop automated scripts for efficient data extraction or those with a team capable of handling bulk processing. Requirements: • Expertise in Python or other relevant programming languages for PDF parsing • Experience with libraries such as PyPDF2, PDFMiner, or similar tools • Ability to extract structured data accurately (tables, text, etc.) • Handling of different PDF formats and layouts • Data output must be in Excel (.xlsx) format per template provided. Preferred Qualifications: • Prior experience with large-scale data extraction • Strong a...
I'm in need of a proficient data scraper who can extract the staff list from a specified university website. The data fields I require are: - Name - Email - Phone number - Department - Designation The scraped data needs to be delivered in CSV format. This is a one-time project, so I won't need recurring updates. Ideal skills and experience include: - Proficiency in data scraping tools and software - Experience with web scraping from .edu websites - Strong attention to detail for data accuracy - Ability to deliver data in specified format (CSV) Looking forward to your proposals.
I'm looking for a skilled developer to create a Windows application that scrapes data from e-commerce websites and updates it in a CSV file. Key Responsibilities: - The app should monitor and record product prices, stock levels, and sale prices. - Data should be sourced from various e-commerce websites. - Updated data should be formatted and saved in a CSV file. Ideal Skills: - Proficiency in Windows application development. - Experience with web scraping tools and techniques. - Familiarity with data formatting and file handling, particularly CSV files.
I'm seeking a web scraping and automation expert who can help me collect product details and pricing information from Amazon on a daily basis. Key Responsibilities: - Scrape product details and pricing information from Amazon. - Automate the process for daily hourly base data collection. Purpose of Data: - The scraped data will be used for market analysis and Price Competition. Ideal Skills: - Proficiency in web scraping tools and programming languages (e.g., PHP, C#, Javascript). - Experience with Amazon data collection. - Knowledge in data analysis and market research. - Automation skills to streamline the daily scraping process. - Bypass Captcha ... Please provide examples of similar projects you have compl...
...their children (ensuring sequential order). ✅ Multi-label classification must maintain parent-child dependencies. ✅ Deploy the trained model for inference on raw .txt inputs. ? Current Work Done & Repository Details We have a fully structured hierarchical classification system, available at: ? GitHub Repository: Hierarchy Trainer ? What’s Already Implemented? ✔ Structured hierarchical label extraction from raw .txt files ✔ Bidirectional sibling relationships within the hierarchy ✔ Graph-based hierarchical representation of classification results ✔ GUI for training, testing, and visualization ✔ CUDA support for GPU acceleration ✔ Standardized _Val labels tracking numerical values ? What Needs to Be Done? ? Extend the current system to support _Val normalization (predi...
I'm looking for an expert in web scraping to gather comprehensive data from and zoopla on properties that meet specific criteria. The data collection should include: - Property Details: Price, Location, Bedroom count, Rental Yield, BMV (Below Market Value), proximity to a station (within 2 miles), and Serviced Accommodation Rates. - Filters: Properties should be filtered based on a specific price range, their proximity to a station, and the number of bedrooms. - Add the type of property (e.g., apartment, house, townhouse) to distinguish different kinds of listings. Ideal candidates for this project should have vast experience in web scraping, preferably with real estate websites, and should be able to deliver a well-structured data s...
We are looking to create a database of contacts from four specific websites. We require as much information from each person in the database of these websites as they have publicly displayed. Data can be scraped and provided by excel or csv spreadsheets. This website is broken down by states across the United States. You have to click on each state to see all of the members in that state, and then open each profile individually. Under each country or state, you have to pen each company profile. We only care about contact information (phone, email, website, name, etc.). We don't care about listings. Here we can just collect the website information from each of the members. If possible
...trading system for me. This system should monitor live stock exchange data and take decisions based on some rules defined by me. Subsequently will place buy or sell orders for me. There is NO API integration possibility! Key Features - Monitor live data and odds via web scraping methods. - Detect changes in real-time and take decisions. - Automate order placement based on rules. Order Placement Mechanics - One single click prepares an order with the correct amount. - A second click places the order instantly. The system should run on a cloud VPS for optimal speed and performance. Ideal Skills and Experience - Proficiency in Python, specifically with libraries such as Selenium, BeautifulSoup, and Requests for scraping and autom...
I'm seeking a programmer skilled in utilizing Sheetmajic AI for web scraping in Google Sheets. The purpose of this project is to scrape daily data from our local municipality page. The specifics of this project include: - Data Source: The local municipality page. - Data Type: Event schedules. Ideal candidates for this job should have: - Proven experience with web scraping. - Proficiency in Google Sheets and Sheetmajic AI. - Ability to deliver accurate and timely data.
I'm looking for a script that can import both automatically and manually products from Aosom to my Opencart store. Key Requirements: - The script...product imports from Aosom to my Opencart store. - Essential product details to be imported include: Product description, Product images, Product prices, Category, SKU, Weight, Dimensions, Color, Material, Age, Meta Description, Meta Title. - The script should transfer any tags associated with the products. Ideal Skills: - Proficiency in Opencart and its architecture is a must. - Experience with web scraping or automation scripts. - Knowledge of Aosom's product structure. - Ability to ensure the script can handle product variations and updates seamlessly. Please ensure your bid reflects your experience and understan...
...pull data from multiple sources, including different projects, documents, cloud storage services (Dropbox, S3), URLs, and media content (YouTube videos). The agent will process, clean, and store the extracted data for further analysis, search, and retrieval. 2. Objectives Develop an AI-driven system to aggregate data from various sources. Enable automated extraction, transformation, and loading (ETL) processes. Ensure seamless integration with cloud storage, document repositories, and media platforms. Implement Natural Language Processing (NLP) for document comprehension and YouTube transcription. Provide an API interface for querying and accessing the processed data. Support integration with various Large Language Models (LLMs), allowing flexib...
I'm looking for a skilled professional who can help me scrap a static site and migrate it to WordPress. The site primarily consists of blog posts, and new content is added on a monthly basis. - Ideal skills for this project: Web scraping, WordPress development, Data migration, PHP, HTML, CSS. - Experience: Previous projects involving static site migration to WordPress will be highly regarded. Please note: This project does not require the addition of any specific features to the WordPress site.
I need a Telegram scraper that will collect user data from specific groups on Telegram. This data will be used to create a contact list. Key Responsibilities: - Scraping data from members of designated Telegram groups - Compiling this data into a usable contact list Ideal Skills: - Proficient in data scraping - Experienced with Telegram's platform - Able to respect privacy and ethical guidelines in data collection
I'm looking fo...students to access college details, class schedules, and receive live notifications from a website. Here are the key aspects of the project: - The chatbot will primarily interact with a website. - It should provide information on admission requirements, course descriptions, and faculty information. - Live notifications should be sent via SMS. - We will use gemini LLM in back end for query - Web scraping a whole website I need the back end and Vector database Embedding I have a basic understanding of the tech stack, so please keep the explanations simple. We will approach this project through video calls where I will learn in real-time. Ideal skills for this project include chatbot development, familiarity with the mentioned tech stack, and excellent...
I'm in need of a professional data miner to extract textual content (specifically information ) from a single website. The data should be formatted in a specific way in MS Excel, as per the template provided in the attachment. Key Requirements: - Timely delivery of the project - Adherence to the provided data format - Expertise in data mining and Excel Please ensure to review the attached format before bidding. The project must be completed within 1 week.
I'm in urgent need of an experienced professional with a PRO Apollo IO membership to assist me in data extraction. Project specifics: - I will provide 20 SIC Codes and need you to extract around 200-300 data points per code. - The data should be compiled into an Excel file. - Key details to be extracted include: Company name and address, Contact person and email, Phone number and company size. - The focus of the data extraction is primarily within the Healthcare sector. Ideal candidates should possess: - A valid PRO Apollo IO membership. - Prior experience in data extraction. - Proficiency in Excel. - Excellent attention to detail and ability to follow instructions accurately. - Strong communication skills for effective unders...
I'm looking to have the past 10 years of JEE and NEET exam questions converted from PDF into a structured JSON format. Key Requirements: - Conversion of all content: questions, answers, exp...exam questions converted from PDF into a structured JSON format. Key Requirements: - Conversion of all content: questions, answers, explanations, and metadata (e.g., year, subject) - Handling of occasional images or diagrams within the JSON Ideal Skills and Experience: - Proficiency in data conversion and structuring, particularly into JSON - Experience with PDF data extraction - Attention to detail to ensure all elements are accurately converted and structured - Ability to handle and appropriately format data from images and diagrams Please provide examples of sim...
I need a Windows desktop application that can automatically book travel tickets from a public travel website like Expedia. The app should interface with a specific embassy website to perform these bookings. This app will save a lot of time and effort, and it should be user-friendly...and effort, and it should be user-friendly and efficient. Ideal skills for this project include: - Strong experience with Windows desktop app development - Proficiency in interfacing with public websites and APIs - Knowledge of travel booking systems - Expertise in creating user-friendly interfaces - Experience with automation scripting - Skilled in web scraping techniques for extracting data - Proficiency in ensuring API security and data integrity The application should provi...
I need a professional who can extract and compile the dimensions of all the girders from my Tekla Structures model of a Foot over Bridge. The necessary deta...compile the dimensions of all the girders from my Tekla Structures model of a Foot over Bridge. The necessary details include the length, width, and height of each girder, as well as its material type. The final output should be an Excel spreadsheet containing these details for every girder in the model. Ideal skills and experience for the job: - Proficiency in Tekla Structures - Excellent data extraction and organization abilities - Proficient in creating and managing Excel spreadsheets - Understanding of civil engineering concepts related to bridge construction - Strong knowledge of structural steel components and...
...Phase 1: Data Processing - Data Extraction: Extract data from the OS Ticket system DB type: MYSQL). - Data Cleaning: Remove duplicates, irrelevant entries, and inconsistencies. - Data Transformation: Prepare data for AI processing. 2. Phase 2: Knowledge Article Generation - Text Analysis: Use NLP models to analyze ticket content. - Ticket Categorization: Group tickets by topics or issues. - Article Creation: Automatically generate structured knowledge articles from categorized tickets. 3. Phase 3: Knowledge Base Organization - System Design: Define structure and taxonomy for the knowledge base. - Integration: Store articles in a searchable and intuitive format. - Access Control: Implement user roles and permissions for the knowledge base....
I'm in need of a skilled data engineer to develop an automation scraper for me. The primary source for this project will be various websites, with the specific task of extracting the raw response from the API endpoint network response in JSON format. Key Requirements: - Development of a real-time data scraping tool - Experience and proficiency with web scraping - Ability to extract and process API network responses - Knowledge of working with JSON data - Familiarity with using Datadoom for data protection The ideal candidate for this project should have a strong background in data engineering, web scraping, and API interaction. If you are capable of creating a scraper that works in real-time and can handle the com...
...importing using excel or CSV or, if you're a true expert: you may even use XML. You will need to maintain these files. If we find out that an attribute was not defined, we want to make sure it will be easy for you to add the attribute and reimport the products adequately. Note: in some cases, product assets/attributes are contained in 3 files: PIES - ACES - Digital asset. You may need to merge that data to succesfully import a brand of products. - You will need develop a comprehensive understanding of our product. We will be there to support you; we understand that our products are not your typical t-shirt. - Import and/or Create products on our Magento 2 website, including configurable products and other types of special products. - Manage and maintain products in Quic...
I need the famous well known mining pool site software installation to my Ubuntu server and do every needed steps including webUi and node installation too to make my new single algo & single coin called Anuma from Kheavyhash algo mining pool Site. It will be the Xenom version which supports Kaspa which is smillar to Anuma coin Please do not bid if you are not smilliar with the above details!
... - MySQL - Python (FastAPI & Web Scraping) - Azure - Chrome extension development - Amazon SP-API - Shopify app development Key Responsibilities: - Design, develop, and maintain complex web applications using for server-side rendering and static site generation. - Architect database solutions using MySQL, ensuring performance, scalability, and data integrity. - Develop robust backend services and APIs using Python and FastAPI for high-performance API development. - Build and maintain Python scrapers to automate data extraction from various sources. - Design and implement Chrome extensions to enhance web functionalities. - Integrate with the Amazon Selling Partner API (SP-API) for e-commerce automation and...
I need a web crawler that can help me find local service providers in certain suburbs in Brisbane Australia. The crawler should be able to traverse the web and gather information on various service providers such as name, web address, email, phone number, contact name. The businesses i want to scrape are providers in: - Yoga - Physiotherapy - Personal Training - Chiropractor An example of the regions are Redcliffe, Kippa-Ring and Clontaf in Brisbane. Ideal Skills: - Proficiency in web crawling and data scraping. - Experience with Apify or similar web crawling platforms. - Ability to understand and implement data filtering based on potential future criteria.
...generate descriptive captions for images. This project uses convolutional neural networks (CNNs) for image feature extraction and recurrent neural networks (RNNs) to generate captions. Implementing this project will demonstrate your ability to work with complex neural network architectures and handle multimodal data. 3)Building a multi-step AI agent involves creating a system that can perform a series of tasks autonomously. Using frameworks like LangChain, you can develop AI agents that can handle complex workflows. In this project, you will create an AI application that takes a user’s query to search the web using the Tavily API and also generates Python code to use the data. The application will then use Python REPL to execute the code and return the...
...for an expert in UiPath studio who can help automate the application process for multiple grants and funding opportunities available online for my startup. Key Tasks: - Automate filling of every new funding application form with the data of my startup - Use UiPath studio on Windows (or any other such tool) - Take as inputs: my startup info and link of the application form - Utilize ChatGPT API to answer questions not covered in my startup info What I will provide: - Information about my startup: company description and history; employee and team details - Web URLs of application forms Please note that the application forms we will be targeting include both grants and funding opportunities. The ideal candidate should have experience with UiPath, knowledge of automation ...
I need an Excel spreadsheet generated from my access machine which includes user details, sorted by department. Details to be included: - Name - Department - The ideal freelancer for this task should have: - Proficiency in Excel - Experience with data extraction from access control systems - Ability to sort and organize data effectively Please ensure the final output is user-friendly and ready for printing.
I'm looking for a Python developer to create an application for analyzing multiple medical reports. The app should: - Have a login page for secure access. - Allow me to upload PDF me...create an application for analyzing multiple medical reports. The app should: - Have a login page for secure access. - Allow me to upload PDF medical reports. - Analyze the reports to predict the stage of hepatitis. - Utilize both text extraction and image analysis in the data processing. - Present the output in an HTML table on the webpage. Ideal candidates should have experience in: - Python development. - Data analysis, particularly in the medical field. - Creating secure, user-friendly applications. Please note, the application needs to take required data from all the u...
...Enterprises pvt ltd. Location: Libya (Preferably Tripoli) Industry: Air Pollution Control / Dust Collection Systems / Fume Extraction Systems Website: About Us: Techflow is a leading provider of air pollution control solutions, specializing in dust collection systems, fume extraction systems, and industrial air filtration technologies. Our systems are used across various industries to ensure environmental compliance and workplace safety. Project Overview: We are looking for a freelance After-Sales & Service Representative in Libya, preferably based in Tripoli, who can assist with erection, installation, and maintenance of our dust collector and fume extraction systems. The ideal candidate should have experience in the mechanical, electrical, and civil aspects...
I'm in need of a freelancer with robust data scraping skills to compile a comprehensive list of strata managers from Sydney CBD and its surrounding areas. This list should include: - Business Name - Phone Number - Generic Company Email - Direct Contact Email (if available) Your task is to collect as many accurate and up-to-date contacts as possible. Key Skills & Experience Required: - Proven experience in data scraping. - Ability to deliver clean and well-organised data. - Prior experience in similar projects will be an advantage. Please include in your proposal a brief outline of your intended approach for this task, as well as any relevant past experience.
...price-tracking - Integrate web-scraping capabilities for real-time data - Set up and manage the back-end database - Integrate payment gateways for in-app purchases - Implement push notifications for app users - Develop comprehensive search and filter functionality - Design an intuitive and user-friendly interface - Implement user authentication and authorization mechanisms - Integrate customer support chat or ticketing system - Optimize site and app performance for faster load times - Implement SEO best practices for better search engine ranking - Incorporate analytics tools to monitor user behavior Ideal Candidate: - Proficient in coding for both websites and mobile applications - Experienced in E-commerce site and app development - Knowledgeable in web ...
...professional Python developer with extensive experience in web scraping using Scrapy, data manipulation via MongoDB Aggregation Pipeline, JavaScript, and API development. The project encompasses all aspects of data extraction, processing, and integrating different technologies. Key Responsibilities: - Web scraping with Scrapy to extract data from various websites - Manipulating and processing the extracted data using MongoDB Aggregation Pipeline - Developing APIs by using FastAPI and Django for seamless integration of different technologies - Utilizing JavaScript where necessary for backend and frontend Ideal Skills and Experience: - Proficiency in Python, Scrapy, MongoDB, and JavaScript, Django, FastAPI - Extensive exper...
...comprehensive data from various platforms including e-commerce websites, business directories, and social media profiles. The data should pertain to local businesses in specific regions, and only one specific industry. The data can be scrapped from catagories in a business directory but then Linked In will need to be scraped to find correct contact person. Data Needed: - Business Name - Type of Business - Contact Email - Contact Phone - Contact Person - Physical Address (divided into Street Number, Street Name, Town or City, State or County, Zip or Postal Code, Country) Regions to Target: - USA - Canada - UK - Australia - New Zealand The data should be neatly organized and delivered in a CSV Spreadsheet. Ideal Skills: - Proficient in data ...
...phone or computer. AI should be able to receive text-based or voice commands, execute tasks on my laptop, and provide updates. The system should respond intelligently, suggest solutions, and provide feedback on ongoing tasks. Multilingual communication (Albanian, English, and others). 4. Self-Learning & Autonomous Growth The AI must create accounts on websites where necessary for learning and data extraction. Must be capable of downloading and processing eBooks, research papers, and hacking documentation. Should experiment with creating AI models, developing software, and improving itself through recursive learning. 5. AI-Powered Software & Business Creation The AI should be capable of designing and launching websites, applications, and business models as request...
...Saturday at my home in Santiago." Bot: "Here’s a summary. Does everything look good?" Client: "Yes, it’s perfect!" Bot: "Great! I’ll notify the specialist now." The specialist receives the request and reviews the details. Specialist: "I need a few more details before confirming the price. What’s the current wall condition? Any old paint that needs removal?" Client: "Yes, some areas need scraping." The specialist finalizes the quote. Scene 5: Payment & Final Steps (1:46 - 2:30) Visuals: The client receives the price, accepts, and makes an initial payment. Text on screen: Bot: "The specialist has sent their quote: $200,000 CLP. Do you accept?" Client: "Yes." Bot: &quo...
Necesito extraccion de datos de algunas webs con el objetivo de obtener leads para gestion de marketing
