Web scraping usingtrabajos

...looking for an experienced developer to create a system that uses an existing API (already developed and tested) built on Apify to scrape real estate ads from and store them in a MySQL database. The project involves the following main components: 1. API Integration: The API has been custom-built for scraping real estate data from immobiliare.it. I will provide the specific search URLs (e.g., Example URL) that serve as input for the scraping. The system should automate scraping daily, ideally in the morning, to ensure consistent data collection. 2. MySQL Database Setup: The scraped data must be stored in a MySQL database hosted on a server I will provide (possibly on a low-cost service like Aruba, but I am open to recommendations). Key requirements:Add only new ads ...

I'm looking for a Python expert to help me with script automation. The specific tasks, deployment location, and input data will be discussed in detail with the selected freelancer. Ideal Skills: - Proficiency in Python - Experience with script automation - Strong problem-solving skills Experience with the following is a plus: - Data scraping - File processing - Web interactions

I'm seeking an experienced developer who can create a web application that integrates the Alpaca/Yahoo Finance APIs for live market data with ChatGPT. The system should deliver actionable trading insights in real time, primarily targeting the U.S. penny stock market. Key Features: - Generating buy/sell signals - Conducting market trend analysis - Providing risk management tips - Analyzing chart images based on specific strategies - Utilizing VWAP and trading volume - Assessing support and resistance levels and historical prices - Interpreting Level 2 data and Time and Sales Ideal Skills: - Proficiency in API integration, especially Alpaca and Yahoo Finance - Expertise in developing web applications - Experience with trading systems and market analysis - Familiarity wit...

Autonomous Snow Removal Robot Path Planning Using NVIDIA Jetson Nano and Unitree LiDAR Project Overview: We are seeking an experienced developer with expertise in edge computing, robotics, and LiDAR data processing to develop a path-planning solution for an autonomous snow removal robot. This robot is designed to clear snow from sidewalks, driveways, and large open areas such as office building premises and mall parking lots. You will have access to the lidar remotely during development. I need a software program that does the functions I described. Key Objectives: Hardware Integration: Utilize the NVIDIA Jetson Nano edge compute module for efficient processing. Process real-time point cloud data from the Unitree LiDAR sensor. LiDAR Data Processing: Step 0: Conne...

I'm seeking an experienced data scraper to collect soccer betting odds and data for various leagues over th...Leagues: Premier League, La Liga, Serie A and 5-6 additional leagues of my choosing. - Excel interface: I need a user-friendly interface to easily add other leagues in the future. - Data updates: The system should be designed for manual updates. - Data points: Specify the source for closing odds (e.g., 2 x major bookmakers). Ideal Skills: - Extensive experience with Oddsportal. - Proficiency in data scraping and Excel. - Previous examples of similar projects to demonstrate capability. Please provide a time and cost estimate for this project, as well as examples of similar jobs you've completed. I look forward to your response. Regards, Gordon. Please include Bun...

I'm looking for a skilled and experienced web scraper to extract data from the Steam Market on a daily basis. Data to be collected includes: 1) Gun Name (e.g., AK-47) 2) Gun Exterior (e.g., Factory New) 3) Lowest Buy Now Price 4) Highest Buy Order Price 5) Category The data needs to be compiled into a CSV file, with specific examples such as "Ak-47 (all skins) with exterior factory new and should have point no 3, 4 and 5 included. Ideal Skills and Experience: - Proficiency in web scraping software and tools - Experience with data analysis and CSV file creation - Familiarity with the Steam Market is a plus - Ability to deliver data daily in a timely manner

I run a community radio station and need a script that can retrieve the temperature from my local airport. The script should create an audio file that says "The current temperature at the KWOT studio is ## degrees." Key Requirements: - Utilize web scraping techniques to fetch temperature data from a specified website. - Create an audio file using a male voice. - The audio file should state the current temperature at the KWOT studio. Ideal Skills and Experience: - Proficient in Python or similar programming languages for web scraping. - Experience with text-to-speech (TTS) software or libraries. - Ability to understand and work with website text data. - Prior experience with radio station projects is a plus. The script should update the tempe...

... What I need is a bot or system that can monitor and read the pricing data from a competitor’s application in real-time. This bot should analyze the competitor’s prices and dynamically adjust the pricing in my app to ensure competitiveness. Additional Information: 1. Existing Dashboard: My dashboard already allows for manual price adjustments. We can store the data collected by the bot (scraping tool) in any file format, where the AUTOMA software will automatically take it and populate a specific field in the dashboard. For example, this field could be the "Time Fare (per min):", or any other field I designate. 2. Proposed Tools for Implementation: - Appium: To automate and simulate user interactions in the competitor’s mobile apps, allowing ...

Por favor, regístrate o inicia sesión para ver los detalles.

I need a PHP-based web scraper that can fetch vehicle details from RTO sources. The fetched data should be returned in a JSON format. Refer: Response Required Formate: {"rc_regn_no":"TN54AB4870","rc_rto_code":"TN-54","rc_regn_dt":"18-Sep-2024","rc_owner_sr":"1","rc_registered_at":"SALEM (EAST) RTO","rc_fit_upto":"17-Sep-2039","rc_tax_upto":"--","rc_status_as_on":"29-Oct-2024","rc_financer":"SHRIRAM FINANCE LTD","rc_insurance_comp":"Reliance General Insurance Co. Ltd.","rc_insurance_policy_no":"120722423750008424","rc_insurance_upto":"16-Sep-2029...

I'm in need of a specialist who can assist with authentication, API usage, and data extraction from websites. The primary requirement is to extract text data from the web. This data will be stored in an SQL database. Ideal skills and experience for the job include: - Expertise in web scraping and data extraction - Familiarity with SQL databases - Proficiency in using APIs - Experience with authentication processes - Strong understanding of handling text data Please reach out if you have the necessary skills and experience to fulfill this project.

scraping of live video and scores of casino game

I'm looking for a skilled data enginee...- Wear - Float Number - Special - Highest buy order - High Buy now Price All of this data should be structured into a single sheet with a standard row and column format. Ideal skills and experience for the job: - Proficient in data scraping and Google Sheets - Familiarity with is a plus - Experience in structuring and formatting data - Able to deliver data accurately and on time on a daily basis. The fetching should be scheduled every morning. The data will be fetched using web scraping or any other methods. The fetching should be managed using Google Apps Script. The fetched data should be updated as follows: in different Sub-sheets. "Won't hurt if it does" Please set up email notification...

I need a DELPHI 12 expert to scrape product titles and attributes from AliExpress. The program should check these against my MySQL database using Firedac. If a product title or attribute is not found, it should be added. If it is found, the existing entry should be updated. The scraping process needs to run monthly. Ideal Skills and Experience: - Proficiency in DELPHI 12 - Experience with web scraping - Familiarity with AliExpress - Knowledge of MySQL and Firedac - Ability to create a program that runs on a schedule

I need assistance in scraping 83 products from Menards and importing them into my WooCommerce store. The products are Meadow Valley Log Siding. - Comprehensive Scraping: You'll need to gather the product name, price, description, images and all variants with their unique descriptions. - WooCommerce Organization: All product variants should be organized under a main product as variations. - Potential Custom Fields: While most products will fit into standard fields, you may need to create some custom fields or attributes for certain products. Ideal candidates for this project should have prior experience in web scraping and WooCommerce. Familiarity with product import and variant organization on WooCommerce is a plus. Please ensure you have the necessary t...

I'm seeking a skilled backend developer with extensive coding and Pyt...history on a daily basis. Key Requirements: - Extracting specific data points: order details, shipping information and payment summary. - Building the backend application in Python. - Ensuring the application can perform daily data scrapes. Ideal Skills: - Proficiency in Python, with a strong understanding of its application in backend development. - Experience with Selenium or similar data scraping frameworks. - Prior work relating to e-commerce platforms, particularly Amazon, is a plus. The scraped data should be saved in JSON format. The application should perform data scrapes on a daily basis. The scraped data should follow a standard JSON format for user order history. Store the scraped data locally...

I will code for Arduino to show the arm movement and its angle using mpu6050

I'm in need of a professional to scrape 1000 corporate email addresses from public databases. The primary use for these email addresses will be for client communication. Ideal Skills and Experience: - Proficiency in web scraping - Experience with public databases - Understanding of corporate email systems - Strong attention to detail - Excellent data management skills Please provide examples of similar work you have done in the past.

...providing MS Office and data entry services for your project. With [X years] of experience in using MS Office applications and performing data entry tasks, I am confident in my ability to meet your needs efficiently and with attention to detail. Services Offered: MS Office Services: Data management and analysis using Excel (formulas, pivot tables, data sorting, and graphs) Document creation and formatting in Word (professional reports, templates, and presentations) PowerPoint presentations design and editing Excel spreadsheet automation (using macros, VBA, and custom functions) Data Entry Services: Accurate and fast data entry into various platforms (Excel, Word, Google Sheets, etc.) Web scraping and data collection Conversion of PDF to Excel or Word ...

...external market conditions. What I need is a bot or system that can monitor and read the pricing data from a competitor’s application in real-time. This bot should analyze the competitor’s prices and dynamically adjust the pricing in my app to ensure competitiveness. Additional Information: My dashboard already allows for manual price adjustments. We can store the data collected by the bot (scraping tool) in any file format, where the AUTOMA software will automatically take it and populate a specific field in the dashboard. For example, this field could be the "Time Fare (per min):", or any other field I designate. The goal is to have a system that keeps my app’s prices updated dynamically and aligned with market trends, leveraging competitor pricin...

I'm looking for an expert in TreeAge Pro and Markov modeling to convert an existing TreeAge model into a interactive independent Excel based economic model. Key Responsibilities: - Convert a TreeAge Pro model utilizing Markov modeling technique into Excel files Ideal Skills and Experience: - Proven expertise in Markov modeling and TreeAge Pro. - Strong background in healthcare analysis. - Experience modeling treatment effectiveness. - Excellent communication skills to explain complex model outputs.

I'm looking for a professional to help me collect product details from different websites. Skills and Experience: - Proficient in web scraping, API integration, and manual data collection. - Previous experience in collecting product information is preferred. - Ability to deliver accurate and comprehensive product details. Please note that I have already contacted the order taker and just need assistance with the collection process.

Breast Cancer Detection using Histopathological Images and deep learning create a project using given data set from Kaggle and run 5 methods from that and additional 2 methods that are not included in that this is the example project report template below Abstract Background Methods Results Discussion and Conclusion Do not use abbreviations or insert tables, figures or references into your abstract. Your abstract generally should not exceed about 300 words. Keywords: Artificial Intelligence; Deep learning; Convolutional Neural Networks; Transfer Learning. 1. Introduction • This section provides an overview of your project and introduces the background work to it • In this section you might wish to include reasons why you feel you are a suitable candidat...

I'm seeking an experienced Python developer with expertise in bioinformatics for a project involving phylogenetic distance analysis. The specific tasks include: - Implementing phylogenetic tree reconstruction from FASTA formatted input data - Utilizing the Neighbor-Joining method for the reconstruction process - Developing algorithms to perform sequence alignments - Optimizing the Neighbor-Joining method for efficiency Ideal candidates should have a strong background in both Python programming and phylogenetics, with prior experience working with FASTA data. A deep understanding of the Neighbor-Joining method is crucial. Please provide examples of similar projects you've completed in your proposal.

...script should capture the following data points: Open, High, Low, Close prices, Volume traded, and Market cap. - Ultimately, the data should be saved in a CSV format for easy analysis. - The script should capture the exact timestamp for each data point. - The total number of trades executed during the period should be captured. Ideal Skills: - Proficient in Python with experience in building web scraping scripts. - Familiarity with the Dexscreener API is a plus. - Experience in handling cryptocurrency data is preferred. The script should retrieve data on an hourly basis. The script should include error handling for API connection issues. Please ensure the script retrieves data from the time range of "From the launch of the token till date." The CSV file should ...

Assistance with data analysis.

Process Idea for I want application. 1. run the live game 2. open the interface for live game control with live game. 3. Cancel the game when I don't want result. 4. Roll back to all process 5. If I don't have cancel the game, continue the game. P.S Refer to attached file about some idea for interface sketch.

FIDO Python Client for Cloud Authentication using REST API for Mobile Authenticator device-bound Passkeys and Security Keys as well.

I need a professional with extensive experience in web scraping using Scrapy. The primary goal of this project is content aggregation. Ideal Skills: - Proficient in Python and Scrapy - Experience in content aggregation - Able to handle large datasets - Familiar with data cleaning and preprocessing Please note that the specific sources and types of data to be scraped have not been finalized yet. Flexibility and adaptability will be key.

...providing MS Office and data entry services for your project. With [X years] of experience in using MS Office applications and performing data entry tasks, I am confident in my ability to meet your needs efficiently and with attention to detail. Services Offered: MS Office Services: Data management and analysis using Excel (formulas, pivot tables, data sorting, and graphs) Document creation and formatting in Word (professional reports, templates, and presentations) PowerPoint presentations design and editing Excel spreadsheet automation (using macros, VBA, and custom functions) Data Entry Services: Accurate and fast data entry into various platforms (Excel, Word, Google Sheets, etc.) Web scraping and data collection Conversion of PDF to Excel or Word ...

Here's the complete overview of the Keyword Research Tool: Project Purpose: This tool is designed for SEO specialists and content managers, combining web scraping with AI-based keyword generation. It automatically analyzes websites and generates relevant keywords based on actual page content (and in most cases: The URLs have no rankings which we can use from sistrix) Main Features: Web Scraping: Extracts content from websites (meta data, main content, headings) Intelligent content detection and filtering by LLM (Claude/OpenAi), based on content of the webpage, e.g. first 1000 Characters? Caching of Keywords to avoid repeated downloads / queries Keyword Analysis: Uses OpenAI (GPT-4) or Anthropic (Claude) for keyword generation Dynamic prompt generation ...

I need a Python-based scraper that can gather information fr...marketplaces. The scraper should be capable of rotating proxies to avoid IP bans. The specific requirements are as follows: - Targeted Marketplaces: The scraper needs to collect data from LinkedIn, Indeed, and Glassdoor. - Information to be Scraped: - Job titles and descriptions - Company details - Salary information The ideal candidate should have: - Proficiency in Python and experience with web scraping. - Familiarity with the job marketplaces mentioned. - Knowledge of proxy rotation techniques to avoid detection. - Attention to detail to ensure all required data is collected accurately. The scraper should run weekly to keep the data relatively current, with a multithreaded option and a database to re...

I need a Python-based scraper that can gather information fr...marketplaces. The scraper should be capable of rotating proxies to avoid IP bans. The specific requirements are as follows: - Targeted Marketplaces: The scraper needs to collect data from LinkedIn, Indeed, and Glassdoor. - Information to be Scraped: - Job titles and descriptions - Company details - Salary information The ideal candidate should have: - Proficiency in Python and experience with web scraping. - Familiarity with the job marketplaces mentioned. - Knowledge of proxy rotation techniques to avoid detection. - Attention to detail to ensure all required data is collected accurately. The scraper should run weekly to keep the data relatively current, with a multithreaded option and a database to re...

ONLY USING ARC GIS PRO Identify suitable location for installation of solar panel on physical and environmental criteria. Data Needed: solar radiation data, land use data, elevation models, and protected areas data. Tools: Solar energy mapping tools, suitability analysis, and spatial overlay. Project Report Guidelines Introduction: Briefly describe the problem or question you are addressing. Include the significance of your study and specify the geoprocessing tools you will be using. Data Description: Detail the datasets used in your analysis, including sources, spatial resolution, and any preprocessing steps taken. Explain why these datasets are appropriate for your study. Methodology: Describe step-by-step how you applied the GIS tools and techniques to conduct you...

I'm seeking an expert in Derivative pricing, specifically with options pricing using the Monte Carlo Simulation (GBM). Key requirements: - Expertise in options pricing - Proficiency in the Monte Carlo Simulation - Ability to achieve a 95% accuracy for the simulation Your task will be to accurately price options using the Monte Carlo method, ensuring we hit the required confidence level. The ideal candidate will have a strong background in finance, data analysis, and programming (preferably in Python or R). Please include examples of similar projects you've completed in your bid.

I'm seeking a skilled web scraper to extract text data from 4 specific telecom websites on a daily basis. The goal is to gather promotional offers from these sites. Deliverables: - Daily extraction of text data from 4 websites - Compilation of this data into a CSV file Ideal Skills and Experience: - Proficiency in web scraping techniques and tools - Prior experience with data extraction from promotional websites - Ability to deliver tasks consistently on a daily basis.

I’m looking for an expert in web automation and data extraction to enhance my email campaigns using RTILA or Zerowork. The objective is to dynamically replace placeholders like {{competidor_1}} and {{competidor_2}} in my email templates with actual competitor names before sending the emails through Instantly. ### Requirements: 1. Proven experience in using **RTILA** or **Zerowork** for web scraping and data automation. 2. Familiarity with email platforms like Instantly and placeholder integration. 3. Ability to create a scalable solution that works across various campaigns and client types. 4. Knowledge of handling sensitive data and ensuring clean, professional outputs. 5. Experience in custom data extraction methods that go beyond basic ...

I have a high-resolution image that needs an ugly lamp removed from it using AI Photoshop techniques. Ideal Skills: - Proficiency in Photoshop - Experience with AI-based photo editing - Keen eye for detail to ensure background integrity

...websites, web marketplaces, or any source that suggests a lower price to products a selection of our product catalog. The system should: Either apply updates directly to the products, or have an api to connect with the magento if its a separrate app, Include a minimum and a maximum price for each specific product that no higher or lower value would be suggested Explicitly enabling a product to the repricing mechanism, products shouldnt be repriced by default Work with multiple sources/websites Able to handle around 10000 products and scale for more in the future However there are some problems to be solved Inventory / Product association with the competitor or marketplace page (manual or automatic) so it knows which product to update Data collection approach (it could either b...

I need a proficient data extractor to gather specific contact details from a website and deliver them in a CSV format. Details to Extract - Email addresses - Phone numbers - Physical addresses - Company name - Occupational therapist name - Website URLs from the contact page Ideal Skills - Web scraping - Data entry - CSV file handling Experience - Prior experience in data extraction from websites is a plus. - It's from the following website - It is a list of Occupational therapists who specialize in Home Modifications & access for all of Australia

I need a proficient data scraper who can extract and compile information from public websites into Google Sheets. Key Responsibilities: - Scrape data from various public domains on the web. - Organize and integrate the collected data into Google Sheets. Ideal Skills: - Proficiency in web scraping tools and techniques. - Experience with Google Sheets, particularly in data integration and management. - Familiarity with handling data from e-commerce sites, social media platforms, and news websites.

I'm seeking assistance in configuring an automation on Make.com. I have a couple of Google Sheets with a column of URLs that I want to scrape for email addresses and potentially the names of business owners or ...have a couple of Google Sheets with a column of URLs that I want to scrape for email addresses and potentially the names of business owners or managers. Key tasks include: - Helping me connect Google Sheets to - Setting up the built-in web scraping tools of to extract data from the URLs - Configuring the automation to insert the scraped data back into the original Google Sheets I am new to , so I would appreciate your help in configuring this automation so I can run it in my account. Ideally, you have experience in web scraping, Google Sheets a...

I'm seeking a professional Python developer with experience in phylogenetic analysis. The main task is to compute phylogenetic distances using the Euclidean distance method for a professional project. Key Requirements: - Proficient in Python with strong programming skills - Experienced in phylogenetic analysis - Ability to work with CSV files Please note, the input data is currently in CSV format. The successful candidate will have the opportunity to contribute to a research publication stemming from this project. The project should utilize the Biopython library. The computed phylogenetic distances should be outputted in a CSV file.

All information will be shared on private chat

I have a VPS server with dedicated IPs and use the paid version of VirtualMin. It has Ubuntu 22.04 64-bit with phpList installed but not fully configured. (Virtualmin had an auto-install package I used.) There is nothing on this server except for this, so there are no other applications or websites to worry about that might break. It's all a fresh install. 1) I have approximately 80k emails from a previous service I used, and I need the server set up finished -I would like to have the following done: -finish setup and config, including DKIM, SPF, and DMARC (if you give me the info, I’ll put it in any additional DNS info, which is on GoDaddy, not the provider the server is on) -Set up any autoresponders and whatever automation is available - Set up and configure bounce handli...

I need to increase my circuit gain to 3000 using this behavioral model

I have a project that requires data scraping and AI generation. The task involves working with a list of companies and their URLs, and I need this completed by Saturday/Sunday. Here's what I need scraped: - Location (City, State) for US companies or (City, Country) for non-US companies - Year founded - Employee count - Logo from LinkedIn - Accent color from their logo or website - Amount of reviews the company has (don't look too hard for this) Additionally, I need the following to be generated via AI (ChatGPT, Claude, Perplexity, etc): - A description of the company using a template I provide - Two comments/small descriptions using a template I provide The task involves 3000-4000 line items, but many are already complete. There are some duplicates. Sort ...

...through web scraping. - Real-time Updates: I need updates every 5 minutes for stocks that are experiencing notable changes, specifically: - Spurts in Open Interest (OI) with changes greater than 7%. - Stock prices with percentage changes greater than +2% (gainers) and less than -2% (losers). - Filtering Logic: I need stocks to be identified that meet the following criteria: - OI% change > 7%. - Top gainers: Price % change > +1%. - Top losers: Price % change < -1%. The identified gainers and losers need to be separated into distinct lists. There should also be logic for gap-up/down filtering based on the opening price deviation (>1.5%). Ideal Skills and Experience: - Proficiency in using NSE APIs for fetching live stock data. - Experience with third-pa...

I'm in need of a proficient Python developer who can create a web scraping application for me. The primary aim of this application is to extract text data from various e-commerce sites. Key Requirements: - Expertise in Python, particularly in libraries/APIs used for web scraping (e.g., BeautifulSoup, Scrapy, Selenium). - Previous experience in developing web scraping applications, preferably for e-commerce sites. - A strong understanding of data extraction, transformation and loading (ETL) processes. - Ability to write clean, efficient and well-documented code. - Good problem-solving skills and attention to detail. Your task will be to create an application that can navigate e-commerce sites, identify relevant text data, and extract it effic...

I need a Python SCRIPT to scrape a news website in Traditional Chinese Characters. The script should assist my client by providing daily updates relevant to my client's business. It should scrape the website once a day, extracting headlines and summaries from the articles. Please provide all source code. Ideal Skills and Experience: - Proficiency in Python and web scraping - Familiarity with news websites - Understanding of Traditional Chinese Characters or ability to use google translate to understand the website's source and content. - Experience with data organization in Excel linked in python (recommend Pandas) - Ability to create efficient and reliable scripts on time and on budget. - Ensure you can handle this project BEFORE accepting it. We will have more pr...