Web scraping using pandasроботи
...Учет сигналов с нескольких периодов. Тестирование новых идей: Возможность внедрения новых стратегий на демо-счете. Ожидаемый результат: Бот должен быть полностью автоматизирован, учитывать динамические параметры (риск, тейк-профит, стоп-лосс), работать только на бирже Bybit и обеспечивать максимальную прибыльность при соблюдении разумных рисков. Вот основы для написания кода: import ccxt import pandas as pd import numpy as np from telegram import Update, Bot from import ApplicationBuilder, CommandHandler, ContextTypes from sklearn.linear_model import LinearRegression import time import logging import asyncio import talib # Логирование (level=, format="%(asctime)s - %(levelname)s - %(message)s") logger = (__name__) # Настройки API
Необхідно розробити веб-застосунок та описати його роботу. Опис має бути в форматі одного розділу бакалаврської дипломної роботи. Більш детальний опис наведений в закріплених файлах.
I’m looking for a skilled developer to help optimize or rewrite a script for data scraping from allegro.pl. The goal is to scrape item URLs and download their HTML content efficiently while ensuring smooth operation. Current Situation: I have a JavaScript-based script that navigates to specific categories on Allegro, scrapes item URLs across multiple pages, and downloads their HTML files in a predefined structure (example attached). The script is slow due to delays between requests. Reducing these delays causes challenges with Allegro's security mechanisms, making the process less reliable. What I Need: A robust and reliable solution for faster and more efficient scraping without interruptions. The ability to download HTML files in the required structure. Ideall...
Будь ласка, зареєструйтесь або увійдіть в систему для перегляду деталей.
I have an existing Python script that performs an automation task, primarily integrating with public APIs and scraping specific websites. Key Task: - I need this Python script converted into an N8N workflow. The key functionalities of the original script that need to be replicated include: - API integration and endpoints - Web scraping Ideal Skills and Experience: - Proficiency in Python and N8N - Experience with API integration and web scraping - Understanding of automation tasks - Familiarity with public APIs
New project as already discussed.
Prototype for AI-Based Disease Monitoring Using Social Media Data Project Overview: We are looking for a freelancer to develop a simple prototype for a project that monitors disease-related trends using social media data (e.g., Twitter). This is a proof-of-concept project intended to explore feasibility, and we plan to expand it into a larger project once we get confidance. The main goal is to extract and analyze basic trends using natural language processing (NLP) and machine learning, along with simple visualizations. --- Scope of Work: 1. Data Collection: Collect a small dataset of tweets or public health data using the Twitter API or any other publicly available source. Focus on disease-related keywords (e.g., “flu,” “dengue,&rdquo...
I need data from my Facebook followers. Specifically, I'm looking for: - Emails - Phone Numbers - Names - Usernames - Profile URLs Skills and Experience: - Proficiency in data scraping, ideally from Facebook. - Familiarity with data privacy regulations and ethical scraping practices. - Ability to deliver data in an organized and easy-to-understand format.
I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...
I'm seeking a skilled professional to create architectural visualization renderings with Unreal Engine 5.2 on our server. You will be required to remote into our system. It is not permissible to use the files on your personal workstation. The renderings we need are for a pitch deck, which will be finally delivered in a ppx (PowerPoint) presentation, but may simply be in a .pdf file. We will supply the text during our chat. Key components include: - Style: The visualizations should represent a modern architectural approach. - Elements: The renderings should encompass exterior views and landscape features. - Designer should be very artistic and be able to grasp our objective for the look we seek Ideal candidates should have: - Proven experience in architectural visualization and...
I'm in need of a professional data scraper to extract contact information from 1400 profiles on a particular website and import it into an Excel CSV file. Key Requirements: - Scraping of 7 specific fields of contact information from each profile, including: - First name - Last name - Email address - Phone numbers - Social media links - Opponent - Win or loss/method Ideal Skills: - Proficient in web scraping tools and techniques. - Excellent attention to detail to ensure data accuracy. - Experience with data processing and Excel. Please bid if you have prior experience in this type of project.
Purpose: This document defines the requirements for developing a scraping script that extracts data from the website with the aim of storing catalog information in a relational database. This includes categories, subcategories, machine plans, parts of each machine and their respective images.
I need a professional data scraper to help me collect emails from the internet. Please note that the data collection is a one-time task.
Будь ласка, зареєструйтесь або увійдіть в систему для перегляду деталей.
- Make a web scraping of all the suppliers in - Make and excel with (Name of suppliers, Description, Adress, Website, Number, URL, category 1 category 2 category 3 category 4) - In the description it will be the (introductión + descripción + otros ) of the web page of each supplier - Make an example with 5-10 suppliers and wait for confirmation from me before doing all the work. This way I can give feedback at the beginning.
Hello, I currently have a JavaScript script that works as follows: 1. It navigates to any selected category on allegro.pl. 2. The script prompts me to input the number of pages to scrape. 3. It iterates through the specified number of pages and collects the URLs of each item listed on those pages. 4. It then visits each item’s URL and downloads the HTML file in a specific structure (I have attached an example of the required HTML structure). Issues: • The script is too slow because of the delays added between requests. • If I reduce or remove the delays, Allegro’s security mechanisms detect and block the script. • I’ve tried switching to Python, but Selenium and similar libraries face issues with Allegro’s automated access restrictions. What...
I'm in need of a skilled web scraper to collect the addresses of locations from 20,000 domains. This is a one-time project with no further data collection required after the initial scrape. Deliverables: - A comprehensive list of addresses in an Excel spreadsheet. - Data integrity: Ensuring all addresses are accurately captured and correctly formatted. Ideal Skills: - Proficiency in web scraping tools and software. - Strong attention to detail to ensure data accuracy. - Experience with data compilation into Excel. Please provide examples of similar projects you've completed in the past.
I'm seeking a Python expert with experience in web scraping, particularly from Instagram. This project involves collecting social media content for analysis. Key requirements: - Proficiency in Python and web scraping tools/libraries (e.g., BeautifulSoup, Scrapy, Selenium) - Prior experience scraping data from Instagram - Familiarity with social media content and its potential for analysis - Ability to handle large data sets and implement efficient scraping techniques - Understanding of Instagram's terms of service and ethical scraping practices.
I'm looking for an expert data scraper that can extract data from a specified facebook page and deliver it in a CSV file. This is a one-time project. Ideal Skills: - Proficient in web scraping tools and techniques - Experience in data extraction and manipulation - Ability to deliver data in specified formats (CSV) Please note, the specifics of what data needs to be scraped from the website have not yet been determined. Your flexibility and expertise in identifying valuable data will be greatly appreciated.
...product mapping for every brand -Manage products PREFIXES and maintain a document that provides the prefixes used by various other suppliers Ideal Skills and Experience: - Scraping: some suppliers do NOT provide complete data or images. Being able to effectively get the information online efficiently is needed - Proven experience as a Product Manager in the retail industry is a must. - Strong understanding of the B2B market and how to effectively meet its needs. - Deep knowledge of Magento 2 as you will have to create configurable products. - Your job will be to determine attributes / categories for products using information available online (you will have to research the brand of products you are importing) - A deep knowledge of how Magento Manages Attributes is ess...
I need a seasoned developer to create a web scraper that will extract product details and pricing from five specific websites. Key Responsibilities: - Develop an automated web scraper for five selected websites. - The scrapers should be triggered in 6-hour cron routines hosted on Amazon AWS. - Store the extracted data into a PostgreSQL database, also hosted on AWS. - Ensure the data is formatted in JSON. Ideal Skills: - Proficient in web scraping, ideally with experience using AWS. - Strong knowledge of PostgreSQL and JSON. - Previous work with data extraction from eCommerce websites would be a plus. I look forward to your bids!
I'm in need of comprehensive data from Google Scholar for a personal project. The specific data points required i...required include: - Article metadata: This will help me understand the context and relevance of the articles. - Citation counts: This will provide insights on the impact and reach of the articles. - Author profiles: This will assist in identifying key contributors in the field. The data should be delivered in Excel format. Ideal skills for this task include: - Proficiency in data extraction and web scraping - Familiarity with Google Scholar - Expertise in data organization in Excel. Experience in handling academic data and conducting market analysis would also be advantageous. Please ensure you can deliver the data in a timely manner as this is a pres...
I'm looking for a straightforward Python script that can scrape text posts from Facebook groups I'm a member of. The primary purpose for this is d...scrape text posts from Facebook groups I'm a member of. The primary purpose for this is data analysis, and I would like the scraped data to be delivered in a CSV file. Key requirements: - Proficient in Python, with experience in web scraping - Familiarity with Facebook's structure and privacy considerations - Ability to code a solution that filters for text posts only - Can provide the data in a well-structured CSV format This project is ideal for someone who can deliver a reliable and efficient scraping tool, and understands the importance of ethical scraping practices. Please include example...
...Engineer/Full Stack Developer with extensive knowledge and experience in database structuring and implementation on AWS. The project revolves around a financial platform, necessitating the design and implementation of a robust ETL (Extract, Transform, Load) pipeline for our data warehouse. Key Responsibilities: - Creating the ETL pipeline - Data extraction primarily from vendor APIs with occasional web scraping - Data loading to various databases Ideal Skills: - Strong expertise in AWS and cloud-based database implementation - Proficiency in designing and optimizing ETL pipelines - Experience in integrating vendor APIs - Knowledge in database structuring and optimization Good to Have: - Proficiency in AI and prompt engineering Please note that while the specific databa...
i have code for collection tweets but the problem it doesn't collect tweets more than 100 tweets only i need to collect more than that
I need a professional who can help me with lead scraping. The primary source for the leads has not been determined yet, so a good understanding of various platforms and their potential for lead generation will be beneficial. Ideal Skills: - Proficiency in data scraping tools and software. - Experience with various lead generation platforms. - Knowledge of data analysis and processing. - Strong attention to detail to ensure data accuracy. Please note, the specific data to be collected from each lead is yet to be decided, so flexibility and creativity in suggesting valuable data points will be appreciated.
I'm looking for a freelancer who can scrape a public website for contact details. The information I need includes email addresses, phone numbers, and names. This is a one-time project. Ideal Skills and Experience: - Proficient in web scraping techniques and tools - Prior experience in data extraction - Attention to detail to ensure data accuracy - Understanding of privacy laws and ethical standards in data collection This is the website: We need the following information: - Name - Adress - E-Mail - Phone number You find an example in the attached Excel file. Please add all other contacts in the same manner.
Job Description: We are looking for an experienced web developer/designer to create a professional, responsive website for our Home and Office Renovation business using WIX. The website should be modern, user-friendly, and responsive for all devices (mobile, tablet, and desktop). Reference Websites: Key Features and Requirements: Platform: The website must be developed using WIX. Design: Clean and modern design inspired by the reference sites. Must be visually appealing, intuitive, and user-friendly. Responsiveness: Fully responsive for mobile phones, tablets, laptops, and desktops. Services Pages: The website should include the following services pages: Kitchens Bathrooms Painting Flooring Wardrobe and Cabinets Villa Renovation
I'm seeking a developer to create a script or browser extension for me. This tool should help me, with only view access to a Shopify backend, to scrape order details at scheduled intervals. Key Requirements: - Acc...view access to a Shopify backend, to scrape order details at scheduled intervals. Key Requirements: - Access the order tab and individual orders - Copy specific information: customer name, number, products, address, city or state Data Handling: - The scraped data should be saved in a CSV format Ideal Skills: - Proficient in developing Chrome extensions or scripts - Previous experience with web scraping - Knowledge of data handling and CSV format Please note, this is a scheduled task, so the tool should be able to operate at predetermined intervals withou...
Project Details £10.00 – 360.00 GBP I am seeking a talented freelancer with strong web scraping skills, preferably in Python, to assist with a project involving two specific websites initially. There is potential for more sites in the future. I will provide the specific data fields that need to be extracted. Key Requirements: - Proficiency in web scraping and/or Python. - Familiarity with MS SQL Server databases is a plus, but not essential. - Ability to extract data efficiently and effectively. - Understanding of necessary security measures, including captcha integration if required. - Capability to deliver quality work quickly, as this project is a priority and needs to be completed ASAP. This project could evolve into a long-term partnership, as...
I'm in need of a data extraction expert to help me gather information from a specific website. The dataset contains approximately 200,000 entries, and I'm looking to filter for contacts from a specific location. Key Requirements: - Export data fields: Name, Email, Designation, Company Name, - Data to be delivered in Excel format - Experience with web scraping and data extraction - Ability to filter data by specific location Compensation: I can offer 20-30 paisa per contact.
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is React.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here: Overall Development Requirements: - Front-End to Back-End Integration: All front-end features must have corresponding back-end operati...
... Introduction to Data Analysis - CRISP-DM reference model - Data Analytics workflows - Distinction between Artificial Intelligence, Machine Learning, and Deep Learning - Roles and requirements of Data Engineers, Data Scientists, and Data Analysts in organizations Review of Python Fundamentals - Data types - Functions Data Analysis - Key Python modules for Data Analytics (NumPy, Pandas) - Data preparation process - Data mining algorithms in Python - Artificial Intelligence (AI) in the workplace - Introduction to specific AI technologies and their applications in professional settings Data Visualization - Exploratory Data Analysis - Insights - Data quality - Benefit analysis - Visualization with Python: Matplotlib, Seaborn, Plotly Express - Dat...
I'm seeking a professional email scraper who can help me collect email addresses from specific ...email addresses from specific social media platforms, for a Rock Band that have 969k Facebook followers and 154k on followers on Instagram. I have recently used the services from someone here and was supplied with a completely fake list, he gave me 95.5% and I couldn't find one single known 'fan' email. I run a website and social media for ex members of that band and I already have 1.5k emails using targeted Facebook ads for that band that have since logged in as members to our website. So if you're saying you can provide 70% success rate, I would anticipate to find a similar % rate when I check your list, I hope that sounds reasonable, fair and understandable....
I'm seeking an expert in Apify for web scraping and for process automation. The main focus of this project is data extraction and reporting, specifically targeting market trends data from various platforms. Key Responsibilities: - Utilize Apify to scrape relevant market trends data from e-commerce websites, social media platforms, and news/financial sites. - Implement to automate the data extraction process, ensuring efficiency and consistency. - Generate comprehensive reports based on the extracted data. Ideal Skills and Experience: - Proven experience in web scraping using Apify. - Proficient in using for process automation. - Strong understanding of market trends data. - Excellent data analysis and reporting skills. - Ability to work w...
I'm in need of a trading strategy to be implemented on the TradingView platform using Pine Script. The strategy should be based on breakout techniques and specifically utilise the Central Pivot Range (CPR) indicator. Key requirements: - Develop a comprehensive strategy that includes Entry points, Targets, and Stop Loss (SL). - Incorporate a Dynamic Trailing Stop (TS) within the strategy. - The strategy should be designed for a single timeframe, as I do not require multi-timeframe analysis. - The milestone for payment will be created only after the strategy is fully ready and tested. Ideal Skills: - Proficiency in Pine Script. - Experience with TradingView platform. - Strong understanding of breakout strategies and CPR indicator. - Ability to incorporate dynamic elements into...
...proficient Python developer with extensive experience using Beautiful Soup, Scrapy, and Requests for a web scraping task. Key Requirements: - Expertise in Python and web scraping libraries such as Beautiful Soup and Scrapy - Proficient in using Requests for HTTP requests - Comfortable working with public websites - Capable of extracting diverse data types including text, images, and audio Task Overview: - The project involves the extraction of data from a public website. - The specific data types to be extracted include text, images, and audio. Ideal Candidate: - A keen attention to detail is crucial for this task, as is the ability to navigate and extract data from potentially complex web structures. - Prior experience with similar...
grocery stores,Surpermarkets ,conviniance stores Fresh Produce wholesellers Fresh Produce importers Catering Companies Food Processor Wine producers Dairy product manufacturer Meat processor Fish processor
I need a freelancer to scrape 30,000 records of contact information from a provided URL within 48 hours. The information will specifically consist of names, email addresses, phone numbers, and mailing addresses. The final output should be in an Excel format. Ideal skills and experience for the job include: - Proficiency in web scraping - Experience with Excel - Attention to detail - Ability to meet tight deadlines
I have a project focused on video and image compression. My goal is to achieve maximum compression rates while preserving original quality using vector quantization (VQ) and deep learning techniques. Please bid only if you have prior experience with similar projects. Detailed requirements will be shared with the most suitable candidate.
I'm looking for a skilled developer to integrate the JVZoo payment system with my custom-built SaaS platform.. The integration should utilize IPN (Instant Payment Notification) to trigger specific actions upon payment confirmation including to Activate subscription, Send confirmation email, Update user account status Key Requirements: - Proficient in working with JVZoo payment systems - Experience with SAAS platform integration - Familiarity with IPN (Instant Payment Notification) The SAAS platform offers both Monthly and Annual subscriptions. Upon payment, the following actions should be automatically triggered: - Activation of subscription - Sending of payment confirmation email to the user - Update of the user's account status If you have a strong background in payment syst...
I'm in need of a web scraping expert with experience in extracting product information from manufacturer websites. Key Requirements: - Scrape product names and descriptions - Scrape product specifications Ideal Skills: - Proficient in Python or similar scraping tools - Prior experience with manufacturer websites - Good understanding of product specifications and descriptions Please provide examples of similar projects you've completed.
I'm in need of a professional who can extract data from a corporate website and compile it into an Excel spreadsheet. Key Requirements: - Extract data from a corporate site. - Data includes: Shopping Centre Name, Street Address, Suburb, State, and Post Code. - Focus on all store locations in New South Wales (NSW). - Use web scraping techniques for data extraction. Ideal Skills: - Proficiency in web scraping. - Experience with data extraction from corporate sites. - Excel spreadsheet management skills. - Familiarity with New South Wales geography is a plus.
...and move it from rough MVP to an evantually a launched site. The primary goal of the site is to enable easy access to data through visualizations and dashboards. This project involves completing a basic freemium model membership site that lists service offerings. Key Responsibilities: - Develop a freemium model membership site - Integrate role based auth system using 3rd party db auth system - Integrate listing scraping system using 3rd party scraper - Create a document generation feature - Establish a process management system (calendaring, scheduling) - Implement data processing and taggging system Ideal Skills: - Experience in developing membership sites, particularly freemium models - Proficiency in leveraging listing systems and document generation features -...
I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...
We are looking for an experienced Android developer to create an APK similar, with features like real-time audio communication, text messaging, and a user-friendly interface. The project involves using NIO (Non-blocking I/O) and WebRTC libraries for high-performance, low-latency communication.
I'm looking for a detailed, realistic t-shirt image for my apparel company featuring two racecars. Design Specifications: - The lead racecar should be depicted going into an outside turn, scraping the wall with its back end and creating sparks. - The second place car needs to be shown sliding in across the bottom of the turn. Important Notes: - The design perspective should be an angled view. - The racecars need to be in bright and vibrant colors. - The Image must be in vector form. - The final image files must be AI (Adobe Illustrator) and PDF file formats. Your expertise in creating realistic, dynamic illustrations and experience with designing for apparel will be crucial for this project. Please refer to the attached pictures for reference.
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is Vue.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here:
For our second project, we need to modify the UI of an existing GitHub repository that isn’t ours. We already have a Figma design prepared (some screenshots are attached, and detailed files will be shared during our discussions). The front-end technology stack is Vue.js. After updating the UI, the modified project should first be deployed on the developer’s own test server for evaluation. Once everything is confirmed to be functioning correctly, it will then be deployed to our server. Please ensure that the front-end and logo remain consistent, with no appearances of the old logo or name upon refresh. The GitHub repository can be found here:
