Good beginner web scraping projects일자리
멀티 스레딩 프로그램으로 웹스크랩핑을 하는데 프록시 아이피를 셋팅해서 여러 아이피로 접속해수 수집함
웹스크랩해서 얻은 빅데이터를 인공지능 분석 기능을 사용해서 Block chain으로 데이터를 관리하는 시스템
I need assistance with web scraping. I've lost my credentials for a specific website that hosts E-books and manuals. I require help finding the URL, as well as retrieving these PDFs. Ideal Skills and Experience: - Proficient in web scraping - Experience with finding and retrieving data from websites - Ability to work around login issues - Familiarity with downloading PDFs - Problem-solving skills to locate the specific website Please note, the project involves locating the website, overcoming the login issue and downloading the required PDFs.
...information and all gathered information from the fill-out form. System validates input and confirms submission. Step 2: Data Retrieval App fetches: Vehicle specs via VIN decoding. Market values from KBB, NADA, or other sources. (This is a vision, but depending on complexity and cost associated with this feature, I'm up for discussion in leaving it off.) Comparable listings data using web scraping or APIs. Step 3: Data Analysis The system compiles and analyzes retrieved data: Calculates average market value utilizing the local 10 comparables averaging the listed current prices. Comes up with a simple average asking price. Factors in condition-based adjustments. Same concept. It will take all values of each category and average them. If above 8, then it will ...
I'm seeking a seasoned Java Spring Boot developer to help maintain/enhanced an existing application. The ideal candidate must align with the EST (Eastern Standard Time) time zone. 8 PM IST to 2:30 AM IST. Key Responsibilities: - Maintain the current application - Focus on user authentication and authorization - API creation, integration and development. - back up all meetings and chats to the client. Skills & Experience Required: - Proven experience with Java Spring Boot core, AOP, webflux, Security, - Strong understanding of user authentication and authorization. - Proficient in API integration and development - Ability to work within EST time zone(Must 8 pm IST to 2:30AM) - Expertise in reactive java programming using webflux and other concepts. - Experience with documentDb. ...
Please contact me only if you are good at using Cascadeur!! As a beginner in the animation world, I'm looking for an experienced animator who can teach me, in the simplest and quickest way, how to create character movements using Mixamo in the Cascadeur software. I'm not interested in 3D animation. Also, I don't want to spend a lot of time and effort on modeling and such. I just want to create animations that other people have made in MIXAMO using Cascadeur program and upload them to my YouTube channel. <LIST> How to import animations from MIXAMO and change their position, rotate them, and merge them When importing two or more animations, how to make them flow naturally when the positions are different between each animation How to import an object an...
Just moved to Miami and as a complete beginner, I'm eager to learn Spanish primarily for daily conversational skills. I'm looking for an experienced online tutor who can assist me with this. I am looking for a tutor that can maybe do 2-3 sessions a week. Schedule options 8-9 am evenings after 7pm weekends Skills and Experience Required: - Proficiency in Spanish - Teaching experience, particularly with beginners - Skills in facilitating online lessons - Ability to teach conversational Spanish - Understanding of Miami's cultural context helpful
I need help scrapping product data from eBay for 300 electronics / Lightning products, including images. The data will need to be compiled into a CSV file suitable for uploading on to my website. Requirements: - Product Title - Product Price - Product Specifications (Dimensions, Weight, ...category and relevant data so it conforms to the correct format for my website. Images should be extracted in JPEG format. Second Task: I need a solution for checking stock and price of the selected items on a daily basis. This could be a script or some other method to monitor if an item is out of stock or if the price has changed. Ideal skills and experience for the job: - Proficiency in data scraping - Experience with eBay - CSV file creation - Basic understanding of monitoring stock and pri...
I'm looking for a skilled data scraper to extract product details from a secure website. The data to be scraped includes: - Product name and price - Product description - Product specifications Ideal skills for this project include: - Proficiency in web scraping tools and techniques - Experience in handling secure sites - Strong understanding of JSON Please note, the primary focus of this project is on text content related to product details. Experience in scraping similar data will be an advantage.
I'm looking for someone to harvest email addresses from a company directory website. The goal is to collect 100 email addresses. The payment is 10p per email, which totals £10 for 100 addresses. Requirements: - Collecting email addresses from a company directory website - Delivering the email addresses in a plain text file Ideal Skills: - Web scraping - Data collection - Familiarity with company directories
Hello, I am looking for a professional freelancer experienced in Data Scraping to obtain Saudi phone numbers along with the associated multiple names for each number. I would like to extract the data from any of the following apps: 1. App 1 2. App 2 3. App 3 (Number Book Gulf) – This app is the preferred option. Project Details: • Extract Saudi phone numbers only. • Retrieve all names associated with each number (there may be multiple names per number). • Save the data in an Excel or CSV file. • The data must be accurate and properly extracted from any of the mentioned apps. Notes: • Priority will be given to the "Number Book Gulf" app. However, if it is difficult to extract
I'm a beginner with AWS EC2 and I need assistance to deploy my tested Flask app on a Windows Microsoft IIS server. Key requirements: - Guide me through the process of deploying a basic 10 lines of flask file on AWS EC2 - Ensure that the app is running smoothly on the server Ideal skills: - Proficient in AWS EC2 and Windows IIS - Experienced with Flask applications - Capable of providing clear, concise guidance for a beginner
Python and Visual Studio Code Data Processing Data Entry Web Scraping Data Mining The project involves creating a script to mine text data . Key Responsibilities: - Develop a text mining script that can efficiently extract and process data from various fields in the database. - The script should be able to handle large volumes of data and return results in a timely manner. Ideal Skills: - Proficiency in SQL and data mining techniques. - Experience with developing scripts for database text extraction. - Ability to work with large datasets.
As a beginner in React, I am looking for someone to teach me how to launch my React apps on my local MacOS environment. I already have a development environment set up, but I could use some guidance to ensure I'm doing everything correctly and efficiently. Ideal Skills and Experience: - Extensive knowledge and experience with React - Familiarity with MacOS development environment - Ability to teach and explain concepts clearly - Patience and understanding towards beginners
I need a script that can scrape manifests from an online website and insert the data into a MySQL database. Ideal Skills: - Proficient in Python or similar languages - Experience with web scraping tools (BeautifulSoup, Scrapy) - Familiarity with MySQL and database management - Ability to write efficient, clean code Responsibilities: - Develop a web scraping script - Ensure data is accurately inserted into MySQL - Make the script run at specified intervals Please note, the specific website and data fields have not yet been determined. The freelancer will need to be flexible and ready to adapt the script as needed.
...freelancing work for various types of projects. Key Responsibilities: - Develop, debug, and integrate systems using our proprietary development stack - Frequent client interaction for requirement gathering - Inherit and maintain existing codebases - Manage up to 10 simultaneous projects in a dynamic environment - Ensure the quality of code through regular code reviews and automated testing practices Ideal Skills and Experience: - Proficient in Python, Java, JavaScript, and TypeScript - Primarily experienced in backend systems development - Strong client-facing skills for regular requirement gathering - Self-driven and organized with a knack for juggling multiple tasks - Previous experience maintaining existing codebases - Proven ability to deliver quality projects...
I'm seeking a beginner Android developer who has experience in launching applications and fixing small bugs. The primary goal of the app is to enhance user engagement. Key Responsibilities: - Implement push notifications and in-app messaging to boost user engagement. - Troubleshoot and fix UI/UX issues and crashes. Ideal Skills and Experience: - Proficient in Android development. - Previous experience in app launches. - Able to identify and rectify small bugs. - Knowledge of user engagement enhancing features like push notifications and in-app messaging. - Experience dealing with UI/UX issues and crashes.
We are seeking a skilled freelancer to work on a comprehensive project that involves data scraping, visualization, and prediction of stock market data. The ideal candidate will have experience in web scraping, data analysis, and machine learning. Key Requirements: 1. Data Scraping: - Scrape historical stock data from reputable sources (e.g. Yahoo Finance, Quandl, etc.) - Extract relevant data points such as open, high, low, close, volume, etc. - Store data in a structured format (e.g. CSV, JSON, etc.) 2. Data Visualization: - Create interactive and dynamic visualizations using libraries such as Matplotlib, Seaborn, Plotly, etc. - Visualize stock price movements, trends, and patterns - Create dashboards to display key metrics and insights...
I'm looking for a skilled professional to help me build a comprehensive email list that will be used primarily for client communication. Key Responsibilities: - Scrape relevant websites to gather potential email addresses. - Ensure the email addresses are valid, relevant, and appropriate for client communication. Ideal Skills and Experience: - Proficient in web scraping techniques and tools. - Previous experience in creating email lists for business purposes. - Understanding of data validation and filtering processes to ensure quality and relevance of the list.
I'm in need of a freelance robotics consultancy with expertise in industrial robotics. The main focus will be on system design and integration for the manufacturing industry. Ideal Skills: - Extensive knowledge of industrial robotics - Proficiency in system design and integration - Experience in the manufacturing sector Expectations: - Design and integrate a robotics system tailored for manufacturing - Deliver a high-quality, efficient, and effective system - Provide ongoing support and consultancy throughout the project
I need an experienced Meta ads professional to promote my newly developed option chain calculator. This tool is specifically designed for trading in stock market options. The primary goal of the campaign is to generate leads. Key Feat...updates - Profit/Loss calculation - Predictive features to indicate whether to enter a call or a put I will also teach you how to develop this tool so you won't have to pay for subscriptions. Desired User Experience: - The tool needs to be beginner-friendly. Skills and Experience Required: - Proven track record in managing successful Meta ads campaigns - Experience in promoting financial tools or software is a plus - Ability to understand and translate technical features into marketing content - Skills to make the product appealing to ...
I need a Python expert to scrape tweets from a specific Twitter account using the Twitter API. The scraped tweets should be inserted into a MySQL database. Key Requirements: - Experience with Python and Twitter API - Familiarity with MySQL - Ability to scrape and process data efficiently What You Will Do: - Watch the provided video for guidance - Scrape tweet text from a specific account - Insert new data into the database without deleting existing records Please check the video and let me know if you're capable of doing this.
I'm looking for a creative and detail-oriented individual who can take a script and transform it into an engaging, visually enriched story with a natural-sounding voiceover. Key aspects of the project: Audience: Th...polished, visually appealing videos creating high retention. 3. Experience with voiceover production, including the use of AI voiceover tools. 4. Comfortable working with AI-based tools for video and audio creation (not a beginner level). 5. An eye for detail to ensure visual and audio elements align seamlessly. Deliverables: A high-quality, fully edited 15 - 20 minute video. Feedback and revisions incorporated as needed to meet project goals. Opportunities for Future Work: This project could lead to additional collaborations for similar videos and other cre...
...and Apollo.io. Identify potential candidates based on job titles like Inside Sales Representative, Lead Inside Sales, Inside Sales Manager, and Sales Coordinator. Collect and organize name, job title, company, location, LinkedIn profile, email, and phone number. Ensure data accuracy and relevance for headhunting. Deliver structured reports in CSV or Excel format. Requirements: Experience in data scraping, lead generation, or recruitment research. Proficiency in tools like Lusha, ZoomInfo, LinkedIn Recruiter, , and PhantomBuster. Strong research and analytical skills to verify and validate contact details. Ability to work independently and meet targets. Preferred Qualifications: Prior experience in recruitment, B2B sales intelligence, or data mining. Familiarity with the construct...
Position Summary: We are looking for a rigorous and competent data entry professional to ensure the entry...data security protocols to guarantee the confidentiality and integrity of information. - Create or modify graphic documents and media using Adobe InDesign. - Produce detailed reports and share them with relevant teams. - Collaborate with other departments to ensure smooth data communication. Technical skills: - Advanced knowledge of Microsoft Word, Excel and Google Sheets. - Good knowledge of advanced Excel functionalities (pivot tables, complex formulas, etc.). - Strong data security skills (access management, encryption, best practices). - Experience in using Adobe InDesign for document creation and editing. - Convert manual documents to di...
I'm looking for a skilled data entry specialist with web scraping experience to assist in entering product details into our database. The data is currently housed in Airtable and will need to be meticulously transferred and updated. Key Responsibilities: - Data Entry: Accurately inputting product details from Airtable into our database. - Web Scraping: Gathering product prices, descriptions, and images from various websites. Ideal Skills: - Proficiency in Airtable - Experience with data entry and web scraping - Attention to detail - Ability to meet deadlines
I'm seeking a skilled developer or team to create a software capable of scraping user data from APIs. Before I officially list this project, I would like to receive estimates from potential candidates. The key elements of the project are: - Development of scraping software specifically designed to extract user data from various APIs. - Providing an estimate for the cost and time required for such a project. - All responses will be considered for a launch date that is to be announced. Ideal freelancers for this project should have: - Proven experience in developing scraping software. - Strong understanding and experience working with APIs. - Ability to provide accurate project estimates. The format for the scraped data is currently undecided, so flexibility and ...
i need a website scraped in the craft area the headings are Name Description sku price image url Diamensions Weright isbn format page url pages Autoir in excel format url script built
I am seeking a knowledgeable and experienced attorney specializing in copyright law and web scraping legalities to provide legal guidance for my automated YouTube channel project. About Me: I operate a YouTube channel that leverages automated tools to produce videos by referencing articles sourced from various online platforms. My process involves scraping content via RSS feeds and utilizing keywords to generate scripts, which are then transformed into engaging video content. Project Scope: Legal Assessment: Evaluate the legality of my current web scraping practices, particularly in relation to copyright laws and terms of service agreements of the sources I use. Compliance Strategy: Develop strategies to ensure my operations comply with relevant laws, ...
I need a skilled programmer experienced in Python or Node.js, who can create a script for me that will parse Google SERP da...Google SERP data through our rotating proxy provider. The script needs to extract data points such as Titles and URLs, Meta descriptions, and Search result rankings. Key Requirements: - The script should run daily as an API enpoint which will get settings for scraping (google domain, language code, country code, proxy settings, keywords) - The output data needs to be in JSON format Since Google has recently updated its system to block bots/scrapers, the script needs to effectively navigate through this challenge. Experience with web scraping, working with proxies and understanding of Google SERP is a plus. Please apply if you have the relevan...
I'm a beginner with Solana, eager to learn advanced strategies specific to copy trading. My main goal is to understand and master these advanced techniques. Key Requirements: - Proficient in Solana and copy trading with a track record of teaching these concepts. - Able to explain complex strategies in a simple, understandable way. - Patient, engaging, and able to adapt to my learning pace. Ultimately, I'm looking for a tutor who can help me navigate this advanced trading landscape on Solana.
I'm seeking assistance to extract data from a conference website. The task involves gathering information on all attendees and their respective compa...file. - Create a secondary CSV file that lists all the companies in attendance (one column: Company). The data needs to be extracted from a publicly accessible section of the conference website. The task needs to be completed before noon EST on January 21st. I will make a decision on whom to select by 9:00pm EST on January 19th. Ideal Candidate: - Previous experience with data extraction and web scraping is preferred. - Proficient in using tools like Python, Excel, or any other data extraction software. - Attention to detail to ensure accurate data collection. Successful execution of this project may lead to future wo...
I'm seeking a professional with deep expertise in Puppeteer and the Google API. I am open to various tasks including web scraping, automation of tasks, and data extraction and analysis. Your role will involve employing Puppeteer for web automation and using the Google API for data management. Ideal Candidates Should Have: - Extensive experience with Puppeteer - Proficiency in using various Google APIs - Strong skills in web scraping and data analysis - Able to automate tasks efficiently - Good understanding of working with structured, text, and image data.
I need ...site. My project logic is fully implemented, but I'm encountering access difficulties due to this anti-bot solution. What I require: - Solving the PerimeterX blocking issue to access the main endpoint: /niles/partners/{partner_id}/menus - Providing a solution that enables unrestricted requests. Necessary headers and cookies will be provided. I am not looking for assistance with logic or general scraping—just with bypassing this specific block. Key skills and experience: - Proficient with using a headless browser, specifically Selenium. - Familiar with session-based authentication mechanisms. Please provide: - Any additional information you need from me to give an accurate quote. - Examples of prior experience with systems like this. I look forward to your p...
I'm in need of a comprehensive database containing contact information for Real Estate Professionals (Agents and Brokers) associated with @properties, covering all cities they operate in. The data should be structured in an Excel spreadsheet and must include: - Name - Address - City - Email (Any...number - Company name Key Requirements: - I'm looking for as many contacts as possible, ideally in the thousands. - The email addresses do not need to be verified, but any available email is acceptable. - Prior to engaging in further conversation, I would like to see at least 10 examples of the data you've gathered. Please note that this task may be straightforward for those experienced in data scraping. A successful completion of this project could lead to future opportu...
...our team for ongoing and future projects. Please note: we are looking for an individual freelancer, not an agency. This is a long-term, part-time position where you’ll maintain and enhance existing websites, add new features, and contribute to exciting new projects as we expand. The role is flexible, averaging 23 hours per week, but some weeks may require 40+ hours depending on the workload. If you’re passionate about coding, optimizing performance, and building high-quality tools, this is the perfect role for you! WHAT YOU’LL BE WORKING ON: PROJECT 1: HOSTED PLATFORM WEBSITE -Technologies: HTML, CSS, JavaScript, jQuery, PHP, MySQL -Tasks: --Fixing UI bugs. --Adding features via API requests. --Enhancing server-side functionalities. PROJECT 2: CUSTO...
Python Web Scraping Specialist with Advanced Scrapy Expertise Company Overview: We are an innovative tech company specializing in developing cutting-edge software solutions for the automotive industry. Our flagship platform aggregates and standardizes car data from various sources, enabling a seamless meta-search experience for users worldwide. Role Overview: We are looking for an Advanced Web Scraping Specialist with extensive Scrapy experience and exceptional Python skills to join our team. This role involves developing and integrating custom web scrapers into our sophisticated scraping automation system. You will handle challenges like bypassing complex web protections, managing proxy rotations, and working within a multi-layered softwa...
hey Richard, help me enhance my scrapping code for machines
I'm looking for a Python expert to help me create an automation script that scrapes news articles from the US scheduler. Requirements: - Experience in Python and web scraping - Ability to work with scheduling systems - Understanding of news article structure and scraping techniques Please reach out if you can assist with this project.
I'm seeking a dedicated fullstack developer to join my team. The focus will primarily be on backend development, specifically for web applications. Flexibility to work across different time zones is essential, as tasks will vary according to project needs. Key Responsibilities: - Backend development for various web applications - Collaborating with the team to meet project deadlines Ideal Candidate: - Proficient in Django and Ruby on Rails - Experience with frontend development and database management - Able to adapt to different time zones as per project requirements - Team player with good communication skills
I'm looking for a civil engineer with a solid background in structural design. The job involves ongoing single-family home remodeling and new additions in California, USA, specifically focusing on the design of foundations, footings, and framing. Key Requirements: - Must possess a CSLB engineer stamp to approve designs for city permit submission - Extensive experience in structural design for residential buildings - Proficient in foundation and footing design, as well as framing Ideal Skills: - Previous work with single-family houses is highly valued - Proficient in using Revit for structural design - Able to perform general structural design The primary purpose of this work is for remodeling existing homes, necessitating a keen understanding of how to integrate new structures with...
As a beginner in UX development, I'm looking for a mentor who can guide me specifically on TSX/TypeScript. I prefer learning through watching video tutorials, so if you can provide or recommend high-quality resources, that would be ideal. Key Requirements: - Extensive knowledge and experience in UX development, particularly in TSX/TypeScript - Ability to explain complex concepts in a simple, understandable manner - Access to or knowledge of quality video tutorial resources - Patience and understanding towards a beginner's pace and level of comprehension If you can help me understand this key area of UX development, I would be incredibly grateful. Let's get started!
I'm looking for a skilled data extractor with LinkedIn experience. The task is to extract specific information from user profiles on LinkedIn. Key Requirements: - Extract user profiles data from LinkedIn, focusing primarily on contact information. - Deliver the extracted data in CSV format. Ideal Skills: - Proficient in data extraction and web scraping. - Familiar with LinkedIn's platform and its user profiles. - Experience in delivering data in CSV format.
I'm looking for an expert in algorithm development to create a system for a book reading app. The app will feature primarily free books with video ads incorporated into the experience. Key Aspects of the Algorithm: - The primary focus of the algorithm should be enhancing user engagement. - It should also take into account the user's reading history when making book recommendations. Ideal Skills: - Proficiency in algorithm development and understanding. - Experience in AI applications for algorithm improvement. - Knowledge in creating user-centric systems. - Understanding of integrating advertising into app algorithms. If you're able to create a compelling and engaging algorithm, we can discuss the conditions further.
Hi, I am beginner with Selling on Amazon, focussed on Germany. I have only one product of 20€ which i sell once per day on average. I do this as a side hustle mainly to learn how ecommerce is working and later scale up the business. I am looking for an experienced Amazon seller that can coach me via zoom call to become better which means creating more sales. I had tried Ads but my margin went down the drain so i stopped again. I started creating infographics but for sure they could be further improved. At the moment I do not want to add more products. I only want to improve the one product which I am selling. You are bidding for just the 30 minute call. If you can help me, we could also work together longer term.
