Web scraping for beginners jobs
I have an existing scraper built in python for the website (CWH). It scrapes the following information: - product description, price, images - SEO metadata - Additional metadata Currently, all the scraped data is stored in a CSV file. I am looking for a developer who has expertise in python / scraping and postgres to do the following: [Phase / Milestone 1] 1. Convert the existing scraper (code attached - /site-packages removed for space) to load the data in a postgres database. 2. Scrape reviews of products from the (CWH) website and store them in the database. 3. Look up the availability of the product in specific stores and write the boolean value in the postgres database. (code attached - ) [Phase
I'm in need of a Python script that can download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from ...download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from a public website every hour. - Upload the report to a specific portal folder without any modifications. Ideal Skills: - Proficient in Python programming. - Prior experience with web scraping and automating tasks. - Familiarity with working with Excel files in Python. - Knowledge of file upload pr...
I am looking for a professional web designer to create a website for stock market trading classes aimed at adults, particularly beginners. Key Requirements: - The site should be user-friendly, visually appealing, and tailored to the needs of adult beginners. - It should contain all necessary sections including course information, registration, contact details, etc. - Experience in designing educational or e-commerce websites would be a plus. - Understanding of stock market trading is not necessary, but would be beneficial. Ideal Skills: - Proficiency in web design and development - Strong understanding of UX/UI principles - Experience with SEO and responsive design - Knowledge of e-commerce platforms and tools
I'm in need of a versatile professional skilled in Squarespace and Canva. Your primary task will be to set up product pages on Squarespace, particularly focusing on integrati...tasked with creating a series of Canva social media posts and setting up an e-learning course in Squarespace (I will provide the written content). Additional responsibilities will include various general marketing tasks, such as scraping email addresses. Ideal Skills: - Proficiency in Squarespace and Canva - Experience in e-learning course setup - Knowledge of basic marketing tasks - Skills in data scraping Understanding of product fulfillment and delivery integration on e-commerce platforms is crucial for this role. Looking forward to your bids. Looking for ongoing pers...
As a novice Hummingbot user, I'm seeking assistance to configure Hummingbot for arbitrage strategies across Solana Key Requirements: - Initial setup of Hummingbot for these chains - Guidance and explanation of the setup process to enhance my understanding Ideal Skills: - Expertise in Hummingbot - Proficient in Solana, Ethereum, and Binance Smart Chain - Experience in teaching or explaining technical concepts to beginners Please refer to this video for context: I appreciate your help in making this a successful project.
I'm looking for a skilled PHP developer to create a dynamic web scraper for trading data. The scraper needs to collect price data from various sources, namely: - Stock market websites - Cryptocurrency exchanges - Forex trading platforms The data should be collected in real-time, so experience with PHP and web scraping is a must.
...provide a detailed description below. 1. Excel Spreadsheet: Please create an excel spreadsheet with the following columns. Column A: Label: “Video title” In this column, please provide the video title to match the title of the video download. For example, if you look at this TikTok video (@returnhomenor/video/7164090596796157230?lang=en), you would label the cell in this column: “Allow us to introduce ourselves!” Column B: Label: “Hashtags” In this column, please provide all of the hashtags included in the post. For example, for the same TikTok video shared above, you would put the following string in this cell in this column: “#terramation #humancomposting #naturalburial #greenburial #mortician #funeraldirector #greenfune...
I'm in need of a freelancer who can assist me with data entry of realtor information (name, company name, phone number, email, city) from multiple websites onto an excel sheet. This data needs to be formatted in a way that it can ea...freelancer who can assist me with data entry of realtor information (name, company name, phone number, email, city) from multiple websites onto an excel sheet. This data needs to be formatted in a way that it can easily be imported into my CRM. Key Tasks: - Source realtor information from multiple websites - A combination of web scraping and manual data entry - Processing of more than 500 entries Ideal Skills & Experience: - Proficient in Excel - Experience with web scraping - Detail-oriented to ensure data accuracy - Ab...
I am seeking a skilled freelancer to develop an online dashboard that consolidates data by scraping three specific webpages and processing files from an online consultation system with restricted access (user and password protected). The dashboard must include the functionality to download PDF reports and present the data in a user-friendly and analytical format. A detailed explanation of the webpages to be scraped is provided in the attached PDF. 1. Key Responsibilities: Design and implement an online dashboard with secure user authentication and restricted access. Scrape data from three specified websites, utilizing anticaptcha to bypass CAPTCHA requirements. Integrate uploaded files from an online consultation system. Enable the generation and downloading of PDF reports directl...
I'm looking for a skilled WordPress developer to create a custom plugin for related posts. The plugin should be able to: - Search external websites based on a list I provide - Identify similar articles using the keywords in my site's post titles - Automatically posting 3-5 related titles with hyperlinks on the original site The ideal freelancer for this project should have a solid understanding of WordPress plugin development, web scraping, and SEO practices. Experience with creating similar plugins in the past will be a big plus. The objective is to increase my site's interactivity and improve its SEO ranking through relevant external links.
I need a software engineer to create a Python SDK/package for scraping Reddit data. The package should accept either an email address or a LinkedIn profile URL as input to identify and retrieve data from a person's Reddit account. Key Responsibilities: - Build a Python package that takes a person's identifier (an email address or LinkedIn profile URL, both are suitable as options) as input. - Implement logic or utilize third-party APIs to identify the person's Reddit account. - Scrape the person's Reddit activity, including posts, comments, and likes. - Structure the retrieved data for easy access by the package user. The choice of third-party APIs for identifying Reddit accounts is open. The freelancer may choose whatever they think is mos...
...hosted on City Hive () to Shopify. Since City Hive lacks a direct export feature, this project requires scraping the product data and preparing it for import into Shopify, ensuring all essential details are included. Key Project Requirements: Data Extraction: Scrape or extract product data from the website, including product titles, descriptions, pricing, images, categories, brands, and options/variants. Example product page: Legend Vineyard Exclusives LVE Cabernet Sauvignon. Ensure that product categories (e.g., Wine, Spirits), brands (e.g., John Legend), and relevant attributes (e.g., Cabernet Sauvignon, Red Wine, Napa Valley) are captured. CSV File Preparation for Shopify: Format the data according to Shopify’s CSV template. Include the following fields...
Create a Simple Octoparse Template for Web Scraping Job Description: I need someone familiar with Octoparse to create a simple template that I can use to scrape a local copy of a website. This is an older website with no dynamic content, logins, or complex elements—it’s straightforward and static. Scope of Work: Set up the Octoparse template to start on a page listing all business categories. Configure the template to navigate into each category, extract business listings, and handle pagination if applicable. Capture basic business details like name, address, phone, and website (if listed). Key Information: The site is hosted locally on my computer, so I’ll run the template myself. The template should be reusable and easy for me to use wi...
I'm looking for a skilled developer to help with two tasks. Firstly, I need an information scraper built or fixed to pull numerical values from a specific source and store them in my database. Secondly, I am experiencing issues with my billing. Card bills are being generated, but my database doesn't update on recurring charges. This issue needs to be fixed promptly. Ideal Skills: - Proficient in web scraping tools and techniques - Strong knowledge of database management - Experienced with and troubleshooting payment gateway issues - Good understanding of recurring billing systems - Ability to deliver prompt and efficient solutions
I'm looking for a data scrapper who can extract specific information from Twitter and Facebook for me. Twitter Data: - I need the Username and bio, Number of followers, and Name of Twitter users. - I want this information from both personal and business profiles. Facebook Data: - I want to scrape Business profile follower links from Facebook. Ideal Skills: - Prior experience in data scraping from social media platforms - Proficiency in data analysis - Familiarity with Python or other scraping tools - Knowledge of ethical data scraping practices 800K records / 2 days delivery
I need a freelancer who can extract text content from a specific website - Google Trends. Key Responsibilities: - Extract relevant search terms from Google Trends - Organize the data in a systematic and easily understandable format Ideal Skills: - Proficiency in web scraping and data extraction - Familiarity with Google Trends - Excellent data organization skills Experience: - Previous work related to web data extraction is preferable - Experience with Google Trends is a plus
...my WordPress store with a specific e-commerce site. Currently, I manually add products and check stock status but I'm looking to fully automate this process. Key Responsibilities: - Web scraping product information from a specified e-commerce site, not via API. - Daily synchronization of prices and stock status. - Importing various product details including Title, SKU, Price, Stock status, Attributes (options to pick), Description, and Images. Tools & Plugins: - The integration with my WordPress store should be done using the WP All Import plugin. Ideal Skills & Experience: - Proven experience in web scraping. - Strong knowledge of WordPress and WP All Import. - E-commerce and inventory management experience is a plus. - Excellent problem-solv...
As a beginner freelancer, I'm e...beginner freelancer, I'm eager to develop my graphic design skills, particularly in logo design. I'm specifically interested in the illustrative style of logo design. I am looking for a mentor or a professional who can guide me in this journey. I would appreciate someone who can share their knowledge and experience, helping me to improve my skills and understanding of the field. Ideal skills and experience: - Extensive experience in graphic design and logo creation - Proficiency in illustrative style design - Ability to mentor and provide constructive feedback - Patience and understanding towards beginners in the field Please note, my goal is not just to complete projects, but to truly learn and grow in this field. Your gu...
I need assistance with a data scraping project focused on Facebook profiles from the Netherlands. Requirements: - Simply the name and profile link of each individual. - No specific criteria for the data points. The project is open to all profiles. - A small sample of the data before the full scrape is not necessary, I am fine with receiving the full dataset directly. Ideal skills for this job: - Proficiency in data scraping techniques and tools. - Familiarity with Facebook's data privacy policies and ethical standards. - Ability to deliver clean, organized data in a timely manner.
I'm looking for a skilled data extractor who can help me collect information about brokers, consultants, and agents from the SquareYards website. Key Details: - The data should be compiled into a CSV file. - The website is publicly accessible, so no login credentials are needed. - Ideally, you have experience with web scraping and data processing. Your task will be to systematically extract the relevant information and deliver it in the specified format. Please provide examples of similar projects you've completed in your bid.
I need a Python script that scrapes articles from the CoinMarketCap community section (), with dates being configurable. Key Requirements: - Store scraped data in the filesystem - Store metadata as...filesystem - Store metadata as JSON and content as text - Extract all possible metadata from the articles, with a focus on Author name, Published date, and Tags/categories - Ensure articles are not scraped more than once if the script is run again - Ensure the script isn't aggressive enough to warrant a blacklist from coinmarketcap servers Ideal Skills: - Proficient in Python - Experience with web scraping - Knowledge of CoinMarketCap and its community section is a plus - Familiarity with data storage in JSON and text format
I need a selenium-style program that extracts data from regarding past odds from Bet365, Unibet, and Betway. The data must be formatted in XML before I convert it into an Excel file. Data Requirements: - Odds history - Match results - Betting trends Sports: - Football Ideal Skills and Experience: - Proficiency in Python and Selenium - Previous experience in web scraping, particularly from betting sites - Familiarity with XML formatting - Understanding of football betting data. Please note, I can manually download the necessary pages. Your task is to write a program that automates the data extraction process.
...seasoned Winautomation professional to refine my existing scraper and incorporate additional features for a supplier-site. Key tasks include: - Enhancing the scraper to filter data by brandname - Implementing a function that allows the scrape to resume from the last point - Adding an option for image download: yes or no Post these updates, I need my current Python scrapers to be either fully transformed or seamlessly incorporated into Winautomation. My objective is to have all scrapers consolidated within a single platform. The data I typically scrape includes: - Brand, SKU, price - Text data (HTML, descriptions, name, tags, etc.) - Image-URL - Download image: yes/no, etc. As part of the scraping process, I need to log in to the supplier sites in order to acce...
I'm seeking a professional email scraper who can help me collect email addresses from specific social media platforms, particularly Facebook and Instagram. The goal is to gather emails from accounts related to a particular band. Ideal Skills: - Proficient in data scraping techniques - Familiar with social media platforms, especially Facebook and Instagram - Experience in identifying and extracting relevant data from social media - Knowledge of ethical and legal considerations in data scraping Please note that it's crucial to respect the privacy of individuals and adhere to the terms of service of the respective platforms.
...AI-generated whiteboard-style videos for a trading course designed for beginners. The videos must be in Arabic (Saudi dialect) and include engaging animations, clear voiceovers, and educational visuals. The freelancer will also assist in creating an exam and generating auto-certificates for course participants. Responsibilities: Video Creation: Develop whiteboard-style educational videos using tools like Doodly, Videoscribe, or similar. Ensure videos are engaging, accurate, and tailored to beginners in trading. Voiceover: Use AI-powered tools or native Arabic (Saudi dialect) speakers for clear and professional narration. Script Visualization: Translate provided scripts into appealing animations and visual elements. Simplify complex trading c...
I am looking for a seasoned professional with extensive experience in Winautomation and Power Automate. The project involves updating and refining my existing web scraper, with a specific focus on a supplier's website. This includes: * Implementing a brand name-based scraping filter * Adding functionality to resume scraping from the last point * Including an option to download images or not Additionally, I require the conversion of existing Python scrapers to Winautomation. The goal is to unify all my scrapers within the same software program for streamlined operations. I primarily scrape supplier sites for various product details including but not limited to: Brand, SKU, price, HTML descriptions, tags, image URLs, and whether to download ...
I'm in need of a professional data scraper who can extract text content and images from a specific website and save it into a CSV file. This is a one-time project with no need for data processing or cleaning before saving. Ideal Skills: - Web scraping - Data extraction - CSV formatting - Image handling Please note, I require the raw data to be saved without any modifications. please save; URL LINKS and all item information into columns / tabs in a csv excel file, or google spreadsheets file. we are scraping from here; in Japanese. CARDLIST｜ONE PIECEカードゲーム公式サイト｜ワンピース
I’m looking for a skilled Python developer to create a custom tool to assist with business origination. The tool should enable efficient data scraping from True Local Australia () and include features for data collection. Key Requirements 1. User Inputs in Python: - Industry/Business type. - Location (e.g., New South Wales). 2. Functionality: - Automate input of specified criteria into (). - Scrape business information from multiple result pages, including: - Business name, location, website, phone number, and email address. - Click into each result to capture additional details: - Business description - Year established. - Number of staff. - ABN and ACN (if available). 3. Output: - Save scraped data into Excel/CSV format. 4. Advanced
We are looking for a Python Developer with strong experience in Django and web scraping to help build and enhance chatbot applications. You will develop backend services, integrate web scraping tools, and manage data to improve chatbot functionality. Responsibilities: Develop and maintain backend services using Python and Django. Implement web scraping techniques to gather data from external websites. Integrate scraped data into chatbot systems for improved responses. Work with databases (SQL/NoSQL) and APIs to support chatbot features. Collaborate with frontend developers to ensure smooth integration. Requirements: Strong experience with Python, Django, and web scraping tools like BeautifulSoup or Scrapy. Familiarity...
I am looking for a female telecaller for my motorcycle training academy. The telecaller’s primary role will be to follow up with potential customers who have expressed interest in our training courses. The target audience for these calls will predominantly be beginners looking to learn how to ride. Therefore, the telecaller should be able to provide comprehensive details about our pricing and payment options to these prospective trainees.
I'm seeking a skill...individually. Tasks to be Automated: - Data Processing: Handling and analyzing numeric data efficiently. - Web Scraping: Gathering necessary information from the web. - Report Generation: Creating insightful reports based on processed data. Typical Data: - Primarily numeric data, so experience with handling and analyzing numeric data is crucial. Data Sources: - Primarily sourced from emails, web pages, and documents. Ideal Skills and Experience: - Proficiency in Python with a strong portfolio of automation scripts. - Experience with data processing and web scraping. - Ability to generate comprehensive reports. - Familiarity with extracting and processing data from emails, web pages, and documents. - Understan...
Job Title: Computer Programmer (Web Scraper/Software Developer) Job Location: Remote Job Type: Contract Job Overview: We are looking for a skilled and self-motivated Computer Programmer to develop a software solution that will automate the process of collecting property tax delinquent data from public property records. The solution will allow for filtering and sorting between different property types (houses and land) and should extract specific property-related information including owner names, addresses, APN (Assessor’s Parcel Number), delinquency status, county details, lot size, assessed value, and market value. The ideal candidate should have experience building web scrapers, APIs, or data collection tools, with strong programming skills and a fo...
Project: Automated Shopify Inventory Update ====================================== Required Skills: --------------------- Expertise in Shopify. Advanced knowledge of Excel (CSV database manipulation). Familiarity with Python for data extraction and processing. Project Description --------------------------- We are seeking a freelancer to automate the process of updating our Shopify inventory. This project involves adding approximately 8,000 new products from a supplier while ensuring compatibility with the existing catalog of 7,000 products already on our platform. The supplier’s inventory data is provided in an Excel file and must be adjusted to match our current Shopify format. Tasks to Complete Data Structure and Formatting: -------------------------...
...seeking a skilled Python developer with expertise in web scraping to create a script that extracts product information from websites. The solution must be efficient, reliable, and capable of handling diverse website structures. Project Requirements: Domain Extraction: Start with a large array of email addresses and extract their respective domains. PDF Search: For each domain, search for downloadable product sheets in PDF format. HTML Product Extraction: If PDFs are unavailable, extract product information directly from the HTML content of the website. Robustness: Ensure the script is adaptable to handle varying formats and structures of product information across different websites. Desired Qualifications: Proven experience in Python web scrapin...
Hi Motiur, I'd like to scrape a number of entries off of a webpage list of 232 different law firms. Most I'd like are shown on the primary page. If possible, I would also like to pull the description of the firm on the profile page linked to the primary page (I've called this the "clickthrough description" in the excel template). Do you think you can get all this information for the firms? Best, Will
I'm seeking a developer to create a bot for data collection. This bot will need to interact with various websites and databases to gather different types of data. Key Requirements: - The bot should be able to collect text data, images, and numerical data. Ideal Skills and Experience: - Proficiency in bot development and programming. - Experience with web scraping and database interaction. - Knowledge of collecting and processing various data types: text, images, and numerical data.
I need a Java automation script that has been designed for data extraction. The script is not functioning properly at the moment and requires a skilled programmer to perfect its logic flow. Key Responsibilities: - Analyze the existing Java code - Improve and perfect the logic flow - Ensure the script runs properly and correctly Ideal Skills: - Proficient in Java programming - Experience with writing and debugging automation scripts - Knowledge of web scraping techniques - Strong problem-solving skills
I'm looking for a skilled developer to create a web scraping program compatible with a MAC M2 processor. The specifics of the data to be scraped, the target websites, and the ultimate use of the data are currently undetermined. Therefore, flexibility and adaptability will be key to this project. Project: Setting in the program where it is possible to store and change login information Website Spamzilla Login information and password Website Ubersuggest Login information and password When clicking on ”start to extract from Spamzilla” button following will happen Login to a Spamzilla Extract predefine filters and make them choicble in the program as a dropdown list When chosen a predefined filter the program began to extract data from the website...
I'm seeking a talented content creator with a knack for teaching software through engaging YouTube tutorials. The focus will primarily be on custom software, targeting beginner-level users. Key Responsibilities: - Create and edit software tutorial videos using Adobe Premiere Pro - Develop creative and engaging content that simplifies complex concepts for beginners - Proactively bring fresh and innovative ideas to enhance tutorial production Ideal Skills and Experience: - Proven experience in creating software tutorial videos - Highly proficient in Adobe Premiere Pro - Exceptional creativity and ability to think outside the box - Excellent understanding of beginner-level software concepts - Strong communication skills and ability to convey complex ideas simply
I need an expert in web scraping and MS Power Automate to help me set up a project. The site we will be working with requires scrolling and clicking to access data fields. - You will remotely connect to my Windows server via AnyDesk to do the work. - The site is not specified yet, but it requires interaction to retrieve data. - Your main tasks will involve setting up the scraping process and ensuring it runs smoothly. Ideal skills for this job include: - Proficiency in MS Power Automate - Extensive experience with web scraping - Familiarity with handling AJAX-loaded content - Ability to work remotely and troubleshoot in real-time. Please note, this project may involve working with various types of data fields, so flexibility and adaptability a...
...is to design and develop a unique, tech-inspired website for our cybersecurity podcast brand, InfyTek, which focuses on cybersecurity topics blended with emerging technologies such as AI, Quantum Computing, Blockchain, and other futuristic technologies. The website should have a clean, modern, and professional design with a techie look, appealing to both beginners and professionals in the cybersecurity space. The website will serve as a hub for podcasts, blogs, videos, and industry news, offering visitors valuable insights, practical guidance, and the latest updates in the field of cybersecurity. Key Features 1. Homepage • A modern, tech-themed landing page with: • Introduction to the podcast and brand. • Featured sections for: • La...
I'm looking for a compelling brochure for my stock market Academy, aimed specifically at beginners in the field. The primary purpose of this brochure is to attract new students. Therefore, it should not only convey the essence of our Academy, but also instill a sense of excitement and potential in the stock market. Key Requirements: - The brochure should be designed in a modern and trendy style, appealing to a broad demographic of potential students. - It should clearly outline our course offerings, our teaching methodology, and the unique aspects of our Academy. - It should be visually engaging, using a mix of graphics, images and text to maintain the reader's interest. Ideal Skills and Experience: - Proven experience in graphic design, particularly in cr...
I'm in need of a skilled web scraper to update my contact directory. The task will involve scraping public directories for contact details. Key Requirements: - The websites to be scraped are primarily public directories. - The information that needs to be updated includes names and titles, phone numbers, and email addresses. This is a one-time update. Ideally, the freelancer should have experience in web scraping and data management. Proficiency in Python, BeautifulSoup, or similar web scraping tools is a plus.
I need a script that scrapes the site for PDF files, downloads them and saves them to my S3 bucket. The script only needs to run once, and there are no filtering criteria for the PDFs to be downloaded. Ideal skills and experience: - Proficient in Python or similar programming languages - Familiar with web scraping frameworks like Scrapy or BeautifulSoup - Knowledgeable in AWS S3 for file storage - Experience in working with PDF files
I'm looking for a Python expert to scrape restaurant data from the first page of the Lieferando website. The data fields I need include: - Restaurant Name - Cuisine Type - Number - Address The scraped data should be saved in a CSV format. Please note, I only need the code file, not the data itself. Ideal Skills: - Proficient in Python - Experience with web scraping - Knowledge of data handling in Python - Familiar with saving data in CSV format Please ensure that the code is efficient and well-commented for future understanding.
I'm looking to develop an Arduino-based robotics project with a specific focus on creating an educational robot. This robot will be specifically designed to teach coding. Key Responsibilities: - Design and create a functional robot using Arduino - Implement features that faci...focus on creating an educational robot. This robot will be specifically designed to teach coding. Key Responsibilities: - Design and create a functional robot using Arduino - Implement features that facilitate coding education - Ensure the robot is user-friendly and suitable for educational purposes Ideal Skills: - Proficiency in Arduino programming and robotics - Experience in creating educational tools or robots - Strong understanding of coding principles - Ability to make complex concepts accessibl...
We are developing Trademark management software. For that we needed data of all trademark applications filed on Indian trademark website of government of India. But due to lack of time, we bought data of 67.50 trademark applications filed and updated that in our software. Now, we want you to develop scrapper: i. that can update data and documents of existing 6.75 million trademark stored on aws server, and ii. that can scrap all data and document of newly filed trademark application, which are not in our database. Watch for understanding. --------------------------------------------------------------------------------------------------------------------------- For your knowledge: 1. Our SaaS is hosted on EC2 server of AWS 2. Data is hosted on RDS
We are developing Trademark management software. For that we needed data of all trademark applications filed on Indian trademark website of government of India. But due to lack of time, we bought data of 67.50 trademark applications filed and updated that in our software. Now, we want you to develop scrapper: i. that can update data and documents of existing 6.75 million trademark stored on aws server, and ii. that can scrap all data and document of newly filed trademark application, which are not in our database. Watch for understanding. --------------------------------------------------------------------------------------------------------------------------- For your knowledge: 1. Our SaaS is hosted on EC2 server of AWS 2. Data is hosted on RDS
