Web scraping job python jobs

I need a seasoned developer to create a web scraper that will extract product details and pricing from five specific websites. Key Responsibilities: - Develop an automated web scraper for five selected websites. - The scrapers should be triggered in 6-hour cron routines hosted on Amazon AWS. - Store the extracted data into a PostgreSQL database, also hosted on AWS. - Ensure the data is formatted in JSON. Ideal Skills: - Proficient in web scraping, ideally with experience using AWS. - Strong knowledge of PostgreSQL and JSON. - Previous work with data extraction from eCommerce websites would be a plus. I look forward to your bids!

I'm in need of comprehensive data from Google Scholar for a personal project. The specific data points required i...required include: - Article metadata: This will help me understand the context and relevance of the articles. - Citation counts: This will provide insights on the impact and reach of the articles. - Author profiles: This will assist in identifying key contributors in the field. The data should be delivered in Excel format. Ideal skills for this task include: - Proficiency in data extraction and web scraping - Familiarity with Google Scholar - Expertise in data organization in Excel. Experience in handling academic data and conducting market analysis would also be advantageous. Please ensure you can deliver the data in a timely manner as this is a pres...

I'm looking for a straightforward Python script that can scrape text posts from Facebook groups I'm a member of. The primary purpose for this is data analysis, and I would like the scraped data to be delivered in a CSV file. Key requirements: - Proficient in Python, with experience in web scraping - Familiarity with Facebook's structure and privacy considerations - Ability to code a solution that filters for text posts only - Can provide the data in a well-structured CSV format This project is ideal for someone who can deliver a reliable and efficient scraping tool, and understands the importance of ethical scraping practices. Please include examples of similar projects you've completed in your bid.

I'm looking for a skilled Python developer with extensive Django experience to build a new web-based security application. Key Features: - The application will primarily focus on security, thus expertise in security-focused programming is a plus. - One of the core features of this application will be security audit logging. This will require a deep understanding of how to create, implement and manage logging systems within the context of security. Ideal Skills: - Proficiency in Python and Django is a must. - Experience in building web applications, particularly security-based ones, will be highly regarded. - Strong skills in creating and managing security audit logging systems. - Knowledge of user authentication and authorization mechanisms will be benefi...

I'm looking for an experienced developer to set up a Telegram bot for me based on a prompt generated via ChatGPT. The bot will be designed to handle a variety of task...(sending messages and media) Content Delivery: The bot will need to send a mix of text messages, media files (including images, audio, and video), as well as links and attachments. Ideal Skills: - Proven experience in Telegram bot development - Familiarity with ChatGPT and other AI tools - Strong understanding of Telegram's features and capabilities - Excellent programming skills, particularly in Python or Node.js The right freelancer will have a strong background in bot development and a keen understanding of user interaction and content delivery. I'm looking for a reliable professional who can br...

...Engineer/Full Stack Developer with extensive knowledge and experience in database structuring and implementation on AWS. The project revolves around a financial platform, necessitating the design and implementation of a robust ETL (Extract, Transform, Load) pipeline for our data warehouse. Key Responsibilities: - Creating the ETL pipeline - Data extraction primarily from vendor APIs with occasional web scraping - Data loading to various databases Ideal Skills: - Strong expertise in AWS and cloud-based database implementation - Proficiency in designing and optimizing ETL pipelines - Experience in integrating vendor APIs - Knowledge in database structuring and optimization Good to Have: - Proficiency in AI and prompt engineering Please note that while the specific databa...

I'm looking for a Python developer who can build a system that detects phishing websites based on their URLs. The system will be fed with data from a provided dataset () containing URLs and their labels (legitimate or phishing). Key Responsibilities: - Develop a phishing detection system that can classify URLs as either legitimate or phishing. - Implement the system for batch processing only, as real-time checking is not required. The ideal candidate will have: - Extensive experience with Python - Previous work in machine learning or data classification - Ability to work with and analyse large datasets.

Hello, i need an expert in NLP,python,and ML To apply sentiment lexicon on Dataset and add basic features to it

I need an expert in python,ML, and NLP

I need a Python developer to integrate a Telegram bot with Python code that will execute predefined terminal commands. The system should take messages which are broadcasted to the bot and execute the corresponding command. Key Requirements: - Python programming skills - Experience with Telegram bot development - Familiarity with terminal commands - Knowledge of MySQL for querying The primary goal of this project is to automate the execution of specific tasks via the Telegram bot. The user will interact with the system by sending MySQL queries, which the bot will interpret and respond to. The ideal freelancer for this project should be able to help me with the following: - Executing predefined commands - Using MySQL queries to trigger these commands - Ensuring the sys...

I'm seeking a proficient Python developer to create a 3D volume-packing optimizer program. This program is aimed primarily at packing mixed shapes primary cubes and cylinders, with a focus on both minimizing unused space and maximizing stability. Key Features: - The program should efficiently pack cubes into a designated volume, no typical use, can have varied applications - It should balance between minimizing unused space and maximizing stability, ensuring packed items are secure and space is used efficiently. - Show time taken to pack and Total weight. Expectations: - I need a detailed explanation of each step and line of code. This is critical for my understanding and future modifications. - Code should be easy to understand an not overcomplicated preferably (degree lev...

I'm in need of a budget-friendly Python scraper. who can create script for cheap budget. i want to build long term relationship with him

I need a professional who can help me with lead scraping. The primary source for the leads has not been determined yet, so a good understanding of various platforms and their potential for lead generation will be beneficial. Ideal Skills: - Proficiency in data scraping tools and software. - Experience with various lead generation platforms. - Knowledge of data analysis and processing. - Strong attention to detail to ensure data accuracy. Please note, the specific data to be collected from each lead is yet to be decided, so flexibility and creativity in suggesting valuable data points will be appreciated.

I'm looking for a freelancer who can scrape a public website for contact details. The information I need includes email addresses, phone numbers, and names. This is a one-time project. Ideal Skills and Experience: - Proficient in web scraping techniques and tools - Prior experience in data extraction - Attention to detail to ensure data accuracy - Understanding of privacy laws and ethical standards in data collection This is the website: We need the following information: - Name - Adress - E-Mail - Phone number You find an example in the attached Excel file. Please add all other contacts in the same manner.

...in need of an experienced Python developer to assist with debugging and enhancing a Windows desktop application that manages cloud instances. The application is built using Python, Tkinter, and AWS SDKs (boto3). The areas of focus will primarily be the application logic (Python code). Your role will encompass: - Identifying and fixing bugs within the Python code - Enhancing the application's overall performance - Possibly improving aspects of the user interface (Tkinter), depending on your expertise and suggestions While specific cloud services or features in AWS have not been highlighted, familiarity with EC2 instance management, S3 storage operations, and Lambda functions would be beneficial. Ideal skills for this project include: - Proficiency ...

1. Position 1.1 My start date will be 14th January 2025. 1.2 My employment will be a full time capacity. 1.3 The duties of this position are to house architecture, building architecture. I will be required to perform these duties, and any other duties the employer may assign to me, having regard to your skills, training and experience. 1.4 I will be required to perform my duties remotely. 4. Ordinary hours of work 4.1 My ordinary hours of work will be a minimum of 40 hours per week, plus any reasonable additional hours that are necessary to fulfil my duties or as otherwise required by the employer. 5. Remuneration 5.1 My salary is $1700 USD per month. 5.2 The payment will be preceded by the 1st of the month. 5.3 Payment will be proceeded through Freelancer.com based on hourly contract wi...

I'm seeking a developer to create a script or browser extension for me. This tool should help me, with only view access to a Shopify backend, to scrape order details at scheduled intervals. Key Requirements: - Acc...view access to a Shopify backend, to scrape order details at scheduled intervals. Key Requirements: - Access the order tab and individual orders - Copy specific information: customer name, number, products, address, city or state Data Handling: - The scraped data should be saved in a CSV format Ideal Skills: - Proficient in developing Chrome extensions or scripts - Previous experience with web scraping - Knowledge of data handling and CSV format Please note, this is a scheduled task, so the tool should be able to operate at predetermined intervals withou...

Full-Stack Web Developer for GPT Application Location: Remote Contract Duration: Approximately 5-6 months (initially commit to 100-200 hours of work) Description: We are seeking a proactive and self-motivated Web Developer to build a web interface for our upcoming GPT application hosted on Azure. The ideal candidate will possess a strong understanding of both front-end and back-end development, with a solid foundation in web technologies. Mandates: ***Experience working in Azure microservices environment. Our environment is expected to contain: **Frontend: React, JavaScript, HTML, CSS (Hosted on Azure Web Apps microservices) **Backend: Python (FastAPI) on Azure Web Apps **Database: Cosmos DB (NoSQL) Key Responsibilities: Develop a user-...

I need a Python Telegram bot that receives TradingView alerts and sends them to my Telegram channel or chat. The bot should also send a chart (image or link) along with each alert. It should have bot detection bypass for TradingView.

Project Details £10.00 – 360.00 GBP I am seeking a talented freelancer with strong web scraping skills, preferably in Python, to assist with a project involving two specific websites initially. There is potential for more sites in the future. I will provide the specific data fields that need to be extracted. Key Requirements: - Proficiency in web scraping and/or Python. - Familiarity with MS SQL Server databases is a plus, but not essential. - Ability to extract data efficiently and effectively. - Understanding of necessary security measures, including captcha integration if required. - Capability to deliver quality work quickly, as this project is a priority and needs to be completed ASAP. This project could evolve into a long-term p...

I'm in need of a data extraction expert to help me gather information from a specific website. The dataset contains approximately 200,000 entries, and I'm looking to filter for contacts from a specific location. Key Requirements: - Export data fields: Name, Email, Designation, Company Name, - Data to be delivered in Excel format - Experience with web scraping and data extraction - Ability to filter data by specific location Compensation: I can offer 20-30 paisa per contact.

I'm looking for a Python expert to Scrap a website for me. I will share the website and more details over chat. Thanks in advanced!

...freelancer with Python Knowledge to provide in-depth tutorials tailored to my learning needs as shown below. The ideal candidate should be able to explain complex concepts in a clear and understandable manner, and create engaging, hands-on exercises. Only Freelancers that can work remotely are required. Topics include: Introduction to Data Analysis - CRISP-DM reference model - Data Analytics workflows - Distinction between Artificial Intelligence, Machine Learning, and Deep Learning - Roles and requirements of Data Engineers, Data Scientists, and Data Analysts in organizations Review of Python Fundamentals - Data types - Functions Data Analysis - Key Python modules for Data Analytics (NumPy, Pandas) - Data preparation process - Data mining a...

Graph Optimization Problem: Selecting Minimum Nodes for Coverage (Java Implementation)

I'm seeking a professional email scraper who can help me collect email addresses from specific social media platforms, for a Rock Band that have 969k Facebook followers and 154k on followers on Instagram. I have recently used the services from someone here and was supplied with a completely fake list, he gave me 95.5% and I couldn't find one single known 'fan' email. I run a website and social media for ex members of that band and I already have 1.5k emails using targeted Facebook ads for that band that have since logged in as members to our website. So if you're saying you can provide 70% success rate, I would anticipate to find a similar % rate when I check your list, I hope that sounds reasonable, fair and understandable. Look forward to hearing from you.

Project Title: Python Flask & JavaScript Developer Needed to Integrate UI Module into Existing Web App Project Description: We are looking for an experienced Python Flask and JavaScript developer to help integrate a new UI module into our existing web application. The task involves developing a new module/page that will follow an already existing UI design. The module will retrieve its data from an existing backend API, which is already used by the current app. Requirements: - Develop a new UI module/page in the existing web application. - The new UI should replicate the design of an already existing page in the app. - Integrate the backend API (already in place) to fetch data for the new module. - Ensure the new UI is fully functional and properly...

...or React, we're want to use MongoDB for data storage, and AWS to host our Python application. The project requires exceptional knowledge in: Python, FastAPI, NextJS/React, MongoDB, CCXT, API, Websockets and an expert level understanding of the API docs of the following exchanges: Bybit, Bitget and OKX. Key requirements: - Fixing backend functionality and API issues - Implementing frontend - Enhancing Error Handling, Data Synchronization, Connection Stability, Security and AWS efficiency - Reviewing and Enhancing our code. At the end of the project, we would need a tutorial on how to set everything up on aws. Skills and experience: - Extensive experience with NodeJS, NextJS and MongoDB - Deep understanding of Python, FastAPI, CCXT, API and Websockets - Expert...

I need a skilled Python programmer to help me automate the order placement on Interactive Brokers. Key Requirements: - Automate the placement of Market orders, Limit orders, and Stop orders - Strong proficiency in Python - Experience with Interactive Brokers platform - Knowledge about different types of trading orders Ideal Skills: - Python programming - Trading experience - Interactive Brokers expertise - Order placement automation I am looking to hire a pythan trading expert, You need to automate trade in Shoonya Broker Account, Automate the buy sell order, It has lots requirment I have attached excel file to fetch and update data, and automate trade, I can choose any interval, It need to fech candle data, more detaiil i wll give if you can provide result wit...

I'm seeking an expert in Apify for web scraping and for process automation. The main focus of this project is data extraction and reporting, specifically targeting market trends data from various platforms. Key Responsibilities: - Utilize Apify to scrape relevant market trends data from e-commerce websites, social media platforms, and news/financial sites. - Implement to automate the data extraction process, ensuring efficiency and consistency. - Generate comprehensive reports based on the extracted data. Ideal Skills and Experience: - Proven experience in web scraping using Apify. - Proficient in using for process automation. - Strong understanding of market trends data. - Excellent data analysis and reporting skills. - Ability to work with diverse pl...

Project Title: Create ...Installation/setup steps. • Configuration/customization options. • Troubleshooting and maintenance tips. 3. Support for initial setup and testing (if needed). Skills Required: • Experience with API integration (especially Marsello and WhatsApp APIs). • Knowledge of messaging API platforms (e.g., Twilio, Ultramsg, etc.). • Proficiency in a programming language suitable for the integration (e.g., Python, Node.js). • Strong problem-solving and debugging skills. Timeline: • 1-2 weeks max Additional Notes: • Please include examples of similar integrations or relevant projects in your proposal. • Indicate which WhatsApp API platform you recommend and why. • Let us know if you foresee any challenges or...

I'm seeking a dedicated virtual assistant to streamline my job applications and assist with managing ad campaigns across multiple platforms. Key Responsibilities: - Job Applications: - Crafting compelling resumes and cover letters - Identifying suitable job opportunities - Completing application forms - Ad Campaign Management: - Overseeing campaigns on Google Ads, Facebook Ads, and LinkedIn Ads - General Advertising Tasks: - Content creation - Conducting market research - Performing analysis on campaign performance Ideal Skills: - Strong writing and communication skills for job application materials - Experience with Google Ads, Facebook Ads, and LinkedIn Ads - Ability to create engaging content - Proficient in market research and...

...script to buy and sell tokens with Python. (Python code to modify) Example token to buy "oraim8c9d1nkfuQk9EzGYEUGxqL3MHQYndRw1huVo5h" I have the RPC_ENDPOINT = "CHAINSTACK_NODE" <API Key> Key Requirements: - Modify the existing python script for automated buying and selling tokens. - Implement transaction logging within the script for tracking purposes. Ideal Skills: - Extensive experience with Solana platform. - Proficient in scripting for token trading. - Prior work with creating automated trading scripts. - Capable of implementing logging within scripts. Only wtih python Solana version 0.36.2

I'm seeking a skilled web developer to create a comprehensive job advertisement platform. The website will cater to job advertisements of all types - full-time, part-time, freelance, and contract work. Key Features: - A user-friendly interface for posting job advertisements, accessible by both employers and recruitment agencies. - An efficient categorization system for different job types. - A robust back-end to handle high traffic and numerous job postings. - Database with CVs and profiles, after the application. Ideal Skills: - Proficiency in web development, particularly in creating interactive and user-friendly platforms. - Experience in building job-related websites will be a significant advantage. - Strong knowledge of b...

I'm in need of a proficient Python developer with extensive experience using Beautiful Soup, Scrapy, and Requests for a web scraping task. Key Requirements: - Expertise in Python and web scraping libraries such as Beautiful Soup and Scrapy - Proficient in using Requests for HTTP requests - Comfortable working with public websites - Capable of extracting diverse data types including text, images, and audio Task Overview: - The project involves the extraction of data from a public website. - The specific data types to be extracted include text, images, and audio. Ideal Candidate: - A keen attention to detail is crucial for this task, as is the ability to navigate and extract data from potentially complex web structures. - Prior expe...

Job Title: Automation Test Consultant Location: Pune Experience Level: 10+ years Joining: immediate Joiner Working mode : Hybrid Company Description: Reval Analytical Services () is an affiliate of Virtua Research Inc. () Virtua is a US-based Fintech SaaS company providing business analytics and forecasting tools to public and private companies as well as institutional investors. Reval is a 20-year-old company focused on designing and implementing proprietary SaaS solutions and applications for market and competitive analysis. We are leaders in our product categories and our customers include many of the biggest listed companies in the U.S Job Description: We are seeking an experienced Automation Test Consultant to consult our team and lead efforts

I need a Python developer to assist with updating an API URL for product feeds on my Shopify store. This task is solely focused on the API URL change, and I have all the necessary details and credentials ready. Key Responsibilities: - Update the API URL for my Shopify store's product feeds. Ideal Candidate: - Proficient in Python with experience in Shopify API. - Quick and efficient at executing straightforward tasks.

I'm looking to develop a Telegram bot that automates responses to messages and sends links as notifications. Key Requirements: - The bot should be capable of sending predefined responses to incoming messages. - It should also be able to send links or URLs as notifications. Ideal Skills: - Proficient in Python or Node.js, the most common languages for Telegram bot development. - Experience with Telegram Bot API. - Prior experience in developing bots that handle message automation and sending notifications.

Senior Full Stack Engineer (Python + Full-Stack (JS) Developer) About the Role We are actively seeking talented developers proficient in Python & Javascript/Typescript to join our ambitious team dedicated to pushing the frontiers of AI technology. This opportunity is tailored for professionals who thrive on developing innovative solutions and aspire to be at the forefront of AI advancements. You will work with different companies in the US who are looking to develop cutting-edge commercial and research AI solutions. Job Responsibilities: Write readable, reusable, and maintainable code for high-quality software development. Participate in code reviews to ensure adherence to standards for code quality and best practices. Develop web applications using modular...

grocery stores,Surpermarkets ,conviniance stores Fresh Produce wholesellers Fresh Produce importers Catering Companies Food Processor Wine producers Dairy product manufacturer Meat processor Fish processor

I need a freelancer to scrape 30,000 records of contact information from a provided URL within 48 hours. The information will specifically consist of names, email addresses, phone numbers, and mailing addresses. The final output should be in an Excel format. Ideal skills and experience for the job include: - Proficiency in web scraping - Experience with Excel - Attention to detail - Ability to meet tight deadlines

I am currently engaged in a research and development-focused robotics project and require expert assistance with integrating both Raspberry Pi and Modbus with a Panasonic servo. The primary component of this project revolves around programming with Python. Ideal candidates for this project should possess: - Extensive experience in robotics and R&D - Proficiency in integrating Raspberry Pi and Modbus with Panasonic servos - Advanced skills in software development - Ability to troubleshoot if necessary

...Requirements: Frontend Development: Proficiency in HTML5, CSS3, JavaScript, and modern frontend frameworks (React, Vue.js, or similar). Experience with responsive design using CSS frameworks like Bootstrap or custom CSS. Knowledge of charting libraries (such as TradingView, Highcharts, or ) to implement trading charts. Backend Development: Proficiency in server-side development (Node.js, Python, PHP, or similar). Experience with database management systems (MySQL, PostgreSQL, or MongoDB). Implement secure user authentication and authorization (JWT, OAuth, or similar). Experience in integrating APIs for live market data (Cryptocurrency, Forex, etc.). Tools and Technologies: Version control using Git. Knowledge of Docker or similar containerization tools (optional but preferred)...

I'm in need of a web scraping expert with experience in extracting product information from manufacturer websites. Key Requirements: - Scrape product names and descriptions - Scrape product specifications Ideal Skills: - Proficient in Python or similar scraping tools - Prior experience with manufacturer websites - Good understanding of product specifications and descriptions Please provide examples of similar projects you've completed.

I'm seeking a seasoned Python professional to develop a mobile application that abbreviates characters into a short form. This project is not just a one-off, but a long-term collaboration prospect. Key requirements: - Develop a mobile app GUI - Ensure the app can convert short form characters back to long characters - Create a publicly accessible frontend Ideal skills: - Proficient in Python and web development - Expert in GUI design - Experienced with APIs - Knowledgeable in encryption and decryption algorithms Please note: - I will provide more details once we reach an agreement - No brokers or middlemen, please. Only genuine developers allowed.

I'm in need of a professional who can extract data from a corporate website and compile it into an Excel spreadsheet. Key Requirements: - Extract data from a corporate site. - Data includes: Shopping Centre Name, Street Address, Suburb, State, and Post Code. - Focus on all store locations in New South Wales (NSW). - Use web scraping techniques for data extraction. Ideal Skills: - Proficiency in web scraping. - Experience with data extraction from corporate sites. - Excel spreadsheet management skills. - Familiarity with New South Wales geography is a plus.

...rough MVP to an evantually a launched site. The primary goal of the site is to enable easy access to data through visualizations and dashboards. This project involves completing a basic freemium model membership site that lists service offerings. Key Responsibilities: - Develop a freemium model membership site - Integrate role based auth system using 3rd party db auth system - Integrate listing scraping system using 3rd party scraper - Create a document generation feature - Establish a process management system (calendaring, scheduling) - Implement data processing and taggging system Ideal Skills: - Experience in developing membership sites, particularly freemium models - Proficiency in leveraging listing systems and document generation features - Knowledge of process managemen...

I'm a seasoned programmer with a specialization in Python and Java. I'm on the lookout for exciting projects that require my expertise and passion for transforming ideas into functional code. - Project Types: I am particularly interested in jobs that involve Python and Java, but I'm open to other possibilities as well. My skills encompass web development, data analysis, and scripting and automation. - Web Development: I can handle both front-end and back-end tasks, making me a suitable candidate for full-stack web development projects. - Domain Flexibility: I can comfortably work within the realms of web development, data analysis, or software development. If you're seeking a programmer who brings innovation and results, let...

I am currently working on a GitHub Python automation repository designed for web automation, specifically for automated testing. Unfortunately, the script is breaking a loop and causing the project to malfunction. I'm looking for an experienced Python developer who can help me troubleshoot and fix the issue so that the project can run smoothly again.

I'm in need of a proficient freelancer or a professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company pr...Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you're not in agreement with the budget or are unable to fulfill the requirements, kindly refrain from...

...specific users from trading. Update real-time trading data for the candlestick chart. User Management: View user activity logs, including login times and trading actions. Suspend or delete user accounts. Security Measures: Implement secure authentication (2FA for added protection). Encrypted communication (SSL/TLS) and secure API integration. Regular backups and audit trails for user activities. Job Responsibilities: Front-End Development: Design a modern, dark-themed, responsive UI/UX similar to GEWE Gold. Develop an interactive trading chart (candlestick) using libraries like TradingView or Chart.js. Create secure login, registration, and user profile pages. Implement a chat system for customer support. Back-End Development: Build a secure admin dashboard to manage users, tr...