Website scraping with python using beautifulsoup and scrapy jobs

I need someone to help me download images from various websites. I have a list of URLs that contain images I need to save. I have a list of 800 URLs of listings. Each listing contain 19-20 images. I need all images saved in JPEG format in Main folder named photos & each link in sub ...the photos by name 1,2,3,... & make sure that the 1st image is the cover photo of that listing. In total I expect 14-15k images. I have tight budget & deadline. Let me know if this is possible programmatically. Budget 30$ MAXXXX Requirements: - Download images from provided URLs - Save all images in JPEG format Ideal skills: - Familiarity with web scraping and image downloading - Attention to detail to ensure all images are downloaded - Experience with file manageme...

I am seeking a dedicated, full stack Python/Django developer for a long-term partnership focused on web application development. The ideal candidate will have extensive experience integrating with React, and will be able to implement robust CRM-style user authentication systems. Key Requirements: - Full stack expertise in Python and Django - Proven experience in web application development - Proficiency in integrating with React - Knowledge and experience with CRM-style user authentication - Ability to deliver high-quality, maintainable code - Ready for a long-term collaboration Skills and Experience: - Python, Django - Full stack development - Web application development - React integration - CRM user authentication s...

I'm looking for a data scraping expert who can help me gather information on potential internship candidates in Canada. Ideal Skills and Experience: - Proficient in data scraping techniques and tools. - Familiarity with various platforms such as job boards, university websites, and social media. - Ability to compile comprehensive data sets including contact information, educational background, work experience, and email addresses. I need a one-time collection of 200-300 contacts. This project will be a stepping stone towards potentially more extensive future collaborations if the data is of high quality and the process is efficient.

I need a skilled web scraper to gather data and images from residential real estate listings. The specific data fields I need are: - Property address - Price - Number of bedrooms Experience with web scraping and data processing is crucial. Please provide examples of similar projects you've worked on.

I am looking for european freelancer to avoid time zone difference. I need to scrap thousand images and rename it by name and date of creation

...Distributed Systems -Design and implement complex, distributed platforms for storing data, scaling parallel algorithms, orchestrating containers etc -Analyze fault-tolerance and high-availability issues, performance and scale challenges, and solve them Pinpoint problems, instrument relevant components as needed, and ultimately implement solutions -Architect and implement containerized applications using Docker, facilitating ease of deployment and scalability -Ability to design high availability systems with fast data processing API -Design and implement robust backend services in Python, Go and Rust to support front-end features -Debug application issues across the stack (frontend and backend...

...are looking to develop a cutting-edge real estate platform tailored for golf course properties. This website will offer AI-driven property descriptions, integrate immersive golf course virtual tours, and provide unique real-time data, making it the top destination for golf enthusiasts interested in buying homes on or near golf courses. The project will require building a user-friendly front-end and robust back-end with AI-powered features, multimedia integrations, and real-time data. Complete website, meta tagged and SEO ready, APP for Android/iOS Project Requirements Breakdown: Core Features of the Platform: 1. AI-Powered Property Descriptions Objective: Automatically generate dynamic and personalized descriptions for golf cour...

I'm experiencing functional bugs with my FastAPI application's API endpoints. The bugs result in unexpected errors, and they need to be addressed to restore proper functionality. Ideal Skills: - Proficient in FastAPI and Python - Experience with debugging and troubleshooting API endpoints - Familiarity with implementing functional enhancements in FastAPI applications - Good understanding of API design and development Please only bid if you can demonstrate relevant experience and have a proven track record of successfully fixing bugs in FastAPI applications.

I need a skilled freelancer to scrape product information from a specific website. The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and images, and product specifications and reviews. The ideal candidate should have experience with web scraping tools and techniques, ensuring clean and organized data output in CSV format. Key Requirements: - Web scraping expertise, preferably with Python - Attention to detail for data accuracy - Ability to deliver results in a timely manner - Providing the code used for the scraping task

I need help with web scraping from a specific e-commerce website. The goal is to gather comprehensive data for product analysis. Key Data Points: - Product details - Pricing information - Stock levels - Minimum order quantities - Delivery times - Specific product information as detailed on the sites The extracted data should be delivered in an Excel format. Ideal Candidate: - Proficient in web scraping tools and techniques - Excellent data analysis skills - Familiar with e-commerce platforms - Able to deliver clean, well-organized data in Excel Looking forward to your proposals. The website would be the following and we would like to see the details for all manufacturers listed:

I'm seeking a skilled freelancer experienced in crawl4ai web scraping to assist me with data extraction from various e-commerce sites. Specifics of the project: - I need detailed product information, pricing data, and customer reviews extracted from these sites. - The purpose of this project is to gather comprehensive data for analysis and potential application in AI. Ideal Skills: - Proficiency in web scraping tools and techniques. - Experience in extracting data from e-commerce sites. - Ability to deliver clean, organized data. Please provide examples of similar projects you've completed in your proposal.

I'm looking for a skilled developer to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and export them into a CSV file via Excel. Key Requirements: - The script needs to operate automatically, without manual intervention. - It should meticulously gather: - Photos and text - Price and description - Category and SKU Ideal skills include web scraping, Python or similar programming language expertise, and experience with data handling in Excel and CSV formats. Please ensure your proposal includes relevant past projects, as well as your approach to this task.

...developer with a strong focus on frontend and backend development, specifically on AWS. The ideal candidate should be well-versed in Python and have a solid understanding of task automation in the derivatives market. Key Responsibilities: - Implementing a React-based frontend - Developing a FastAPI backend on AWS - Automating tasks related to data processing and workflow Skills and Experience: - Proficiency in Python, especially for task automation - Extensive experience with React for frontend development - Expertise in FastAPI for backend development - Strong understanding of AWS services - Prior experience in the derivatives market is a plus - Proficiency in managing and optimizing databases, including SQL and No...

...Stock and Option Trading in NSE and BSE Objective: To develop an automated trading system for stock and options trading in NSE (National Stock Exchange) and BSE (Bombay Stock Exchange) based on our proprietary trading methods and rules. The system should integrate with multiple brokers, execute trades as per predefined conditions, and provide real-time analytics and reports. Scope of the Project: Trading Strategies: Automate trades based on the following methodologies: Candlestick Patterns: Identify and act on specific candlestick formations. Fibonacci Levels: Recognize retracement and extension levels for trade entries/exits. RSI (Relative Strength Index): Execute trades based on overbought/oversold conditions. Ell...

...application developer who is proficient in PHP, Python, Ruby, etc... Design: - I do not have a design for the web application and will need assistance in creating one. Functionality: - The desired functionality of the web application is user registration and authentication, e commerce, geo location, AI YOU MUST PLACE CODE 184 in your opening sentence to be considered for this. Code is used to differentiate between automatic bids (which will be immediately ignored). Skills and experience required: - Proficiency in PHP, Python, and Ruby - Experience in designing web applications - Knowledge of user registration and authentication processes - camera functions on mobile device -image processing - YOU MUST BE FLUENT IN ENGLISH - hone...

I'm looking for a Python expert to write code for training a model to detect weed regions in images, using pre-labelled datasets. Key Requirements: - Python: Proficiency in Python is a must. - Machine Learning: Experience with industry-standard ML frameworks is essential. You can choose between TensorFlow, PyTorch, or scikit-learn based on your preference and expertise. - Image Processing: The project involves the output of segmentation masks of weed regions from the model. Your task will be to develop a model that can accurately identify and segment weed regions in various images. The end result should be segmentation masks that delineate weed regions from non-weed regions in the images. Use guidelines from this github url:

I have a Python script used for monitoring uptime of a specific protocol. It needs some quick tweaking, and would also like to get it to make a DNS change via the Route 53 API (AWS) when the uptime check fails. The script should then revert the DNS change once uptime is restored. Key Requirements: - Tweaking of the existing Python script to improve its functionality and performance. - Implementing a new feature to interact with the Route 53 API. - The script should be able to initiate a DNS change if a failure is detected. Ideal Skills: - Strong proficiency in Python. - Prior experience with AWS Route 53 and API is required. - Excellent problem-solving skills to enhance script performance and functionality.

...generator and industry researcher utilising LinkedIn, ZoomInfo and similar with a focus on the healthcare, fintech, manufacturing, private hospitals, and ecommerce sectors. The project involves gathering key contacts, particularly CEOs/Executives and Department Heads ( CTOs and CISOs) within these industries. Key Responsibilities: - Conduct comprehensive industry research across one of the mentioned sectors with validation via Linkedin / Zoominfo. - Generate 50 leads and gather key contacts, focusing on top level executives and department heads in healthcare organizations, private hospitals and fintech firms. You could choose a market and go from there, 200-5000 employees enterprises must be targeted. - Deliv...

I'm in need of expert assistance with the Build stage of my Azure pipeline which utilizes Python. Ideal skills and experience for the job: - Proficiency in Azure pipelines, particularly the Build stage. - Extensive knowledge and experience with Python. - Previous experience in setting up, monitoring, maintaining, and optimizing Azure pipelines. - Excellent troubleshooting skills.

I'm looking for an expert Odoo 17 Developer with Python experience. Need to add 1 feature and fix 1 issue Put 'Pink' in your bid to know you have read Thanks

I need a da...industry-specific websites for over 500 contacts. This task involves extracting specific fields and updating the information through internet searches and LinkedIn profiles of the company and people working in that company , if available. The ideal candidate will have experience in data collection, web scraping, and a knack for thorough research. Mandatory Fields: - Company Name - Email ID Mobile Number Important but not mandatory: - Contact Person - Designation The primary source will be an industry-specific site, and the selected freelancer will need to find other details and verify the Email IDs and Mobile numbers through other online sources. Familiarity with LinkedIn is a plus. Please note, the focus is on...

Technical Specification for Developing a Customizable HFT Trading Bot Project Goal To develop a high-frequency trading (HFT) bot for the futures market that analyzes order book imbalances and market orders, automatically opens positions, and manages them based on user-defined settings and parameters. Core Functionality 1. Order Book Analysis - Process data for 20 levels of the order book. - Calculate the overall imbalance between buy and sell orders. - Adjustable imbalance threshold (default: 60%). 2. Market Order Analysis - Assess activity of buyers and sellers using market orders. - Adjustable time interval for analysis. - Threshold values for market order activity to confirm signals. 3. Combined Analysis - Ensure two co...

I'm seeking a professional with experience in html layout programming for Current RMS Hire Software. The job involves customizing the layout of several templates including invoice templates, quote templates, and delivery notes templates. Key Responsibilities: - Implement my pre-designed layouts into the software - Ensure all templates function correctly and are visually appealing The designs for these templates are already completed, so the primary task will be translating these designs into the Current RMS system. The layouts are done using HTML with the software, so familiarity with HTML is a must. Ideal Skills and Experience: - Previous experience with Current RMS Hire Software - Proficiency in HTML - Strong attention to d...

...names. I need a Python script that will integrate with an LLM API (like ChatGPT) to process this file. The script should send the domain list to the LLM with a prompt to identify potential phishing domains. The flagged domains returned should be saved in a file named , with one domain per line. Key Requirements: - Efficient and scalable solution for daily use. - Clear documentation for seamless deployment and usage. - Ability to handle large files through batch processing, respecting the API's rate limits. Please note that I will not provide an API key, so ensure to include this cost in your bid. The ideal freelancer for this project should have: - Strong experience in Python. - Familiarity with LLM APIs. - Proven track reco...

...markdown files full of math exercises in French and folder with their answer keys. I would to process them to generate new math exercises with answer key. To do so, we can use a chatbot API like the one from chatgpt. First we need to extract each exercise with its number. For example the first exercise is : Number: "NO2" Exercise: "Si je pense à un nombre, je lui retranche (-12) et je trouve 3. Quel est ce nombre?" Here is the exercise is not well written, so we can use an AI API to rewrite it: Number: "NO2" Exercise: "Si en pensant à un nombre, en lui retranchant (-12), on trouve 3, quel est ce nombre ?" Often there is unnecessary content between the exercises that needs to be removed. Each exercis...

...well-designed and efficient, with the following key features: Spoofing Capabilities: Ability to spoof sender names and email addresses. Header Customization: Support for multiple custom headers in outgoing emails. Link Rotation: Automatically rotate links within email bodies to avoid detection. Sender Name Rotation: Rotate sender names dynamically for each email sent. Performance-Oriented: Must be able to handle high-volume email sending efficiently. Tech Stack: Ideally built in Go, Python, or Node.js for performance and reliability. Requirements: Proven experience with SMTP protocols and email sending systems. Familiarity with email spoofing techniques and header management. Knowledge of anti-detection mechanisms and...

I'm in need of a developer who can create a bot that adds items to a shopping basket based on specific keywords detected in user input. The bot should be able to: - Parse user input for relevant keywords. - Match these keywords with a predefined product catalog. - Add the matched items to a basket and show the total cost. The preferred tech stack for this project is Python or JavaScript. Any previous experience with NLP libraries such as spaCy or NLTK would be considered a strong advantage.

I need a Python expert who can help me develop an automation script for monitoring my databases. Key Responsibilities: - Develop a Python script that can systematically monitor our databases. - Ensure the script can handle various database types. - Implement alerts for system anomalies or irregularities. Ideal Skills and Experience: - Proven experience in Python programming, specifically in creating automation scripts. - Prior experience in system monitoring is a plus. - Familiarity with various database types is highly desirable.

...expert in Django, Python, and Google Sheets API to help automate some tasks. Key Requirements: - Task Automation: Primarily focusing on automating data processing tasks. - Data Transformation & Formatting: This will involve manipulating data into a suitable format for analysis. - Develop an automation script using Python   - Utilize the Google Sheets API to synchronize data for our Django website  Ideal Skills:  - Proficient in Python   - Extensive experience with the Google Sheets API  - Strong background in automation and scripting  - Understanding of data synchronization processes  - Skill in Django is bonus  Ideal Skills: - Proficiency in Python: Essential for...

I'm looking for a Python developer proficient with Zerodha's API to create an algorithm for stock trading. The code should be written in Python 3.8 or newer and is required to handle authentication with the Zerodha API autonomously. The algorithm will monitor Nifty's 750 stocks with a market capitalization exceeding 1000 crore during trading hours (09:15 AM to 03:30 PM). It should execute trades based on a series of specified conditions using various technical indicators. Key Requirements: - The algorithm should check if the current price (1 minute closing) is greater than the 1 Week HMA(30) and less than the 1 Week HMA(44). - It needs to evaluate if both lines of the (1 week MACD(3,21,9)) are below the zero line. - I...

Ideal Skills and Experience: - Proficient in Python or similar programming languages - Experienced in building Telegram bots - Knowledgeable about cryptocurrency trading and exchanges - Familiar with APIs of major crypto exchanges - Excellent problem-solving skills and attention to detail

I need a Python-based solution to convert tabular data from image files into Excel. The solution should include a simple front-end app with specific features. Key Requirements: - The front-end app should allow users to upload image files containing structured data and download the resulting Excel sheet. - The data in the images consists of handwritten format i want data to extracted in specify way numbers are in format of 6688/10 5853/5 and so in . I want numerators should be sorted in one column with title model no and denominator should me in next column with quantity App should have API key as well so that i can integrate ion my existing application the conversion process needs to accurately capture the structure of the data. - Pro...

...setting up a Python-based AI trading bot on a Windows or Linux Amazon server. The bot's code is complete, I just need someone to: - Configure the code and database on my server - Add approximately six API credentials for various systems, including Telegram and BONKbot - Ensure the bot interacts correctly with BONKbot on Telegram The bot is designed to perform automated buy and sell orders based on its checks of selected coins. Ideal skills and experience for this job include: - Extensive knowledge of Python - Familiarity with Solana blockchain technology - Experience setting up trading bots - Proficient in working with Windows or Linux servers and databases - Ability to configure and add API credentia...

I'm in need of a seasoned Data Scraper/Automation Specialist to create a systematic process for gathering data from multiple websites. Initially, this project wi...process for gathering data from multiple websites. Initially, this project will focus on 10 major brands. Key Responsibilities: - Scrape membership information, pricing, opening hours, and other relevant data weekly. - Structure and store this data in Google Sheets for straightforward analysis and historical tracking. - Set up the process so that new brands can be easily added. - Facilitate the assessment of variances within brands and the analysis of seasonal changes. Ideal Skills: - Proficiency in data scraping and automation. - Experience with Google Sheets. - Strong ana...

I'm looking for a seasoned software analyst who can assist with code analysis tasks for our diverse codebase. The primary aim is to enhance the quality of our code across various languages. Key Responsibilities: - Conduct thorough code analysis using SAST - Identify areas for quality improvement Ideal Skills: - Proficiency in code analysis - Extensive experience with Java, JavaScript, Python, and C# - Strong understanding of SAST tools - Excellent problem-solving skills - Ability to communicate findings clearly

I need a skilled Python expert with extensive API knowledge. Integrate a Python script with an API for accurate data conversion. I’ve already completed most of the work, but some adjustments are still needed. Details will be shared with the selected freelancer. I believe this is a one-hour job, and the payment will be $5–10 AUD, depending on the time required

...custom model that will generate Python code based on Vendor online development documentation and our internal best practices. The model should be able to produce code that is 50-60% compliant with best practices. The generated code will need to be compatible with Vendor A's export format. Key Requirements: - The system must be able to run offline. - There needs to be a script that takes a prompt as input, similar to ChatGPT, and returns the corresponding code. - The model will be trained using our examples of finished/exported code, which include scripts, modules, and libraries. Ideal Skills: - Proficient in Python - Experience with machine learning and AI model development - Familiarity with Palo Alto o...

...day (or per night). - You will help me design, code, and develop an IoT product using MicroPython running on an ESP32 microchip. - You do *not* need any experience with microcontrollers, electronics, electrical engineering, mechatronics, Arduino, PCB, circuit design, or Python. - If Freelancer.com prevents you from bidding on this project or if you want to avoid “spending” one of your Freelancer bids you can apply "passively” for this project by pasting "MicroPython_ESP32_11_September_2019" into your Freelancer profile. Please see the section below in this posting called *** APPLYING "PASSIVELY" *** for more information. *** LOCATION *** You must live the Western Balkans in one of the following countr...

Hello, My primary objective is to obtain a formula that replicates the calculation of the "BOT Handicap" line, similar to how it is implemented on Dropping Odds for basketball games. () I would prefer the solution to be provided in Python, but I am open to implementations in other programming languages as well.

Python Aliceblue api Aws or azzure deployment Algotrading Testing Google sheets The code is already written y me 80 % of work in code is done I need pro help in testing indetail, fix bugs and make sure it runs as intended. Make sure all testing is done with old features and also new onces added....deatiled testing is expected...need to deploy in local and cloud aswell ( full assistance in it )

...Description: We are seeking a talented and passionate AI Engineer to join our team and contribute to the development of an innovative, data-driven app. This app leverages advanced AI technology to provide accurate and objective insights, revolutionizing the way data is analyzed and utilized. The project offers a unique opportunity to work on cutting-edge technology with real-world impact. Key Responsibilities: Develop and integrate AI models to support the app’s core functionality. Implement data retrieval and processing features, including API integration. Collaborate on the design and implementation of user-friendly, AI-driven features. Ensure the app is technically robust, scalable, and efficient. Requirements: Stro...

I need to generate an MFA system using TOTP, with existing users. The process is as follows: they enter the LOGIN page with username and password, then I need two-factor so they can continue if everything is correct. The system is developed in PHP/MYSQL without any type of framework. I only require MFA/TWO-FACTOR to validate as a second step, otherwise they will not be able to enter. Third-Party applications can be used. I need the system to be secure for validation The budget can be variable and we could adapt if we have a good proposal, if you have a demo, send it

I'm in need of a Python expert who can maintain my web scraping code. The code is currently set up to collect data from various news websites on a daily basis. Key Responsibilities: - Ensuring the scraping code runs smoothly and efficiently every day. - Troubleshooting any issues that arise with the code or the websites being scraped. - Implementing updates to the code as needed, such as changes in website structure or scraping requirements. Ideal Skills: - Strong Python programming skills. - Experience with web scraping, particularly from news sites. - Problem-solving skills for troubleshooting code issues. - Ability to adapt to changes in website structures. Your expertise will help ensure consistent ...

...patient calls, book/reschedule appointments, integrate with major dental management software, and port our existing business phone number to a VoIP system. ? This is an urgent project with a hard deadline of 2 weeks. Only apply if you have pre-built AI voice solutions or the ability to execute this quickly. ? How to Apply ? Submit your proposal with: ✅ A working demo or past AI voice assistant project. ✅ Your approach to integrating with dental software (Curve Hero, Dentrix, Open Dental, etc.). ✅ Your VoIP experience & how you will handle number porting. ✅ Estimated timeline & milestones for 2 weeks execution. ✅ Your team composition (if applicable). ✅ Any additional AI features you can implement. We are ready to hire IMMEDIATELY and ...

...professional look and host it as a secure, user-accessible web application to work on a sample of documents we will provide as a test. The functionality of the existing repository will remain intact, with focus primarily on visual customization and deployment. Scope of Work: UI Customization - Update colors, fonts, and layouts to align with a professional, branded appearance. - Replace default branding with a custom logo, favicon, and design elements. - Adjust input forms, buttons, and navigation for a polished look. - Ensure the interface remains user-friendly and responsive on all devices. Hosting the Application: - Deploy the customized application on a cloud platform (e.g., AWS, GCP, or Azure). - Configure the appli...

I'm in need of a Google Sheet that consolidates real-time grain cash bid information from local and regional elevators into one accessible location. Key Requirements: - The sheet needs to pull data from specific elevator websites: ADM Sauget, Bunge, Green Plains, and Cargill. - It should only focus on updating cash bids in real-time. Ideal Skills: - Proficiency in Google Sheets and data scraping. - Experience with automating Google Sheets for real-time data updates. - Familiarity with grain elevator cash bid data. This project will be a great fit for you if you're adept at creating automated Google Sheets and have experience working with real-time data.

...solutions provider dedicated to delivering innovative, scalable, and reliable technology solutions for businesses of all sizes. With our comprehensive expertise across multiple technologies and industries, we transform business challenges into competitive advantages through customized software solutions. Our Core Services Custom Software Development End-to-end development of bespoke software applications tailored to specific business needs Web applications, mobile apps, and enterprise software solutions Integration services and API development Legacy system modernization and migration Technology Consulting Technical architecture design and planning Digital transformation strategy Technology stack optimization Performance optimization ...

I'm seeking a skilled Python backend developer to enhance my project. The role focuses on: - API Development: Creating seamless and efficient APIs. - Database Integration: Ensuring smooth connectivity and interaction with our existing database. - User Authentication: Implementing secure and reliable user authentication processes. Ideal candidates should have extensive experience in Python and backend development, with a strong understanding of API creation, database management, and user authentication systems. Your expertise will significantly contribute to the project's success.

I'm looking for a web developer to create a site similar to Programiz or W3Schools, with a dedicated admin panel for content upload. Key Features: - The site will primarily host text tutorials and interactive exercises. - It should cater to a wide array of programming languages and technologies, not just limited to Python, JavaScript, or HTML/CSS. - The admin panel needs to come equipped with a comprehensive content editor, allowing me to upload and format tutorials with ease. Ideal Skills: - Proficiency in web development, with a strong portfolio of similar projects. - Experience in building intuitive and user-friendly admin panels. - Understanding of interactive web content creation. Please provide examples of your p...

I'm in need of a Python script that can perform speaker diarization and transcription in real-time. The setup will involve one microphone capturing a conversation between two individuals. The script should be able to: - Store the audio from the mic into small arrays - Feed these arrays into a diarization system - Output speaker-labelled transcriptions as new arrays are created during the conversation. The audio input will be streaming audio, and the system is expected to handle two speakers. The transcription will only need to support English. Ideal skills and experience for the job include: - Proficiency in Python - Experience with audio processing and speaker diarization - Understanding of real-time data handling - Ability to crea...