What is web scraping in python jobs

...need a Python-based data scraper that can automatically scrape text data from vehicle dealership websites, such as: I would need the scraper to do multiple different URLs with the final of each CSV uploaded to my server. This scraper would need to run once a day. For example, the multiple URLs would need to be defined by the Porsche Centre search field which gives different IDs for each location, eg: I have a list of what data needs to get scraped and can help with the before/after code of where this information sites. I would also need to include some standard information to go in each CSV also. The project is urgent

I will assist in creating an application where admins can send messages, and users (Clients/Support) can view them. User Roles: -> Clients -> Support -> Admin Screens (Client): Splash Screen (app name/logo for a few seconds). Onboarding Screen (app features overview). Login & Registration (email/password). Account Verification (OTP on email). Home/Group Chat (view admin-created project groups). Chat Screen (communicate with group admin). Notification Screen (real-time push notifications). Settings (edit profile, change password, notifications, logout/delete account). Support & Tickets Section. Subscription Screen (Stripe integration). Screens (Support): Similar to Clients, but includes one-to-one chats with clients and view-only access to admin groups. Screens (...

I need a seasoned AI developer with a strong background in Natural Language Processing (NLP) to help me with a sentiment analysis project. Key Responsibilities: - Develop an NLP model capable of sentiment analysis for our website. - Ensure the model is accurate and efficient. Ideal Skills: - Extensive experience in NLP, particularly in sentiment analysis. - Proven track record of developing AI models for website deployment. - Strong programming skills, preferably in Python and JavaScript. Your expertise will be crucial in interpreting user sentiment and helping us enhance our website's interactivity and user experience. Please provide examples of your previous work in this field.

I have a Python script used for monitoring uptime of a specific protocol. It needs some quick tweaking, and would also like to get it to make a DNS change via the Route 53 API (AWS) when the uptime check fails. The script should then revert the DNS change once uptime is restored. Key Requirements: - Tweaking of the existing Python script to improve its functionality and performance. - Implementing a new feature to interact with the Route 53 API. - The script should be able to initiate a DNS change if a failure is detected. Ideal Skills: - Strong proficiency in Python. - Prior experience with AWS Route 53 and API is required. - Excellent problem-solving skills to enhance script performance and functionality.

...heads in healthcare organizations, private hospitals and fintech firms. You could choose a market and go from there, 200-5000 employees enterprises must be targeted. - Deliver a well-organized contact list for potential business outreach with emails ( excel ) Ideal Skills: - Proven experience in lead generation and market research using LinkedIn and similar tools. - Strong understanding of how to conduct market research and leads generation. - Excellent data organisation and presentation skills. - Strong communication skills for potential follow-up correspondence. Please submit your proposal if you have the required experience and skills. This is a bid just for initial list of validated leads, if we see your potential this will be extended to a longer-term con...

1. Connecting mine domain from GoDaddy to my hosting ( directAdmin) 2. Installing POS system script that I bought on Codecanyon to my hosting. The name of the script that I bought is OffPos by DoorSoft.

I need a skilled Machine Learning expert to help train a Convolutional Neural Network (CNN) model for classifying breast cancer images using the CBIS-DDSM, M...Learning expert to help train a Convolutional Neural Network (CNN) model for classifying breast cancer images using the CBIS-DDSM, MIAS, and INbreast datasets. The goal is to achieve high performance metrics, specifically aiming for: - Accuracy: Up to 95% - Recall/Sensitivity: Up to 95% - Specificity: Up to 95% - Precision - F1 Score The project needs to be implemented in Python, using GPU Tensorflow on a native Windows local environment. Familiarity with the Tensorflow installation process for Windows is a plus. Please note that data preparation has not yet started, so experience in data pre-pro...

We have been using the Boulevard "BLVD" as our booking & payment platform to track all our customer & booking data. We collect data from BLVD using Daily Recurring Report Exports through their API created by GraphQL, the report exports are in CSV format and the data is automatically updated. All the report CSV's are exported from BLVD using fileURLs, and the fileURL provides an automatic download of the CSV with all the related data, there's 12 fileURLs/CSVs each updated with the related data. Each fileUrl is a static, signed url that will reference the latest version of the export, an example of the fileURL link: /api/2020-01/report_exports/(id).csv?signature=(signature) I'm making this listing because I can't seem to fix the pr...

I am seeki...a skilled developer located in India to create a web scraper for me. The goal of this project is to collect open interest data from the National Stock Exchange of India (NSE). Key Responsibilities: - Design and implement a robust data scraping tool capable of extracting open interest data from the NSE. - Ensure the tool can operate continuously and efficiently, collecting data for analysis on a daily basis. Ideal Skills: - Proficiency in data scraping and web development. - Experience with financial market data, particularly from the stock market. - Familiarity with the National Stock Exchange of India and its data. I would prefer a freelancer who has prior experience in developing similar tools and can demonstrate the...

I am seeking an expert in data scraping to collect text content from a specific websites (aprox 25 of them). The purpose of this project is to aggregate the scraped content for further use. Each of the target sites have contact section with offices listed. We need to aggregate working hours for these. Ideal Skills: - Proficient in data scraping tools and techniques - Experience with content aggregation projects - Strong attention to detail -python Please bid only if you have proven experience in scraping website text content and are able to deliver clean, structured data fast! Message for more details.

I'm looking for a proactive Django developer to improve my existing e-commerce website. The enhancements include implementing a multi-product 'Add to Cart' feature and a tracking-focused user dashboard. Ke...Implement 'Add to Cart' function allowing for multiple product selections - Develop a user-friendly dashboard with a focus on user activity tracking - Ensure seamless integration of new features with existing website setup Ideal Skills: - Proficient in Django, Python, API, CSS, JavaScript - Prior experience with e-commerce website development - Strong attention to detail and web development best practices The dashboard should track purchase history and provide insights on user behaviour. If you are passionate about developing efficient...

I am seeking a talented freelancer to develop an automation and analysis system for a Blackjack card game using computer vision and game strategy analysis. The system should be able to: Monitor the screen in real-time to track the game. Keep track of the history of dealt cards. Restart the game when needed. Analyze the dealer's hand. Provide strategy recommendations for the next move based on my hand. Requirements: Screen Capture and Monitoring: The system must continuously monitor the screen in real-time to capture and detect gameplay. Utilize screen capture tools (OpenCV or similar) to detect cards, the dealer’s hand, and the player's hand during the game. Card History Tracking: The system should keep a...

...Although the choice of design tool (Figma, Adobe XD, Sketch) is open, the ability to create advanced functionality is crucial. - Develop user flows and wireframes to visualize the voting process. **System Architecture:** - Design the system architecture, including the selection of appropriate frontend technologies (HTML, CSS, JavaScript, React, Angular, Vue.js), a suitable backend programming language and framework (Python/Django, Node.js/Express, Ruby on Rails), and a secure database system (MySQL, PostgreSQL, MongoDB). - Create detailed documentation outlining the pros and cons of your options, focusing on long-term efficacy and ease of use for end users. Ideal skills for the job include: - Proficiency in UI/UX design. - Experience in system archit...

...skills in data analysis, macros, and VBA. You will be required to create a sophisticated Excel spreadsheet for analyzing trading data. Key Responsibilities: - Create an advanced Excel spreadsheet for trading data analysis - Incorporate real-time data updates into the spreadsheet - Implement advanced charting and visualization techniques - Design automated trading signals within the spreadsheet Ideal Skills: - Excel: Advanced spreadsheet creation and optimization - Macros and VBA: Proven experience in automating tasks and enhancing workflow - Python: Familiarity with Python for data analysis and Excel integration would be a big plus. Payment: - The designer will be compensated on a daily basis, with payment based on the number of days worked. Your experti...

I'm seeking a skilled professional to develop a Convolutional Neural Network (CNN) for classifying breast cancer images. The p...and ResNet50 architectures. - Split the data 80% for training and 20% for testing. Performance Goals: - Achieve an accuracy of up to 95%. - Achieve a recall/sensitivity of up to 95%. - Achieve a specificity of up to 95%. - Evaluate precision and F1 Score. Technical Requirements: - Implement the project using Python with GPU Tensorflow on a native-Windows local environment lab. - Familiarity with Tensorflow installation on Windows is required. Ideal Skills: - Proficiency in Python and Tensorflow. - Experience with CNN model development. - Familiarity with breast cancer datasets and related image classification tasks. - Ability ...

We have been using the Boulevard "BLVD" as our booking & payment platform to track all our customer & booking data. We collect data from BLVD using Daily Recurring Report Exports through their API created by GraphQL, the report exports are in CSV format and the data is automatically updated. All the report CSV's are exported from BLVD using fileURLs, and the fileURL provides an automatic download of the CSV with all the related data, there's 12 fileURLs/CSVs each updated with the related data. Each fileUrl is a static, signed url that will reference the latest version of the export, an example of the fileURL link: /api/2020-01/report_exports/(id).csv?signature=(signature) I'm making this listing because I can't seem to fix the p...

I'm in need of a skilled data scraper to extract information from a variety of sources. Website Scraping: - Text content - Links Social Media Scraping: - Data from Facebook - Data from Twitter - Data from Instagram The ideal freelancer for this project should have extensive experience in web scraping and social media data extraction. Proficiency in programming languages such as Python is a plus.

We need a developer to work on: -Nextjs front end using ReactJS -Python and Typescript based backend -Mobile Application Development It's important that the work is high quality and well documented.

We need a developer to work on: -Nextjs front end using ReactJS -Python and Typescript based backend -Mobile Application Development It's important that the work is high quality and well documented.

We are looking for a Data Scientist with expertise in AI and Machine Learning to develop a time series forecasting model. The project involves analyzing historical sales data using AWS and Snowflake. The ideal candidate should have strong skills in Python, machine learning, and predictive analytics. This is a short task estimated to take 1-2 hours. Please apply with your relevant experience and availability!

I'm seeking a proficient web scraper to extract contact details from the provided website. Ideal Skills: - Proficient in web scraping tools and software. - Experienced in data extraction from company websites. - Deliver the extracted data in Excel format.

I'm looking for a skilled developer to create an automated software solution in Python for triangular arbitrage on the Binance cryptocurrency exchange. Key Requirements: - The software should efficiently identify and execute trades across optimal crypto pairs, capitalizing on price discrepancies. - It should be compatible with Windows. - It should feature real-time trade execution. Ideal Skills: - Experience in algorithmic trading. - Deep understanding of the Binance API. - Strong analytical skills. - Keen eye for market opportunities. If you are passionate about crypto trading and automation, I want to hear from you! [[ Price Negotiable ]]

Snowflake developer Contract length - 6 month+ Shift - PST shift time Location based - Chennai(India) Experience -5+ Years Overview We are seeking a skilled Snowflake Lead/Senior Developer. The ideal c...maintain dbt models to ensure data quality and consistency. Perform Snowflake administrative tasks related to platform performance and health. Qualifications: Proven experience as a Snowflake Lead/Senior Developer or similar role. Strong proficiency in dbt. Solid understanding of data modeling principles and best practices. Proficient in SQL and data warehousing concepts. Proficient in Python. Preferred Qualifications: Experience with cloud platforms (GCP preferred). Skills & Requirements Snowflake, DBT models, SQL, Data warehousing, Pytho...

I'm looking for a skilled Python developer to help fix my code that utilizes the LinkedIn API for posting updates with images. The task involves troubleshooting and resolving any issues in the existing code to ensure successful posts on LinkedIn. This job is expected to take about 1 hour. If you have experience working with APIs and social media integrations, I would love to hear from you!

I'm looking for a proficient Python developer experienced in Kafka, Avro schema, and MySQL to assist in producing Kafka messages. Key requirements include: - Fetching records from a MySQL database. - Handling mixed data types (both text and binary) from the database. - Utilizing a pre-defined Avro schema for data validation before publishing to a Kafka topic. Ideal candidates will have: - In-depth knowledge of Python and its libraries for Kafka and MySQL. - Experience working with mixed data types. - Understanding of Avro schema and its application in Kafka.

Machine Learning Generative Models Question 1 - Generative models In the following exercise, you will deal with a generative learning problem, precisely, VAE and GAN. You should write your training code and meet the following constraints. In this exercise, you will create a generative model: choose VAE or GAN implement and train your model: The decoder/generator should get as input a vector from the latent space and produce an image. For convolutions that upscale the input’s spatial size (for the decoder/generator), use . Output visualization: Generate images from your model and visualize its latent spaces. You can compare different architectures for this purpose (e.g., low/high dimension of the latent spaces, etc.). Dataset: You will use the 102 Category Flower Da...

I'm facing an issue with my K-Medoids clustering. I have two phrases that ...an issue with my K-Medoids clustering. I have two phrases that share similar words, but are not similar as a whole, causing overlaps in the clustering process. I used Sentence-Transformers for semantic similarity and cosine distance for the distance measure. The main goal is to increase the accuracy of the clustering. I'm open to suggestions for alternative clustering algorithms that could better handle this situation. Ideal skills for this project include: - Expertise in various clustering algorithms - Proficiency in Python and familiar with the Sentence-Transformers library - Strong understanding of semantic similarity and distance measures - Experience in ...

I'm in need of a skilled web scraper to extract property listings from PropertyFinder. The project involves capturing essential details such as property descriptions, prices, locations, sizes, and pictures. Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Prior experience in scraping real estate data - Ability to handle large datasets - Attention to detail for accurate data capture - Familiarity with handling images in data scraping

I'm in need of an innovative ChatGPT prompt that can effectively compare two spreadsheets for outliers or anomalies. For a hospitality business the supplier sends a transaction report but the invoice they apply the payment to is not the same one as we make the payment for, as due to cash flow we have to sometimes split payments up. They may apply it to the oldest invoice. There is however sometimes errors where they have not applied our payment and we need a way to quickly spot these, without intensive labour. We need a chatgpt (or google) prompt that will take these two sheets and return a list of possible errors, it may be easier to provide a sheet that links our payment to whichever invoice the supplier has applied it to by checking the amount, note the sup...

Need help with solving 2 issues.

I'm seeking Python experts to transform English descriptions into Python scripts targeting Machine Learning models. Your primary focus will be on classification tasks using TensorFlow. Precision and a strong grasp of Python are essential, as is a commitment to pushing the boundaries of Machine Learning. Key Responsibilities: - Convert English into Python scripts - Focusing on classification tasks - Utilizing TensorFlow predominantly Ideal Skills: - Exceptional Python programming skills - Strong attention to detail - Proficiency in English - Experience with TensorFlow - Background in creating ML scripts Please apply at A CV or profile showcasing your skills is required.

I'm looking for a skilled Python developer to create a program that reads text content from the website and stores it in a Pinecone vector database, categorized by keywords. Key Requirements: - Proficient in Python programming - Experience with web scraping - Familiarity with Pinecone vector database - Ability to categorize data by keywords Please provide examples of your previous work in web scraping and vector database integration.

I'm in need of a professional data entry and scraping expert to assist in filling out a Google Sheet using SensorTower. Instructions and examples have been provided. The data primarily focuses on downloads and revenue statistics. Key Requirements: - Proficiency in data scraping and data entry - Familiarity with SensorTower is a plus - Ability to follow instructions accurately - Experience with Google Sheets Please write 'APPLES' as a test to confirm you are not a bot.

...expertise in modern web technologies, backend development, and AI-driven solutions. Proficient in building scalable applications using React, , , and Node.js, combined with the power of TypeScript and TailwindCSS for efficient, maintainable front-end design. Possesses advanced skills in Python, Django, and Data Management, enabling seamless integration of back-end systems and databases. With experience in Machine Learning (ML) and Natural Language Processing (NLP), delivers intelligent, data-driven solutions tailored to business needs. A Blockchain enthusiast with hands-on expertise in developing decentralized applications and integrating cutting-edge technologies. Proficient in AWS and Firebase, ensuring robust cloud-based archi...

Title: Development of a Self-Service POS System for 24/7 Sales Container I am looking for an experienced developer (or small team) to create a custom self-service POS system for my 24/7 sales container. The system should run on touchscreen hardware and connect to a central server for product and sales management. The goal is to have a reliable, user-friendly, and scalable POS solution that streamlines operations and enhances customer experience. Requirements: Hardware Integration: Touchscreen display for user interaction. EAN barcode scanner for product identification. Receipt printer (e.g., Epson or Star Micronics). LAN connection support for real-time data synchronization. Software Features: Product Scanning: Scan EAN barcodes to display produc...

Extract data from website and export in excel sheet

I am seeking a dedicated, full stack Python/Django developer for a long-term partnership focused on web application development. The ideal candidate will have extensive experience integrating with React, and will be able to implement robust CRM-style user authentication systems. Key Requirements: - Full stack expertise in Python and Django - Proven experience in web application development - Proficiency in integrating with React - Knowledge and experience with CRM-style user authentication - Ability to deliver high-quality, maintainable code - Ready for a long-term collaboration Skills and Experience: - Python, Django - Full stack development - Web application development - React integration - CRM user authentication systems

I'm looking for a data scraping expert who can help me gather information on potential internship candidates in Canada. Ideal Skills and Experience: - Proficient in data scraping techniques and tools. - Familiarity with various platforms such as job boards, university websites, and social media. - Ability to compile comprehensive data sets including contact information, educational background, work experience, and email addresses. I need a one-time collection of 200-300 contacts. This project will be a stepping stone towards potentially more extensive future collaborations if the data is of high quality and the process is efficient.

I need a skilled web scraper to gather data and images from residential real estate listings. The specific data fields I need are: - Property address - Price - Number of bedrooms Experience with web scraping and data processing is crucial. Please provide examples of similar projects you've worked on.

I am looking for european freelancer to avoid time zone difference. I need to scrap thousand images and rename it by name and date of creation

We are looking to develop a cutting-edge real estate platform tailored for golf course properties. This website will offer AI-driven property descriptions, integrate immersive golf course virtual tours, and provide unique real-time data, making it the top destination for golf enthusiasts interested in buying homes on or near golf courses. The project will require building a user-friendly front-end and robust back-end with AI-powered features, multimedia integrations, and real-time data. Complete website, meta tagged and SEO ready, APP for Android/iOS Project Requirements Breakdown: Core Features of the Platform: 1. AI-Powered Property Descriptions Objective: Automatically generate dynamic and personalized descriptions for golf course properties. Details: Use AI to create unique p...

I'm experiencing functional bugs with my FastAPI application's API endpoints. The bugs result in unexpected errors, and they need to be addressed to restore proper functionality. Ideal Skills: - Proficient in FastAPI and Python - Experience with debugging and troubleshooting API endpoints - Familiarity with implementing functional enhancements in FastAPI applications - Good understanding of API design and development Please only bid if you can demonstrate relevant experience and have a proven track record of successfully fixing bugs in FastAPI applications.

I need a skilled freelancer to scrape product information from a specific website. The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and imag...The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and images, and product specifications and reviews. The ideal candidate should have experience with web scraping tools and techniques, ensuring clean and organized data output in CSV format. Key Requirements: - Web scraping expertise, preferably with Python - Attention to detail for data accuracy - Ability to deliver results in a timely ma...

I need help with web scraping from a specific e-commerce website. The goal is to gather comprehensive data for product analysis. Key Data Points: - Product details - Pricing information - Stock levels - Minimum order quantities - Delivery times - Specific product information as detailed on the sites The extracted data should be delivered in an Excel format. Ideal Candidate: - Proficient in web scraping tools and techniques - Excellent data analysis skills - Familiar with e-commerce platforms - Able to deliver clean, well-organized data in Excel Looking forward to your proposals. The website would be the following and we would like to see the details for all manufacturers listed:

I'm seeking a skilled freelancer experienced in crawl4ai web scraping to assist me with data extraction from various e-commerce sites. Specifics of the project: - I need detailed product information, pricing data, and customer reviews extracted from these sites. - The purpose of this project is to gather comprehensive data for analysis and potential application in AI. Ideal Skills: - Proficiency in web scraping tools and techniques. - Experience in extracting data from e-commerce sites. - Ability to deliver clean, organized data. Please provide examples of similar projects you've completed in your proposal.

I'm looking for a skilled developer to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and export them into a CSV file via Excel. Key Req...scrapes products from an eCommerce site. The script should capture comprehensive product details and export them into a CSV file via Excel. Key Requirements: - The script needs to operate automatically, without manual intervention. - It should meticulously gather: - Photos and text - Price and description - Category and SKU Ideal skills include web scraping, Python or similar programming language expertise, and experience with data handling in Excel and CSV formats. Please ensure your proposal includes relevant past projects, as...

More details: What specific tasks do you want the macro to perform? Data analysis, Data formatting Do you need the macro to run automatically under certain conditions? No, I'll run it manually What level of user interaction do you foresee with the macro? Simple prompts and inputs

I'm in need of a senior developer with a strong focus on frontend and backend development, specifically on AWS. The ideal candidate should be well-versed in Python and have a solid understanding of task automation in the derivatives market. Key Responsibilities: - Implementing a React-based frontend - Developing a FastAPI backend on AWS - Automating tasks related to data processing and workflow Skills and Experience: - Proficiency in Python, especially for task automation - Extensive experience with React for frontend development - Expertise in FastAPI for backend development - Strong understanding of AWS services - Prior experience in the derivatives market is a plus - Proficiency in managing and optimizing datab...

Project Title: Automation of Stock and Option Trading in NSE and BSE Objective: To develop an automated trading system for stock and options trading in NSE (National Stock Exchange) and BSE (Bombay Stock Exchange) based on our proprietary trading methods and rules. The system should integrate with multiple brokers, execute trades as per predefined conditions, and provide real-time analytics and reports. Scope of the Project: Trading Strategies: Automate trades based on the following methodologies: Candlestick Patterns: Identify and act on specific candlestick formations. Fibonacci Levels: Recognize retracement and extension levels for trade entries/exits. RSI (Relative Strength Index): Execute trades based on overbought/oversold conditions. Elliott Wave Theory: Use pattern ...

I am looking for a progressive web application developer who is proficient in PHP, Python, Ruby, etc... Design: - I do not have a design for the web application and will need assistance in creating one. Functionality: - The desired functionality of the web application is user registration and authentication, e commerce, geo location, AI YOU MUST PLACE CODE 184 in your opening sentence to be considered for this. Code is used to differentiate between automatic bids (which will be immediately ignored). Skills and experience required: - Proficiency in PHP, Python, and Ruby - Experience in designing web applications - Knowledge of user registration and authentication processes - camera funct...