Web scraping job python jobs
I'm in need of a reliable tool that can meticulously scour the web for email addresses of approximately 7,000 businesses. The businesses will predominantly be located in one state, but will span across different cities. Key Requirements: - The tool must prioritize high accuracy over speed. The searches should be thorough and precise, ensuring that the email addresses collected are valid and relevant. - The results of each search should be exported in a CSV file (.csv). The file should contain the business name, address, and corresponding email address. Ideal Skills and Experience: - Proficiency in web scraping and data mining - Experience with CSV file handling and data organization - Ability to design a tool that balances high accuracy with a methodical pace. ...
I'm seeking a skilled Python developer with solid experience in Kafka, Avro schema, and MySQL. The key focus of this project is to assist in producing Kafka messages through the following tasks: - Fetching records from a MySQL database, specifically transactional data. - Handling mixed data types (both text and binary) from the database. - Utilizing a pre-defined Avro schema for data validation before publishing to a Kafka topic. Ideal candidates will have: - Proficiency in Python and its libraries for Kafka and MySQL. - Proven experience working with mixed data types. - A comprehensive understanding of Avro schema and its application in Kafka. Your primary goal in this project will be data validation and publishing. Please note, the version of MySQL in use has not b...
I'm looking for a talented social media marketer with extensive experience in organic promotion on Meta and LinkedIn. My company specialises in travel and insurance, and our primary goal is to engage and reach all types of travelers in Australia. Key Responsibilities: - Promote recent project launches and service-related posts to increase visibility and interest - Boost our reach and engagement on Meta and LinkedIn, with a particular emphasis on driving shares and achieving a viral reach - Foster an engaging online community through encouraging likes, comments, and shares Ideal Skills and Experience: - Proven track record in organic social media marketing, particularly on Meta - Experience in promoting content - Ability to create engaging, shareable content - Strong understanding of...
Fix the Python code and output as per my requirement
We are developing a platform designed to optimize international transactions for businesses engaged in global trade. The platform w...Integrating advanced security measures to ensure that transactions and data are protected. Required Roles: AI/ML Engineers Blockchain Developers Full-Stack Developers Mobile App Developers (iOS/Android) DevOps Engineers UI/UX Designers Security Engineers Cloud Architects Compliance Engineers Data Engineers/Scientists QA Engineers Technologies: Frontend: React, Vue.js, Angular Backend: Node.js, Python, Ruby on Rails Blockchain: Ethereum, Hyperledger, Solidity, Smart Contracts AI/ML: TensorFlow, PyTorch, Scikit-Learn Databases: SQL/NoSQL (MySQL, PostgreSQL, MongoDB) Mobile: React Native, Swift, Kotlin Cloud: AWS, Azure, GCP DevOps: Docker, Kubernetes,...
I need a Python-based data scraper that can automatically scrape text data from vehicle dealership websites, such as: I would need the scraper to do multiple different URLs with the final of each CSV uploaded to my server. This scraper would need to run once a day. For example, the multiple URLs would need to be defined by the Porsche Centre search field which gives different IDs for each location, eg: I have a list of what data needs to get scraped and can help with the before/after code of where this information sites. I would also need to include some standard information to go in each CSV also. The project
I will assist in creating an application where admins can send messages, and users (Clients/Support) can view them. User Roles: -> Clients -> Support -> Admin Screens (Client): Splash Screen (app name/logo for a few seconds). Onboardi...Similar to Clients, but includes one-to-one chats with clients and view-only access to admin groups. Screens (Admin): Manage user accounts and subscriptions. Content & notification management. Respond to support tickets. Business Website: A simple landing page with business details, FAQ, contact form, and app QR code for download. Tech Stack: -> UI/UX: Figma -> Mobile App: Flutter -> Backend: Python + Django -> Database: Postgres -> Server: DigitalOcean (200 free credits). -> Testing: Unit, integration, UI, and UA...
We are seeking an experienced digital marketing and SEO consultant to help elevate the online presence of a licensed Marriage and Family Therapist based in San Marcos, CA. The practice is 100% virtual, serving clients across California. Our goal is to optimize the website and advertising efforts to attract clients statewide while maintaining a strong local presence. Key Responsibilities 1. Search Engine Optimization (SEO): â—‹ Conduct an SEO audit of the current WordPress website. â—‹ Optimize for statewide rankings, including searches like "therapist near me" and virtual therapy-related terms. â—‹ Identify and implement strategies to maintain high local rankings while expanding statewide visibility. 2. Google Business Profile Optimization: â—‹ Review and optimize the existing ...
I need a seasoned AI developer with a strong background in Natural Language Processing (NLP) to help me with a sentiment analysis project. Key Responsibilities: - Develop an NLP mode...Processing (NLP) to help me with a sentiment analysis project. Key Responsibilities: - Develop an NLP model capable of sentiment analysis for our website. - Ensure the model is accurate and efficient. Ideal Skills: - Extensive experience in NLP, particularly in sentiment analysis. - Proven track record of developing AI models for website deployment. - Strong programming skills, preferably in Python and JavaScript. Your expertise will be crucial in interpreting user sentiment and helping us enhance our website's interactivity and user experience. Please provide examples of your previous work...
I need a skilled Machine Learning expert to help train a Convolutional Neural Network (CNN) model for classifying breast cancer images...need a skilled Machine Learning expert to help train a Convolutional Neural Network (CNN) model for classifying breast cancer images using the CBIS-DDSM, MIAS, and INbreast datasets. The goal is to achieve high performance metrics, specifically aiming for: - Accuracy: Up to 95% - Recall/Sensitivity: Up to 95% - Specificity: Up to 95% - Precision - F1 Score The project needs to be implemented in Python, using GPU Tensorflow on a native Windows local environment. Familiarity with the Tensorflow installation process for Windows is a plus. Please note that data preparation has not yet started, so experience in data pre-processing and augmentation is ...
...just use the AWS that was working fine, instead he sent a 2.11GB MySQL data dump export, 2 Python Scripts, and 3 Tableau Workbook Files. I haven't been able to get the setup to work like it used to and keep getting errors. For example, the data on MySQL database & Tableau hasn't updated in months but the Report Export CSVs shows data from as recent as today, but our both MySQL and Tableau isn't showing this recent data. I believe this is due to the Python scripts not working right, even though everything had worked before. I tried to migrate from MySQL to PostgreSQL hoping it might help solve my issues, I used a migration app to convert the dump from MySQL to PostgreSQL and ChatGPT to edit the Python scripts. In the end I was only able to view t...
I am seeking a skilled developer located in India to create a web scraper for me. The goal of this project is to collect open interest data from the National Stock Exchange of India (NSE). Key Responsibilities: - Design and implement a robust data scraping tool capable of extracting open interest data from the NSE. - Ensure the tool can operate continuously and efficiently, collecting data for analysis on a daily basis. Ideal Skills: - Proficiency in data scraping and web development. - Experience with financial market data, particularly from the stock market. - Familiarity with the National Stock Exchange of India and its data. I would prefer a freelancer who has prior experience in developing similar tools and can demonstrate their ability to deliver high-q...
I am seeking an expert in data scraping to collect text content from a specific websites (aprox 25 of them). The purpose of this project is to aggregate the scraped content for further use. Each of the target sites have contact section with offices listed. We need to aggregate working hours for these. Ideal Skills: - Proficient in data scraping tools and techniques - Experience with content aggregation projects - Strong attention to detail -python Please bid only if you have proven experience in scraping website text content and are able to deliver clean, structured data fast! Message for more details.
I'm looking for a proactive Django developer to improve my existing e-commerce website. The enhancements include implementing a multi-product 'Add to Cart' feature and a tracking-focused user dashboard. Ke...Implement 'Add to Cart' function allowing for multiple product selections - Develop a user-friendly dashboard with a focus on user activity tracking - Ensure seamless integration of new features with existing website setup Ideal Skills: - Proficient in Django, Python, API, CSS, JavaScript - Prior experience with e-commerce website development - Strong attention to detail and web development best practices The dashboard should track purchase history and provide insights on user behaviour. If you are passionate about developing efficient web...
...system should offer strategic suggestions and highlight the most optimal move for the player to increase their chances of winning. Skills Required: Strong experience with OpenCV and computer vision for real-time card and game area detection. Knowledge of Blackjack rules and strategy to provide correct game suggestions. Experience with game automation and screen scraping tools. Familiarity with Python or C# (or other programming languages suitable for this type of automation and analysis). Ability to integrate card counting and game analysis features effectively. Real-time strategy recommendation algorithms for Blackjack. Deliverables: A fully functional system that monitors the game screen and tracks the cards in real-time. A history tra...
...wireframes to visualize the voting process. **System Architecture:** - Design the system architecture, including the selection of appropriate frontend technologies (HTML, CSS, JavaScript, React, Angular, Vue.js), a suitable backend programming language and framework (Python/Django, Node.js/Express, Ruby on Rails), and a secure database system (MySQL, PostgreSQL, MongoDB). - Create detailed documentation outlining the pros and cons of your options, focusing on long-term efficacy and ease of use for end users. Ideal skills for the job include: - Proficiency in UI/UX design. - Experience in system architecture design. - Knowledge of various frontend, backend, and database technologies. - Ability to create comprehensive and clear documentation. Please note that this project...
...Create an advanced Excel spreadsheet for trading data analysis - Incorporate real-time data updates into the spreadsheet - Implement advanced charting and visualization techniques - Design automated trading signals within the spreadsheet Ideal Skills: - Excel: Advanced spreadsheet creation and optimization - Macros and VBA: Proven experience in automating tasks and enhancing workflow - Python: Familiarity with Python for data analysis and Excel integration would be a big plus. Payment: - The designer will be compensated on a daily basis, with payment based on the number of days worked. Your expertise will be instrumental in helping me make sense of trading data and automate parts of the analysis process. Please provide examples of similar projects you've worked on...
I'm seeking a skilled professional to develop a Convolutional Neural Network (CNN) for classifying breast cancer images. The p...and ResNet50 architectures. - Split the data 80% for training and 20% for testing. Performance Goals: - Achieve an accuracy of up to 95%. - Achieve a recall/sensitivity of up to 95%. - Achieve a specificity of up to 95%. - Evaluate precision and F1 Score. Technical Requirements: - Implement the project using Python with GPU Tensorflow on a native-Windows local environment lab. - Familiarity with Tensorflow installation on Windows is required. Ideal Skills: - Proficiency in Python and Tensorflow. - Experience with CNN model development. - Familiarity with breast cancer datasets and related image classification tasks. - Ability to achieve hig...
...just use the AWS that was working fine, instead he sent a 2.11GB MySQL data dump export, 2 Python Scripts, and 3 Tableau Workbook Files. I haven't been able to get the setup to work like it used to and keep getting errors. For example, the data on MySQL database & Tableau hasn't updated in months but the Report Export CSVs shows data from as recent as today, but our both MySQL and Tableau isn't showing this recent data. I believe this is due to the Python scripts not working right, even though everything had worked before. I tried to migrate from MySQL to PostgreSQL hoping it might help solve my issues, I used a migration app to convert the dump from MySQL to PostgreSQL and ChatGPT to edit the Python scripts. In the end I was only able to view t...
I'm in need of a skilled data scraper to extract information from a variety of sources. Website Scraping: - Text content - Links Social Media Scraping: - Data from Facebook - Data from Twitter - Data from Instagram The ideal freelancer for this project should have extensive experience in web scraping and social media data extraction. Proficiency in programming languages such as Python is a plus.
We need a developer to work on: -Nextjs front end using ReactJS -Python and Typescript based backend -Mobile Application Development It's important that the work is high quality and well documented.
We need a developer to work on: -Nextjs front end using ReactJS -Python and Typescript based backend -Mobile Application Development It's important that the work is high quality and well documented.
We are looking for a Data Scientist with expertise in AI and Machine Learning to develop a time series forecasting model. The project involves analyzing historical sales data using AWS and Snowflake. The ideal candidate should have strong skills in Python, machine learning, and predictive analytics. This is a short task estimated to take 1-2 hours. Please apply with your relevant experience and availability!
I'm seeking a proficient web scraper to extract contact details from the provided website. Ideal Skills: - Proficient in web scraping tools and software. - Experienced in data extraction from company websites. - Deliver the extracted data in Excel format.
I'm looking for a skilled developer to create an automated software solution in Python for triangular arbitrage on the Binance cryptocurrency exchange. Key Requirements: - The software should efficiently identify and execute trades across optimal crypto pairs, capitalizing on price discrepancies. - It should be compatible with Windows. - It should feature real-time trade execution. Ideal Skills: - Experience in algorithmic trading. - Deep understanding of the Binance API. - Strong analytical skills. - Keen eye for market opportunities. If you are passionate about crypto trading and automation, I want to hear from you! [[ Price Negotiable ]]
Snowflake developer ...have experience working with event or time-series data. Job Description Key Responsibilities: Design and implement scalable data models and pipelines using Snowflake. Develop and maintain dbt models to ensure data quality and consistency. Perform Snowflake administrative tasks related to platform performance and health. Qualifications: Proven experience as a Snowflake Lead/Senior Developer or similar role. Strong proficiency in dbt. Solid understanding of data modeling principles and best practices. Proficient in SQL and data warehousing concepts. Proficient in Python. Preferred Qualifications: Experience with cloud platforms (GCP preferred). Skills & Requirements Snowflake, DBT models, SQL, Data warehousing, Python, Data Mo...
I'm looking for a skilled Python developer to help fix my code that utilizes the LinkedIn API for posting updates with images. The task involves troubleshooting and resolving any issues in the existing code to ensure successful posts on LinkedIn. This job is expected to take about 1 hour. If you have experience working with APIs and social media integrations, I would love to hear from you!
I'm looking for a proficient Python developer experienced in Kafka, Avro schema, and MySQL to assist in producing Kafka messages. Key requirements include: - Fetching records from a MySQL database. - Handling mixed data types (both text and binary) from the database. - Utilizing a pre-defined Avro schema for data validation before publishing to a Kafka topic. Ideal candidates will have: - In-depth knowledge of Python and its libraries for Kafka and MySQL. - Experience working with mixed data types. - Understanding of Avro schema and its application in Kafka.
...visualization: Generate images from your model and visualize its latent spaces. You can compare different architectures for this purpose (e.g., low/high dimension of the latent spaces, etc.). Dataset: You will use the 102 Category Flower Dataset dataset Images can be resized for efficiency but not smaller than 64x64. ~vgg/data/flowers/102/ You should provide: Code (python file) able to reproduce your results. The trained network with trained weights (.pkl file). If the model size is less than 500MB, you should submit it on Moodle. Otherwise, upload it to your Google-Drive. A function called "reproduce_hw4()". This function should be able to reproduce the results that you reported. Discussion: Discuss your results. You should provide the following: Model architectur...
I'm facing an issue with my K-Medoids clustering. I have two phrases that share similar words, but are not similar as a whole, causing overlaps in the clustering process. I used Sentence-Transformer...overlaps in the clustering process. I used Sentence-Transformers for semantic similarity and cosine distance for the distance measure. The main goal is to increase the accuracy of the clustering. I'm open to suggestions for alternative clustering algorithms that could better handle this situation. Ideal skills for this project include: - Expertise in various clustering algorithms - Proficiency in Python and familiar with the Sentence-Transformers library - Strong understanding of semantic similarity and distance measures - Experience in improving clustering processes and ...
I'm in need of a skilled web scraper to extract property listings from PropertyFinder. The project involves capturing essential details such as property descriptions, prices, locations, sizes, and pictures. Ideal Skills & Experience: - Proficiency in web scraping tools and techniques - Prior experience in scraping real estate data - Ability to handle large datasets - Attention to detail for accurate data capture - Familiarity with handling images in data scraping
...invoices. We need to make sure they have received all the payments we have noted (in the ours-wally sheet) and have a note of them at their end and any payment that is NOT present or amounts are vastly different highlight them. If a prompt cannot be made, will accept a python script but would prefer some sort of prompt. Note I do not have time to go back and fourth, your job is to provide a prompt or script and sample output that solves this issue and use case and makes it much easier to spot problems. So simply do the job and provide a sample/screenshot/output data. I will not reply to any auto bids or bids saying you can do it - I don't have time to engage on that level, as I would be faster just doing it myself if that is the case. Note In this c...
I'm seeking Python experts to transform English descriptions into Python scripts targeting Machine Learning models. Your primary focus will be on classification tasks using TensorFlow. Precision and a strong grasp of Python are essential, as is a commitment to pushing the boundaries of Machine Learning. Key Responsibilities: - Convert English into Python scripts - Focusing on classification tasks - Utilizing TensorFlow predominantly Ideal Skills: - Exceptional Python programming skills - Strong attention to detail - Proficiency in English - Experience with TensorFlow - Background in creating ML scripts Please apply at A CV or profile showcasing your skills is required.
I'm looking for a skilled Python developer to create a program that reads text content from the website and stores it in a Pinecone vector database, categorized by keywords. Key Requirements: - Proficient in Python programming - Experience with web scraping - Familiarity with Pinecone vector database - Ability to categorize data by keywords Please provide examples of your previous work in web scraping and vector database integration.
I'm in need of a professional data entry and scraping expert to assist in filling out a Google Sheet using SensorTower. Instructions and examples have been provided. The data primarily focuses on downloads and revenue statistics. Key Requirements: - Proficiency in data scraping and data entry - Familiarity with SensorTower is a plus - Ability to follow instructions accurately - Experience with Google Sheets Please write 'APPLES' as a test to confirm you are not a bot.
Experienced and versatile Full-Stack Developer with expertise in modern web technologies, backend development, and AI-driven solutions. Proficient in building scalable applications using React, , , and Node.js, combined with the power of TypeScript and TailwindCSS for efficient, maintainable front-end design. Possesses advanced skills in Python, Django, and Data Management, enabling seamless integration of back-end systems and databases. With experience in Machine Learning (ML) and Natural Language Processing (NLP), delivers intelligent, data-driven solutions tailored to business needs. A Blockchain enthusiast with hands-on expertise in developing decentralized applications and integrating cutting-edge technologies. Proficient in AWS and Firebase, ensuring robust cloud-base...
...communicates with the server via LAN or WLAN. User Interface: Intuitive and easy-to-use interface, suitable for customers without technical knowledge. Scalability: The system must be extendable to additional POS stations or sales locations. Expectations from the Freelancer: Proven experience in developing POS systems or similar software. Expertise in backend technologies (e.g., Python, PHP, Node.js) and frontend frameworks (e.g., React, Vue.js). Familiarity with hardware integration (barcode scanners, printers, touchscreen). Development of an intuitive backend for product management and reporting. Reliable communication and timely delivery. Provide documentation and, if possible, training on the software. Budget and Timeline: ...
Extract data from website and export in excel sheet
I need a skilled web scraper to gather data and images from residential real estate listings. The specific data fields I need are: - Property address - Price - Number of bedrooms Experience with web scraping and data processing is crucial. Please provide examples of similar projects you've worked on.
I am looking for european freelancer to avoid time zone difference. I need to scrap thousand images and rename it by name and date of creation
...skilled web developer who can design and implement an employment agency website using a ThemeForest template. The main focus of the site will be job listings but it will also include: - An 'About Us' page - Detailed information on our service offerings - A comprehensive 'Contact Us' section - Employee profiles complete with certificates - A feature for employers to post jobs - Employees profile and Certificate - An interactive chat function for interviews between employees and employers - A secure payment gateway that accepts Visa/Master cards, PayPal, and Alipay - Three multi-language wmpl- Thai, English, Chinese, Myanmar The site needs to accommodate three user roles: job seekers, employers, and site administrators. The ideal candidate will h...
...Technologies: Backend: Node.js or Python (for AI model integration) AI Model: OpenAI’s GPT-4 API (or alternative) 2. AI Golf Course Link for Property Listings Objective: Allow users to click on a property listing and access detailed, AI-generated content about the associated golf course. AI Narration: AI will narrate key features of the golf course, including its design, famous holes, course difficulty, history, and what makes it unique. Multimedia Content: Each property page will include embedded images, videos, and possibly 360-degree views of the golf course. Real-Time Data: Display live weather conditions, current course status (e.g., green speed, course open/closed), and upcoming events. Frontend: React or Angular (for interactive UI) Backend: Node.js or Python ...
I'm experiencing functional bugs with my FastAPI application's API endpoints. The bugs result in unexpected errors, and they need to be addressed to restore proper functionality. Ideal Skills: - Proficient in FastAPI and Python - Experience with debugging and troubleshooting API endpoints - Familiarity with implementing functional enhancements in FastAPI applications - Good understanding of API design and development Please only bid if you can demonstrate relevant experience and have a proven track record of successfully fixing bugs in FastAPI applications.
I need a skilled freelancer to scrape product information from a specific website. The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and imag...The task involves extracting a total of 841 entries accurately and efficiently. The data fields required include product name and price, product description and images, and product specifications and reviews. The ideal candidate should have experience with web scraping tools and techniques, ensuring clean and organized data output in CSV format. Key Requirements: - Web scraping expertise, preferably with Python - Attention to detail for data accuracy - Ability to deliver results in a timely manner - Providi...
I need help with web scraping from a specific e-commerce website. The goal is to gather comprehensive data for product analysis. Key Data Points: - Product details - Pricing information - Stock levels - Minimum order quantities - Delivery times - Specific product information as detailed on the sites The extracted data should be delivered in an Excel format. Ideal Candidate: - Proficient in web scraping tools and techniques - Excellent data analysis skills - Familiar with e-commerce platforms - Able to deliver clean, well-organized data in Excel Looking forward to your proposals. The website would be the following and we would like to see the details for all manufacturers listed:
I'm seeking a skilled freelancer experienced in crawl4ai web scraping to assist me with data extraction from various e-commerce sites. Specifics of the project: - I need detailed product information, pricing data, and customer reviews extracted from these sites. - The purpose of this project is to gather comprehensive data for analysis and potential application in AI. Ideal Skills: - Proficiency in web scraping tools and techniques. - Experience in extracting data from e-commerce sites. - Ability to deliver clean, organized data. Please provide examples of similar projects you've completed in your proposal.
I'm looking for a skilled developer to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and export them i...to create an automated script that scrapes products from an eCommerce site. The script should capture comprehensive product details and export them into a CSV file via Excel. Key Requirements: - The script needs to operate automatically, without manual intervention. - It should meticulously gather: - Photos and text - Price and description - Category and SKU Ideal skills include web scraping, Python or similar programming language expertise, and experience with data handling in Excel and CSV formats. Please ensure your proposal includes relevant past projects, as well a...
...who can build a tailored job portal for me with integrated AI capabilities. This platform is intended for recruiters/employers and should include the following features: - AI Functions: - Resume Scanning and Matching: The job portal should have sophisticated AI algorithms that can scan and match resumes to job postings. This will help streamline the recruitment process and ensure the right candidates are being considered for each role. - Predictive Analytics for Job Trends: This feature will provide insights on future job trends, helping recruiters stay ahead of the curve. - User Role: - The portal will primarily cater to recruiters/employers. - Recruiter/Employer Features: - Posting Job Listings: A simple and intuitive int...
I'm in need of a senior developer with a strong focus on frontend and backend development, specifically on AWS. The ideal candidate should be well-versed in Python and have a solid understanding of task automation in the derivatives market. Key Responsibilities: - Implementing a React-based frontend - Developing a FastAPI backend on AWS - Automating tasks related to data processing and workflow Skills and Experience: - Proficiency in Python, especially for task automation - Extensive experience with React for frontend development - Expertise in FastAPI for backend development - Strong understanding of AWS services - Prior experience in the derivatives market is a plus - Proficiency in managing and optimizing databases, including SQL and NoSQL options - Expertise in con...
...time frames, indicators, and thresholds. Technology and Platforms: Programming language: Python (preferred), or any suitable language. Frontend: Simple and user-friendly interface (web-based or desktop-based). Backend: High-performance algorithm with cloud or on-premise hosting. Database: Store historical data, strategy parameters, and trade logs. Risk Management: Automate risk management, including position sizing, maximum risk per trade, and capital allocation. Include error handling to avoid duplicate or erroneous trades. Requirements: Skills Needed: Experience with trading strategies and financial markets. Proficiency in APIs of brokers like Zerodha, Upstox, etc. Strong programming knowledge (Python, Node.js, etc.). Knowledge of algorithms for technical analy...