Website scraping with python using beautifulsoup and scrapy jobs
I'm seeking a part-time Python & Qt developer to collaborate with my team on various customer-driven applications, primarily desktop and embedded systems. Key Responsibilities: - Collaborate with existing team members on diverse application development - Primarily focused on desktop and embedded systems - Potential to transition to full-time based on workload and performance Ideal Candidate: - Proficient in Python and Qt for Python - Intermediate experience in hardware and firmware development - a plus - Capable of developing user interfaces and automation scripts - Excellent English communication skills Please note, different projects will have different requirements. Project specifics will be shared ...
I'm encountering significant response time delays with my code using , particularly when receiving the group list and group messages. I've attempted some basic optimizations, but they haven't worked. I'm seeking a developer who is: - Highly familiar with - Experienced in Python - Skilled in code optimization and error handling Your expertise will help me enhance the performance of my code and resolve these issues. this is not a coding project, but teaching and mentoring
I have developed an algorithm in Python as part of my learning process, focusing on Data Structures and Algorithms. However, I am experiencing difficulties in formatting it as per specific requirements. I am seeking expert guidance from professionals proficient in Python and algorithmic structuring to help resolve this issue efficiently. Please provide clear recommendations and solutions for optimal structuring and formatting of the algorithm.
My Telegram bot, scripted with python-telegram-bot library, needs to be thoroughly checked for proper functionality and enhanced with some new features. Key Tasks: - Implement data logging to keep track of user activity and system errors. - Add a set of custom commands focused on information retrieval. - Conduct a comprehensive review of the bot to ensure its operating as intended. Ideal Skills: - Proficient in Python and the python-telegram-bot library - Experience with bot development - Familiarity with data logging and command creation - Ability to debug and troubleshoot system errors - Capable of implementing user activity tracking
...to build a website similar to with some additional features and a modern minimalist design. The primary difference lies in the implementation of a chatbot and integration of Stripe for seamless payments. Using WIX Key Requirements: - Development of a user-friendly, modern and minimalist e-commerce platform - Integrating a chatbot for customer interaction and support - Incorporating Stripe as the payment gateway for secure transactions - Ensuring the site has the same product offerings as , with room for a few variations Ideal Skills: - Proficient in e-commerce website development - Experienced with chatbot integration - Familiar with Stripe payment gateway - Strong understanding of modern minimalist design p...
I'm seeking a data scientist with robust machine learning expertise specifically in the area of classification. The project will primarily involve dealing with text data. Key Responsibilities: - Apply machine learning techniques to classify text data. - Interpret the results and provide insights. Ideal Skills: - Proficient in Python or R. - Experienced with libraries such as scikit-learn, TensorFlow or Keras. - Strong background in natural language processing (NLP) would be a plus. Experience: - Prior experience with text data classification. - Evidence of successful machine learning projects in your portfolio.
...multiple locations and specific product IDs. here is the app: I have attached the locations, productids for which data needs to be scraped. I have also attached the sample data for fields which we need. Key Requirements: - Scrape data from the Costco mobile app for various locations and product IDs. - Gather a pre-defined list of information for each product (to be shared in an Excel file). - Output the data in a CSV file. Initially, I need the data for one location. If the first batch is successful, I will require the code used for the scraping as well. Ideal Skills: - Proficient in data scraping and using tools for web and app data extraction. - Experience with Python or similar programming languages for scrapin...
I need a Python script that fetches livestock prices of the Current Option strike price (i.e. ATM) of Nifty, such as LTP, Hekin Ashi open, Hekin Ashi close Hekin Ashi high, and Hekin Ashi low every 3 minutes. The data should be formatted in JSON. Remember Values should match exactly with the respective broker. Ideal Skills: - Proficient in Python - Experience with data retrieval from financial platforms, specifically Angel Broking - Familiarity with NSE and BSE stock exchanges - Knowledge of JSON data formatting - Ability to schedule tasks at regular intervals Please provide a bid if you can deliver this project.
I am looking to scrape Facebook profiles using the Facebook Graph API. I need someone who has access to a valid Facebook Graph API key and is experienced in using it to scrape data efficiently. The task involves scraping up to 120,000 profiles daily in 1 month, and you must ensure that the API key remains active and does not expire during the process. I just need the facebook profile result and I don't need the Graph API Key on my side. If you can do this, I want to discuss more detail.
I am seeking a skilled Python developer with expertise in Flask to help me build a custom web application. Key Requirements: - Proficiency in Python and Flask framework - Strong web development skills - Experience in creating custom web applications - Ability to understand and translate project requirements into functional web features The ideal freelancer for this project will be able to work efficiently, deliver high-quality code, and communicate effectively. If you have experience with Flask and are passionate about web development, I would love to hear from you.
...the Caribbean market, enabling individuals and small service providers to accept payments for informal services like tours. The app will link with CashApp and simplify transactions using QR codes, phone numbers, NFC, and link payments. Core Features User Registration & Authentication User sign-up via email, phone number, or social media. Two-factor authentication (2FA) for security. Basic KYC (Know Your Customer) checks for compliance (e.g., photo ID, address). Payment Integration CashApp Integration: Enable linking CashApp accounts for seamless transfers. Support direct payments from CashApp to the app wallet. Support for major payment methods: debit/credit cards, bank transfers, and mobile wallets. Ability to request and send pa...
...skilled programmer with a strong background in web scraping, automation, and data analysis. The objective of this project is to develop a personal efficiency optimization tool that can extract and process relevant information from various websites. Key tasks and requirements: - Design and implement a web scraping system capable of gathering diverse data from multiple websites. - Utilize automation to streamline the data collection process and enhance efficiency. - Process the scraped data and present it in a user-friendly JSON format. - Implement data analysis features to extract insights from the collected information. The ideal candidate should possess: - Proficient programming skills with extensive experience in ...
I need a web scraping application to collect product auction data from a specific website: The primary focus of the project is on gathering historical data. The ideal freelancer for this project should: - Have extensive experience in web scraping and data extraction - Be proficient in using web scraping tools and programming languages, such as Python and Beautiful Soup - Have a good understanding of how to collect and store large amounts of data - Be able to create an efficient and reliable web scraping app Please note, this project does not require real-time updates or automated bidding features. The main goal is to track and collect historical auction data for product analysis. Additionally, a d...
I'm loo...to enhance both the Admin and User Panels of my website. Key Responsibilities: - Improve the User Interface of the Login page, Dashboard, and Settings page - Optimize the overall performance of the website - Integrate a secure and efficient deposit and withdraw system Technologies: - Frontend: React.js, , TypeScript - Back-end: TypeScript, NestJS, Python - Database: MongoDB, Redis The ideal candidate for this project should have: - Proven experience in UI/UX design and implementation - Strong skills in performance optimization - Familiarity with integrating complex systems like a deposit and withdraw system - Expertise in the technologies mentioned above Please note, I am particularly interested in fre...
...professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company profile must encompass key details like the company name, and its associated emails (e.g CEO email, Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you'...
I'm looking for a skilled Python developer with experience in web scraping. The task involves extracting text data from various websites. Ideal Skills and Experience: - Proficient in Python programming - Extensive experience with web scraping - Familiarity with web scraping libraries such as BeautifulSoup, Scrapy, etc. - Good understanding of data handling and processing - Ability to work with a variety of websites
...into an automated trading bot. The bot will need to execute trades based on a trend-following strategy, and it should be compatible with Zerodha or any other Indian broker. indicator link - to be implemented on nifty future timeframe - 3 minute or 5 minute (should be configurable) quantity - should be configurable Bot should have On/Off button Bot to be deployed in such a way that it automatically starts 9.15 AM IST Monday to Friday. Key Requirements: - Proficient in Python, with previous experience in developing trading bots - Familiarity with TradingView indicators - Understanding of trend-following trading strategies - Knowledge of integrating with Zerodha or other Indian brokers The ideal candidate will deliver a high-quality, effici...
...Administration Services company and should have features like blog publishing with comments, user login, and subscription capabilities. While it isn't overly complex, the site needs to be SEO friendly and hosted on our private cloud infrastructure. Key Requirements: - Frontend Development: The site needs to be built using a proper frontend framework (JavaScript based framework like React), providing a seamless, interactive user experience. - Backend Development: You should have experience with Java, Python, or Ruby as we are flexible on the choice of the backend technology. Either Java (Spring Boot) or Python (DJango) or Ruby (Ruby on Rails) - SEO Optimization: The site should be designed with SEO best practices in min...
...professional agency capable of curating and delivering a detailed database of 7,000 US companies. Each company profile must encompass key details like the company name, and its associated emails (e.g CEO email, Owner email, Founder email etc.) along with the website. Key Requirements: 1. All data must be current and verified for precision. 2. Data must be sourced from credible platforms to ensure uniqueness, eliminating any duplication. 3. Final data should be presented in an orderly Excel or Google Sheets format. 4. Timely delivery within 7 days from the project start date. 5. Proficient use of data scraping and verification tools and platforms. Please ensure to read the project description carefully before bidding. If you'...
I'm in need of a bot that can scrape contact details off a specific website and store them into a spreadsheet. Ideal Skills: - Proficient in web scraping and bot development - Familiar with Python and libraries like Beautiful Soup, Scrapy, or Selenium - Experience with data handling and spreadsheet automation Please note: The specific website to be scraped will be disclosed to the selected freelancer. Prior experience with scraping contact details is a plus. Please provide examples of similar projects you've completed.
I need a Python script that reads amounts from a CSV file, verifies stock tickers across NASDAQ, NYSE, and S&P 500, and places market orders using TWSAPI. The script should log an error if it encounters an invalid or unverified ticker. Key Requirements: - Read amounts from a CSV file. - Verify stock tickers from NASDAQ, NYSE, and S&P 500. - Place market orders using TWSAPI. - Log errors for invalid or unverified tickers. Skills and Experience: - Proficiency in Python. - Experience with TWSAPI. - Familiarity with stock market tickers and order types. - Ability to work with CSV files.
I'm looking for a skilled developer to create a Solana API bot for me. The specific requirements are still being finalized, so I would appreciate a flexible approach and open communication. Ideal skills and experience for the job include: - Proficiency in Solana and its API. - Strong programming skills (Python, JavaScript, etc.). - Prior experience in creating trading bots or cryptocurrency bots. - Understanding of blockchain technology. - Ability to work with cloud-based platforms. Since the project specifics are not yet defined, the developer's ability to propose, implement and adapt to changes will be crucial.
Hi I need support Python with development indian time 9:30 am to 10:30 am Tuesday to Saturday..this support will be on zoom meeting. Which we will provide you. And you will connect with my consultant and support him. Hourly 11$. Payment every saturday ..
...applications on the market, each of these has a focus and a target audience. The University of Guayaquil, in its desire to strengthen the relevance of its students, has considered the option of building the social network AlumniUG. The purpose is for it to be a tool that allows them to interact on topics of common interest to the entire university community. What is required: Design a web application (prototype) that meets the expectations of the UG, for which it has given free rein for the design and functional requirements of this, however, it is important to take into consideration that it is a social network for university students, and there are also certain parameters that must be met: • The system architecture is programming and consumption of mi...
...are seeking a skilled and innovative 3D modeler with expertise in creating realistic human models to join our team for an exciting company project. The ideal candidate will have a strong portfolio demonstrating proficiency in human anatomy and character design. You will be tasked with delivering high-quality, accurate 3D models that align with our project requirements and collaborating seamlessly with our team. About the Project: We aim to develop a sophisticated pipeline capable of generating custom 3D models of individuals from images or body scans. This is not about manually crafting 3D models in software like Blender, but rather creating an automated system for producing virtual characters of any individual. The project requires deep...
I'm seeking an experienced...application will be on data processing. Key Requirements: - Expertise in desktop application development with a strong emphasis on Windows OS. - Proficient in creating applications with complex data processing capabilities. - Previous experience designing user-friendly interfaces on desktop applications. Ideal Skills: - Proficiency in programming languages suitable for Windows desktop applications (e.g. C#, Java, Python). - Experience with data processing algorithms and techniques. - Strong understanding of user interface design principles. We are a small nonprofit that needs help with a simple computer program to help us. I look forward to your proposals and hope to work with a pro...
I'm in need of a web scraping professional to capture social media posts and store them in a database. The ideal candidate will utilize a JavaScript-based Chrome extension scraper, with GraphDB and MongoDB for managing the data. Skills and Experience Needed: - Proficient in web scraping, particularly with social media platforms - Experienced in using JavaScript-based Chrome extension scrapers - Familiar with GraphDB and MongoDB for database management - Ability to comprehend and implement detailed requirements - Prior experience with scraping various types of social media posts is a plus - Knowledge of real-time and periodic scraping techniques Please note, detailed requirements ...
I need a Python script that preprocesses images of identification cards so that Tesseract OCR can read and extract from it effectively. The script should perform the following preprocessing tasks: - Noise reduction: The images may contain noise that can hinder OCR accuracy. - Resizing and cropping: The images need to be resized and cropped to a standard size for consistent OCR performance. - Contrast and brightness adjustment: Some images may be too dark or too bright, which can affect OCR performance. Ideal candidates for this project should have: - Extensive experience with Python and image processing libraries like OpenCV or PIL. - Familiarity with OCR tools, particularly Tesseract. - Ability to write clean, efficient, ...
I need a Windows-based desktop application that auto...need a Windows-based desktop application that automates web logins and fetches data for testing purposes. This application will download a list of data in form of a table, then send them to my broker platform in order to make sell/buy transactions. I use Visual Studio, C#, with Selenium. I can provide you with a small example to show you. You will have the opportunity to ask me for additional information. You also notice that the trading platform credentials are saved locally only Ideal Skills and Experience: - Proficient in desktop application development for Windows - Experienced in web automation and data scraping - Knowledgeable in handling various types of data - Able to ensure the applic...
We are seeking a skilled and reliable freelancer to assist with automating the upload and processing of PDFs using n8n and integrating the results into a Supabase database. The role involves working with both native PDFs and scanned PDFs requiring OCR (Optical Character Recognition). Responsibilities: PDF Handling: Upload and process native PDFs directly. Use OCR to extract text from scanned PDFs (image-based). n8n Workflow Development: Create or enhance workflows in n8n to automate PDF uploads. Configure nodes to distinguish between native PDFs and scanned PDFs for appropriate processing. Ensure OCR is applied only to scanned PDFs or PDFs containing images. OCR Integration: Use suitable OCR tools (e.g., Tesseract, AWS Text...
Please Sign Up or Login to see details.
I'm seeking a seasoned freelancer well-versed in Node.js, Python, and Azure AI API. You will be refining my existing code and enhancing the Azure AI integration. Key tasks include: - Implementing AI Humanizer and multilingual recap (Spanish, French, German) features into the system. - Optimizing the performance of the Azure AI integration. The project involves processing images from a 'manhwa' folder. The code slices the images, generates a summary using ChatGPT, converts the summary into voice using TTS, and finally combines it with the images to create a video. Note : This is all you have to do for the project and the amount you bid is the amount i pay when you add recap in different language add a new slec...
Hi, i am currently working on a project which is based on microsoft 365 api's. The project is almost complete just a few functionalities are left which are required to be done on urgent bases. Microsoft 365 api of viewing and downloading an attachment. I have downloaded the attachment but its not opening. Need A developer who is familiar with using Microsoft 365 api's
...application aims to connect local businesses (restaurants, bakeries, supermarkets, etc.) with users interested in purchasing unsold food that is still in good condition. This will help reduce food waste while offering users discounted products. Platforms: Mobile: Android and iOS (ideally developed with Flutter or React Native for cross-platform compatibility). Web: Admin panel for businesses and system administrators. Key Features: For Users: Sign Up and Login: Options to register via email, Google, or social media. User profile with purchase history and preferences. Browse Offers: Interactive map to locate nearby businesses with available offers. Filters by business type (bakery, restaurant, etc.), price range, and dis...
I need a skilled data scraper to extract information on a...extract information on auto parts from various sources. You will be responsible for collecting the data, organizing it into a CSV file, and ensuring it's properly formatted for Shopify. Key Responsibilities: - Scrape data from retail websites, manufacturer websites, and third-party marketplaces. - Collect product names and descriptions, prices and availability, and manufacturer details and specifications. - Organize and format the scraped data into a CSV file for Shopify upload. Ideal Skills and Experience: - Proficiency in web scraping tools and software. - Experience with Shopify and knowledge of its CSV formatting requirements. - Atten...
I'm in need of a skilled web scraper capable of extracting data from a webpage with 5,500 products. These products do not have variants, which should simplify the task. Data to be scraped: - Product name - Product Part Number - Product description (The product descriptions aren't formatted the same way for each product. They are inconsistent but similar.) The final deliverable should be an Excel/CSV file containing all the scraped data, sorted by product name. Ideal skills for this project include: - Proficient in web scraping - Proficient with AI - Experienced in data organization and Excel/CSV Please, only bid if you can deliver quality work in a timely manner. Thank you!
I’m seeking a skilled coding and IT professional to join my team for a long-term partnership. You’ll work on creative and innovative projects, with a focus on integrating and using AI programs like APIFY. Requirements: Strong coding and IT skills (portfolio/examples of work preferred). Experience with AI tools such as APIFY or similar programs. Proficiency in programming languages (e.g., Python, JavaScript). Good problem-solving and communication skills. Why Join? This is a chance to collaborate on exciting AI-driven projects with growth potential. Payment will be a mix of fixed rates and project-based percentages. If you’re experienced with AI tools and excited about innovation, ...
Uber like app There is an uber like app available as open source, I want someone to customise it for me and upload to my server What I want is the following: User App (Rider): User registration/login: Via email, phone, or social media. Ride booking: Input destination, choose vehicle type, and calculate fare. Live tracking: Real-time GPS tracking of the ride. Payment options: Credit/debit cards, mobile wallets, and cash. Notifications: For ride status updates (e.g., driver arrival). Ride history: Past trips, fares, and driver details. Ratings and reviews: For driver performance. Driver App: Driver registration/login: Verification process for drivers. Profile management: Vehicle details, personal information. Ri...
Candidate from Pakistan and Bangladesh are preferred to work for Malaysian Client Job Description: We are seeking an experienced Senior Vue.js Developer with 8-10 years of professional experience in front-end development. The ideal candidate will possess strong expertise in Vue.js and a deep understanding of front-end frameworks, UI/UX principles, and the ability to deliver high-quality, scalable, and maintainable solutions. Key Responsibilities: Design, develop, and maintain advanced front-end architecture using Vue.js and supporting libraries. Collaborate with cross-functional teams, including designers, back-end developers, and product managers, to deliver robust and user-friendly applications. Optimize appli...
Hi I need support Python with development indian time 9:30 am to 10:30 am Tuesday to Saturday..this support will be on zoom meeting. Which we will provide you. And you will connect with my consultant and support him. Hourly 11$. Payment every saturday ..
I'm seeking a professional skilled in Natural Language Processing and web scraping. The primary task will be data extraction from various websites, specifically product information. Key Responsibilities: - Design and implement an efficient web scraper to collect product data from e-commerce, manufacturer, and retailer websites. - Utilize NLP techniques to enhance data extraction and processing. Ideal Skills: - Proficiency in web scraping tools (like BeautifulSoup, Scrapy, Selenium etc.) - Strong background in Natural Language Processing. - Experience with data extraction from e-commerce and manufacturer websites. - Familiarity with Python or similar programming languages. Please provide examples o...
I'm looking for a coder to create a program that will log into my driving school's website, scan for cancelled test dates, and alert me when one is found. Key Requirements: - The program should allow me to manually change search dates on a weekly basis. - Ideally, it will be coded in a user-friendly language or framework, such as Python, JavaScript, or Java. - I would like to discuss the best alert system for when a test is found - potential options could include email, SMS, or a popup notification. Skills and Experience: - Proficiency in coding and web automation. - Experience with creating alert systems. - Able to explain technical details in an easy-to-understand manner.
I'm seeking a data research expert with a strong background in data scraping. Your task will be to gather relevant data on gyms in Qatar. Ideal skills and experience for the job include: - Proficient in data scraping techniques - Able to filter for relevant data - Attention to detail - Prior experience with data research Please note, the specifics of the data types needed (contact details, number of members, available facilities) and the primary source of data (websites, social media, public records) will be determined based on your expertise and the information available. While the preferred format for final data delivery hasn't been specified, previous projects have typically used an Excel spreadsheet or a CSV file. A famili...
I need a freelancer to convert a Python script to Cython. This is primarily to allow for integration with C/C++ code. Key requirements: - Experience in Cython and Python - Knowledge of C/C++ for seamless integration - Ability to implement function inlining optimizations in Cython - Familiarity with multi-threaded and single-threaded Python scripts, with the ability to assess and adapt as necessary Please note, while I'm unsure if the script is single or multi-threaded, the script will likely need to be capable of handling both scenarios. Your expertise in Cython optimizations and integrating Python with C/C++ will be crucial for the successful completion of this project.
I am seeking skilled and experienced developers to create a high-quality CSGO/CS2 gambling site inspired by platforms like CSGOEmpire. The website should deliver an engaging, secure, and seamless experience for users, featuring popular games such as Roulette, Coin Flip, and Case Battles. Key Features & Requirements User Experience: A visually appealing, responsive, and intuitive interface optimized for both desktop and mobile users. Smooth gameplay with minimal load times. Steam Integration: Support for Steam login to enable secure user authentication and item integration. Integration with CS2 skins for deposits and withdrawals. Games & Mechanics: Well-designed and fair gaming mechanics for Roulette, C...
Hi I need support Python with development indian time 9:30 am to 10:30 am Tuesday to Saturday..this support will be on zoom meeting. Which we will provide you. And you will connect with my consultant and support him. Hourly 11$. Payment every saturday on pay*pa*l
...the user's financial questions in a professional and detailed manner. Also add a basic documentation file with technical details about the app. Technologies- ● Use ReactJS and Node.js to create the application (You can use some UI and backend template projects to get started). ● T o power the AI, make use of ChatGPT's Assistant API. Feature description: ● Make use of the Assistant’s System Instructions to determine the general personality, style of writing, way of formatting answers, etc. Also include how the assistant can get the financial reports to analyse. ● Allow the user to ask questions about their data. Use Function calling to make the data available to the assistant ● For returning users, make use of Assistant API's threads to fe...
