Web scraping python data science jobs

I'm seeking a skilled data scraper to extract stock prices from Yahoo Finance. The data should cover both the NYSE and NASDAQ. Key Responsibilities: - Scrape real-time and historical stock prices from Yahoo Finance. - Implement data scraping in a way that it can be run periodically. - Store the scraped data into a MySQL database using "INSERT ON DUPLICATE KEY UPDATE" to handle potential duplicates. Ideal Skills: - Proven experience in web scraping, particularly finance data. - Strong knowledge in MySQL and data management. - Familiarity with Yahoo Finance and stock market data. Please bid if you can provide a prototype and have experience in similar projects.

Web developer Company Description Vyas Card is a platform that provides weekly Zodiac sign predictions and recommendations. Users can check different columns represented by stars, with higher ratings indicating better results in areas like Health, Travel, Romance, Work, Luck, Finance, Study, Lucky Number, and Lucky Color for each Zodiac sign. The platform also includes Prediction and Recommendation columns for detailed insights and feedback for the upcoming week based on the stars ratings. Role Description This is a freelancing role as a Web Developer at Vyas Card LLP in Goregaon. The Web Developer will be responsible for tasks related to back-end web development, front-end development, programming, web design, and overall web development. Q...

I need assistance using the Apify API to extract specific fields from a JSON file using Python. The data needs to be well organized and presented in a format that I can easily understand and use. Then need to scrape 2 other simple websites and present all on my server online (UI) Your main responsibilities would be: - Utilize the Apify API to extract data from a JSON file. - Focus on specific fields that I will provide. - Present the extracted data in a clear, well-structured manner. Ideal skills for this project include: - Proficiency in using APIs, particularly Apify. - Strong data extraction and manipulation skills. - Ability to present data in a clear and user-friendly manner.

I'm seeking an experienced researcher to compile a detailed list of private drum instructors across the entire East Coast of the US and Canada. T...enhancing outreach and potential engagement. Key Responsibilities: - Research and document private drum teachers who possess personal websites showcasing their drumming and teaching services. - Gather and verify essential contact details: First Name, Second Name, Email, Web URL, City. - This project requires search engine research and music teacher directories, NOT LinkedIn scraping. Deliverable: - The final list should be delivered in a Google Sheets or excel document. Ideal Skills: - Proficient in web research and data collection. - Familiarity with music teacher directories preferred. - Previous experience...

...on key metrics: 'Volume' and 'Value per Minute'. Key Requirements: - Proficiency in algorithm development and stock market analysis - Experience with programming languages such as Python, R, or similar - Familiarity with technical indicators, particularly 'Volume' and 'Value per Minute' - Understanding of the Indian stock market and cryptocurrency landscape Your task will be to build a robust algorithm that can efficiently sift through vast data sets, providing insights and filtering stocks and crypto according to the specified criteria. CONDITIONS; Refresh time – 10s/ 20s/ 30s/1min - auto cronjob 10 sec Data Source API – Tradingview/Fyer Script – Cryptocurrency (Perpetual) and / Stocks Listed in NSE (...

I am seeking an experienced and skilled developer to create a feature-rich web application for controlling smart lighting devices via the Tuya API. The application should leverage the capabilities of the Tuya API library to offer seamless control over various aspects of smart lighting systems. Pre-designed templates and assets for the web app interface, as well as a pre-built backend library for API interactions, will be provided to accelerate development. Core Features: - On/Off Control: Allow users to power smart lights on and off individually or as a group. - Dimmer Control: Enable users to adjust light brightness with a slider or percentage input. - Color Adjustment: Provide a color picker or similar interface for changing the light colors, including support for RGB and ...

I'm seeking an experienced HTML, CSS, JS, and Python backend developer to help me create a text-based, interactive fiction game. The project is time-consuming and requires repetitive coding, so patience and attention to detail are critical. Key Features: - The game will be web-based. - It will involve multiple player interactions, including multiple choice decisions, text input, and inventory management. - AI (Gemini 2.0 flash) will generate the story, options, and other elements. Ideal Skills and Experience: - Proficient in HTML, CSS, JS, and Python. - Previous experience in game development, particularly text-based games, is preferred. - Familiarity with AI integration in gaming. - Able to produce and manage repetitive code efficiently.

Hello, I have a Synology DiskStation DS220+ and would like to start my Django project on it. However, I’m encountering some issues. I need Python and PostgreSQL for the project. Using the Container Manager, I was able to run containers for both Python and PostgreSQL, but I’m unable to open the project in a browser. I suspect additional configuration is required, but I’m unsure what needs to be done. The Django project is new, so the instructions should also include steps for creating a new project from scratch. I’m looking for a freelancer with relevant experience who can assist me. Specifically, I would like: A detailed installation and setup guide, including steps for creating a new Django project, as well as screenshots and step-by-step instruct...

I'm seeking a full-time Python Django freelancer to assist with API development for a web application. Key Responsibilities: - Implement user authentication - Oversee database integration - Enable real-time updates - Develop an admin panel - Integrate with 3rd party APIs The API will cater to both internal and external users, so experience in creating secure, scalable and efficient APIs is crucial. The ideal candidate should have: - Extensive experience with Python and Django - Proficiency in API development - Knowledge of implementing user authentication and database integration - Capability to facilitate real-time updates - Skill in developing admin panels - Familiarity with 3rd party API integration - Understanding of both internal and external API require...

I'm looking for a skilled developer with extensive experience in algorithmic trading to help me implement a trend-following strategy on the Zerodha trading platform. Key Requirements: - Proficiency in Python: This will be the primary programming language for the development of the trading algorithm. - Experience with Zerodha: Familiarity with this trading platform is crucial to ensure smooth implementation and operation of the algorithm. - Understanding of Trend-Following Strategies: Prior experience in developing and implementing trend-following trading strategies is highly desirable. The goal of this project is to create a robust, efficient, and profitable algorithm that capitalizes on trending market conditions. If you have the necessary skills and experience, I look f...

I'm looking for a skilled professional who can suggest a reliable, low-latency proxy service for my web scraping project. The script currently targets public APIs and without a proxy, it's taking around 200ms to hit the endpoints. With a proxy, I need the latency to be between 300-500ms max. Key Requirements: - The proxy service should be located in Australia - The IP rotation level should be low, with only a few changes per day - The service should not require any specific authentication methods, as the APIs I am using do not require authentication I've previously tested several proxy services but most of them resulted in latency around 750ms, which is not suitable for my needs. Please only bid if you have experience with a proxy service that has a latency u...

I'm looking for an experienced developer who can integrate my Python-based desktop application with Microsoft Active Directory (AD). The integration should support user authentication and user role management. Key Requirements: - Proficiency in Python, particularly in building and modifying desktop applications - In-depth understanding and experience with Microsoft Active Directory - Skills in implementing user authentication and user role management - Prior experience in similar projects would be a plus Please ensure your bid reflects your ability to meet these requirements and your experience with similar projects.

I'm seeking a Python (Django/Flask) and Bash specialist to upgrade an existing benchmark library. I will look carefully for the application so please take time to read and reply carefully. I have two libraries that use bash to run some benchmarks and collect output from it. I need a seasoned developer that can update them. And potentially gather the data into a database and serve them with some backend. Main task for this job is: Add two tests from one library to another and form a JSON from the output of the tests (7zip test and cpuminer test) I do not accept Auto submissions. Also I dont want to work with companies, only freelancers. If you read it carefully reply with: a. Your working time and current load, also your name, location and English level b. Your over...

I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and provide updates on their progress. Thank you for considering my project.

I'm in need of a seasoned sales professional with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note...

I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.

...page. - Food menu. - Guest list. - Add an admin. - seating management Skills and expectations. - Designs will be provided by us. - Companies or individuals should be able to deliver the entire project end to end. - We would expect daily sync meetings and regular commits to github. - During development, work should be added to a stage site so that we can test and provide feedback. - Tech stack: python, JS, Postgres, FastAPI, React, CSS, HTML, mongoDB - Good attention to detail. Front end needs to reflect the ://(Copy)?node-id=0-1&t=lifqOZ7PNssnwuIk-1...

I am encountering a 'Bad Gateway' error in my Django app that needs immediate attention. Additionally, I need a skilled developer to create a new API for my Python Flask project. Key Requirements: - Debugging and fixing the Django app - Creating an API in a Flask project for data retrieval - Handling file uploads via the API This project is ideal for a freelancer with a strong background in Python, Django, and Flask, with proven experience in API development and debugging. Please reach out if you can help me resolve these issues promptly.

I need a Python program that monitors my Hikvision cameras, NVR, and DVR for various events such as motion, line crossing, and intrusion detection. When an event occurs, the camera should push an image of the event to a pre-defined FTP server with specific usernames and passwords. Key Requirements: - The program should be able to monitor: - Motion - Line crossing - Intrusion detection - The program needs to work with: - Hikvision Cameras - NVR - DVR Ideal skills for this job include: - Proficiency in Python programming - Experience with Hikvision devices - Knowledge of FTP protocol - Understanding of event detection

I'm seeking a highly skilled quant/developer team for an ongoing project. I have numerous quantitative strategies that need to be tested, refined, and implemented into trading bots. Key Responsibilities: - Strategy Refin...Creating bots to execute successful strategies. Ideal Team Composition: - A member with a qualification in financial engineering. - Experts in machine learning-based trading systems. Compensation: - The team will be paid hourly for consulting, testing, and bot development. - Additional bonuses will be provided for successful bots that yield a return. Technical Requirements: - Proficiency in Python is a must. - Experience with Interactive Brokers and QuantConnect is required. I look forward to working with a team that is as passionate about quantitative t...

I need a skilled Python programmer to help me automate the order placement on Interactive Brokers. Key Requirements: - Automate the placement of Market orders, Limit orders, and Stop orders - Strong proficiency in Python - Experience with Interactive Brokers platform - Knowledge about different types of trading orders Ideal Skills: - Python programming - Trading experience - Interactive Brokers expertise - Order placement automation I am looking to hire a pythan trading expert, You need to automate trade in Shoonya Broker Account, Automate the buy sell order, It has lots requirment I have attached excel file to fetch and update data, and automate trade, I can choose any interval, It need to fech candle data, more detaiil i wll give if you can prov...

High User Friendly - Web Portal We are seeking experienced professionals with a strong background in web design, web development (particularly in Python and open-source technologies), and graphic design to collaborate on the creation of an advanced web portal. The portal will be similar in structure, design, and functionality to platforms like , , and europeanhhm.com. This is a long-term project with the initial focus on developing a feature-rich and user-friendly web portal that offers modern design, robust functionality, and seamless user experience across various devices and platforms. The ideal candidates should have expertise in Python and open-source technologies, along with a deep understanding of web design principles and gr...

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.

I need assistance with deploying a Django-based Python web application and a Node.js project on my dedicated VPS. Additionally, I require the creation of two APIs for the Python project. The ideal freelancer for this job should have: - Proven experience in deploying web applications on Dedicated VPS - Proficiency in Python and Django and flask - Strong skills in Node.js - Experience in creating APIs - Familiarity with VPS management Please submit your bid if you can deliver this project promptly and efficiently.

I need help converting exam papers in both PDF and DOC formats into a structured CSV file. The exam papers consist of multiple subjects and contain different types of questions, including multiple-choice questio...images, I need the image URLs included in the CSV. - Storage: - All cropped images need to be stored in an S3 bucket. Ideal Skills and Experience: - Proficient in using Tesseract OCR for text extraction. - Experienced in handling both PDF and DOC exam papers. - Skilled in using Python libraries such as OpenCV, Pillow for image processing. - Familiar with document parsing tools like PyPDF2, PDFMiner, python-docx. - Knowledgeable in using AWS SDKs for S3 storage. Goal: - A structured CSV file with all the question data. - All processed images successfully...

I have a Python-based web application that needs to be deployed on my Azure VPS. In addition, I need a RESTful API created for another Python project I have. Key Requirements: - Deploy a web application written in Python on an Azure VPS. - Design and implement a RESTful API for a separate Python project. Ideal Skills: - Proven experience with Azure and Python web applications. - Strong skills in Python and RESTful API development. - Ability to deliver quality work within established timeframes.

I want to create voice agent in python , where on button click i can talk with chatgpt and 11labs intigration

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters

I need a Python-based Telegram bot capable of sending broadcast messages. The bot should allow for manual input of these messages, which will consist of both text and images. Key Features: - Manual input for broadcast messages - Capability to send text and images - Python development Ideal Skills: - Proficiency in Python - Experience with Telegram bot development - Understanding of image and text processing

I need a seasoned programmer with expertise in Python and MySQL to convert a segment of my existing PHP Telegram bot code into Python. Specific Requirements: - The primary focus is on translating the broadcast functionality. - The bot should be capable of sending broadcasts based on user-specified times. - Ideally, the freelancer should be able to understand Hindi as the bot is designed for Hindi speakers. Skills & Experience: - Proficient in Python and MySQL. - Prior experience with Telegram bot development. - Able to understand and translate PHP code to Python. - Understanding of Hindi is a plus.

I need assistance with extracting data from a PDF and placing it into an Excel format I will provide. Key Requirements: - Data extraction from the PDF should be done according to specific column headers in the provided Excel format. - Minor data cleaning is needed during the extraction process. Ideal Skills: - Experience in data scraping. - Proficient in Excel. - Attention to detail for data cleaning.

I need good design recommendations first, then need html, css, javascript development.

...integrates seamlessly into our existing Odoo instance. Ensure data security by replacing real customer names with aliases for users with restricted access. Key Features: Custom Module: Develop a custom Odoo module that captures the required data and generates Sales Orders efficiently. Alternative Implementation: Evaluate whether this functionality could also be achieved using Odoo’s Project module. If so, provide a brief explanation and recommendation. Data Validation: Validate mandatory fields (e.g., customer alias, product, quantity) before creating a Sales Order. Access Rights: Restrict access to real customer names; unauthorized users should only see aliases. Configure user roles to control access to Sales Order creation and sensitive data. Order C...

An AI-powered data extraction tool for marketing sector. The tool would be designed to scrape data from multiple sources, including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The ...

Another scraping project - Need cover art based on ISBN and Author Name

I require an experienced Raspberry Pi and OpenWrt specialist to remote...Raspberry Pi and OpenWrt specialist to remotely set up my dual ethernet Waveshare CM4 board. - The project involves configuring one system as a basic Raspberry Pi and the other as OpenWrt. - The primary operating system for the Raspberry Pi will be Raspberry Pi OS, while OpenWrt will be set up on the other system. - I want simple Python code to run on the Raspberry Pi OS. An ideal freelancer for this project should be well-versed with Raspberry Pi, dual-setup boards, and Python programming. Prior experience with configuring OpenWrt is highly preferable. The ability to work remotely and deliver quality setup is crucial for the success of this project. I want this to be done today and can give remote ac...

...crafting intuitive digital experiences, and a focus on responsiveness and accessibility. You will collaborate closely with me to bring our vision to life. Key Responsibilities Design and develop a visually appealing, user-friendly, and responsive website. Implement voice-to-text chat functionality and integrate APIs for real-time responses. Create wireframes, prototypes, and high-fidelity designs for web and mobile platforms. Ensure a seamless user experience across devices and platforms. Conduct user research, usability testing, and iterate based on feedback. Optimize UI/UX designs for performance, accessibility, and scalability. Collaborate with backend developers to ensure seamless integration. Required Skills and Qualifications Proven experience as a UX/UI Developer or simi...

I'm seeking a talented 3D animator to create engaging and educational animations aimed at women of all lift stages starting from teenage. The content will primarily womens health topics, with the goal of making complex concepts understandable, accessible and entertaining. Ideal Skills: - Expertise in 3D animation software - Previous experience creating educational content - Strong understanding of anatomy, the human body, women's health - Creating warm, pleasant, joyful content What I Need: - Animations that can simplify human anatomy and common womens health conditions. - Content that keeps the user engaged and interested and is trauma informed. - High quality production that can be used for educational series Please provide examples of previous similar work in your bid.

...expertise by… Crafting and answering questions related to computer science in order to help train AI models Evaluating and ranking code generated by AI models Examples of desirable expertise: Currently enrolled in or completed a bachelor's degree or higher in computer science at a selective institution Proficiency working with one or more of the the following languages: Java, Python, JavaScript / TypeScript, C++, Swift, and Verilog Ability to articulate complex concepts fluently in Austrian German. Excellent attention to detail, including grammar, punctuation, and style guidelines Payment: Currently, pay rates for core project work by coding experts range from USD $30 per hour. PLEASE NOTE: We collect, retain and use personal data for our prof...

We're looking for an experienced Backend programmer to help us migrate our complex HR system from Python2 to Python3. Key Aspects of the Project: - Our HR syste...you'll need to be comfortable working with complex systems. - There are several libraries and frameworks that will need to be migrated alongside the code. Experience with these is crucial. - While we do have some automated tests, they are not comprehensive. You'll need to be able to validate your work without relying solely on these tests. Ideal Skills and Experience: - Extensive experience with Python, particularly Python2 and Python3. - Backend programming experience. - Previous experience with complex system migrations. - Familiarity with a variety of libraries and frameworks. - Ability to validate cod...

I need someone to scrape data from a service guide website into a Google Sheets document. The data includes Company Name, address, Name, email, phone, mobile, website etc etc from 9632 entries across 20 categories. Ideal candidates for this project should have: - Proficient data scraping skills - Experience with Google Sheets - Attention to detail to ensure all data is accurately captured from all 20 categories.

...content (photos/videos) through direct messages (DMs). A unique aspect of is that media is sold as if it is being sent "live" in real-time, even though the content is pre-uploaded and organized in sequences called scripts. However, does not currently offer an API. This means the AI will need to interact with the platform through alternative methods, such as browser automation or scraping techniques, to send messages, manage media, and perform other tasks READ REQUIREMENTS IN DOCUMENT BELOW...

I'm looking for an experienced Python programmer to develop a script that trains a Lora model focused on human faces using the SDXL framework. The training must prioritize accuracy and should be done without any graphical user interface (GUI). All parameters must be defined within the Python script. Key Requirements: - The script should handle a dataset consisting of 20 photos for each individual, along with multiple sets of individuals in a loop. - The script must handle the training of the Lora, saving the Lora model, and performing inference using the Lora before proceeding with the training for the next individual. - The script needs to load data per individual. - You need to have a PC with RTX 3090 or higher. Ideal Skills: - Proficiency in Python pro...

I'm looking for a proficient Python developer who can create an automated trading bot for me. The bot needs to operate on the Solana network, specifically interacting with the Serum and Raydium decentralized exchanges (DEXs). The primary trading strategy for this bot will be scalping, which involves making quick, small trades. Key Features: - The bot should be able to automatically buy and sell tokens based on filtering criteria sourced from - It's critical that the bot takes into consideration various technical indicators, as well as social media sentiment and specific token-related factors like whether the developer has sold tokens yet or if there are burned tokens from the developer. Ideal Skills and Experience: - Extensive experience in Python programming - ...

I'm in need of a Python coder who can create a script for my options and futures strategy using the Dhan API. My main purpose for this strategy is income generation, specifically through selling straddles with some adjustments. Key Requirements: - Proficiency in Python and experience with Dhan API. - Understanding of options and future trading strategies, particularly selling straddles. - Ability to implement a code that can utilize my historical data. Ideal Candidates: - Have a strong background in quantitative finance and trading. - Prior experience in developing trading algorithms in Python. - Capable of delivering efficient, well-documented, and easy-to-understand code.

I'm seeking a professional who can proofread and edit a scientific book I've written and also design an appealing cover for it. Proofreading & Editing - The primary focus is correcting grammar and spelling mistakes. Improve flow and readability. - Familiarity with the MLA or APA style guide is essential, as this is the style guide to be used for the proofreading process. Cover Design - The cover needs to be visually engaging and appropriate for a scientific book, yet accessible to a wider audience. - Previous experience designing covers for books, especially scientific ones, will be a plus. Skills & Experience - Strong command of English language for proofreading and editing tasks. - Experience with the MLA style guide. - Demonstrated ability in book cover design. - Pr...

About the Company: BEQ Science is a digital health startup focused on improving senior care through innovative balance monitoring and early intervention solutions. Our app helps doctors remotely monitor patients’ balance and fall risks, aiming to reduce falls, address opioid misuse, and slow neurological decline in aging populations. What You'll Be Working On: We are looking for an experienced grant writer to help us secure funding from federal, state, and foundation grants. You will collaborate with our CEO, product development team, and external clinical advisors to craft compelling grant proposals that highlight our innovative technology and its potential to transform senior care. Key Responsibilities: Research and identify relevant grant opportunities, including fe...

I'm seeking a skilled writer with a strong background in Biology and science research to help me pen an experimental-based research paper. Ideal Skills: - Expertise in Biology - Proficient in academic writing - Experience in writing research papers - Understanding of experimental research methodology - Ability to articulate complex concepts clearly - Understanding of pesticides, mode of action, exposure to pollinators

I'm looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone numbers, from various sources. Key Requirements: - Proficiency in data scraping from company websites, business directories, and social media platforms. - Experience in lead generation. - Expertise in logistics, warehousing, and ecommerce sectors is a plus. Ideal Skills: - Data mining - Web scraping - Lead generation - Knowledge of ecommerce and logistics industry