Web crawling and scraping using python işler

I'm looking for an experienced Python developer to create a custom Linux software that interacts with OpenAI/Whisper code for audio transcription. Key Requirements: - The software should allow me to specify a filename or a folder containing either a single file or multiple files to be transcribed. - It should process these files sequentially. Ideal skills include: - Strong expertise in Python and Linux. - Experience with OpenAI/Whisper code. - Solid understanding of audio transcription processes. Install and configure open ai whisper on our test server

I'm seeking a freelancer to compile a detailed, monthly updated database of USA credit cards for a public website or app. Key Requirements: - image of the card. - Information on Interest Rates and Fees: Understand and gather data concerning the cost of owning the card. - Rewards and Benefits: Identify the perks associated with each card including cash back, travel points, etc. - Eligibility Requirements: Document what is needed to qualify for each credit card. Ideal Skills: - web scraping, cleaning and storing data - Familiarity with web/app data requirements Please note: This project will require a commitment to quarterly updates.

I'm seeking a skilled Python developer to create an adaptable API for my project. The primary purpose of the API is to facilitate data exchange between services. Key Tasks: - Design and implement a Python-based API - Tailor the API type (RESTful, GraphQL, SOAP) to project needs - Ensure seamless data interchange between various services Ideal Skills: - Proficiency in Python - Extensive experience in API development - Hands-on knowledge of various API types (RESTful, GraphQL, SOAP) - Strong understanding of data exchange processes

¡Desarrolla la Plataforma E-commerce Líder para Envíos a Cuba! Descripción del Proyecto: ¿Eres un experto en desarrollo web con pasión por el e-commerce y la innovación? ¡Esta es tu oportunidad! Buscamos un equipo de desarrolladores talentosos para crear una plataforma de comercio electrónico de vanguardia que revolucione la forma en que los cubanos adquieren productos desde Estados Unidos. Imagina una plataforma que permita a los usuarios en Cuba acceder a una amplia gama de productos de tiendas online estadounidenses, realizar compras de forma segura y recibir sus pedidos directamente en su puerta. ¡Eso es lo que construiremos juntos! ¿Por qué este proyecto es único? Impacto social: Facilit...

...Chatbot on Azure SQL with LangChain and Chainlit Project Description: We are looking for an experienced developer to build a chatbot that integrates with our existing Azure SQL database, leveraging LangChain for LLM-based query orchestration and Chainlit for the frontend chat interface. The chatbot will enable users to interact with and retrieve insights from data stored in our database using AI. The project involves: Setting up Azure SQL with vector support for embedding and similarity search. Developing Python scripts using LangChain to handle data retrieval, embedding generation, and prompt orchestration. Integrating the backend with Chainlit to create a user-friendly, scalable chat interface. Key Deliverables: A functional ...

I'm looking for...specifics of the project, including the type of machine learning task, industry relevance, and data type, are yet to be defined. Ideal Skills: - Extensive knowledge of various machine learning techniques and algorithms. - Proficiency in Python and relevant ML libraries (e.g., TensorFlow, scikit-learn, Keras). - Strong statistical and data analysis skills. Experience: - Prior projects in Machine Learning, with demonstrable success. - Experience in industry-specific projects (especially in Healthcare, Finance, or E-commerce) will be a plus. - Proven track record of working with different data types (Text, Image, Numerical). Please note that the project details will be provided later. Your ability to adapt and provide valua...

I need a skilled web scraper who can extract data from a members area of a website. The data should be compiled and delivered in an Excel file. Website Scraping of Members Area Ideal Skills: - Web scraping expertise - Proficiency in Excel - Attention to detail

I need three Python scripts for an analysis project involving NASDAQ data . These scripts will scrape stock prices and dividends from free stock data site (i.e., ), place the data in a single-sheet Excel file, and create a line graph similar to an attachment I will provide (). Script 1: Download stock prices (for a year - Download Historical ) and dividend data (for a year) for a given stock Script 2: save data to a single-sheet Excel file Script 3: Create a chart in the Excel file The ideal freelancer for this project should have: - Extensive experience with Python, particularly with libraries for web scraping and data analysis. - Proficiency in creating and manipulating Excel files with Python. - Skills in data visua...

I'm in need of a skilled programmer who can create an independent bot for me. The bot's main task will be to retrieve cer...will be to retrieve certain information from a secure website. Key Requirements: - The bot should be able to log into the site with provided credentials. - It should collect specific user data, particularly user activity and user messages. Ideal Skills: - Proficiency in programming languages such as Python, Java, or similar. - Prior experience in web scraping and bot development. - Understanding of data security and ethical considerations in data retrieval. - Ability to deliver a reliable, efficient, and independent bot. Please note: The target website is secure and requires login credentials. The ...

Hi. I would like to scrape oddsportal for game results,closing and opening all odds import them into excel. I am interested in soccer matches. The scraper should be able to scrape data according to date i.e. I would like to input a date range and sport (soccer) and get the match details for those matches. Further details will be discussed with bidder. I should also mention that date range for scrapping data could be quite long (i.e. months) so the output xls could be quite big. It is very important to me that scraping is done as quickly as possible (seconds) with as less clicks as possible and without hanging-up or crippling my PC while scraping. PROJECT DETAILS: Sport:----------------------Football Bookmaker:------------------Bet365, BWIN, P...

I'm looking for an expert in AI tools to scrape a website for me. The goal is to extract specific contact information and organise it neatly in an Excel sheet. Data to be Scraped: - Email addresses - Phone numbers - Names - Zip Codes The ideal candidate should have prior experience in web scraping and data management. Proficiency in using AI tools for this task is crucial. Data Formatting: - I need the data to be sorted into separate sheets for each type of information. Please provide examples of previous similar tasks you have completed successfully.

I’m looking for a skilled developer to help complete and debug a nearly finished web application project. My original programmer was 95% done but has gone MIA, leaving the script untested and unfinished. The project is ready for final touches and testing in a dev environment. About the Project: The application is designed to track and analyze trade ideas from Telegram groups. The key features include: Telegram Group Downloader: - Use the Telegram Client API (e.g., Telethon or Pyrogram) to download messages from public groups. - Extract trade details such as: - Coin/Pair (e.g., BTC/USDT) - Entry points - Stop Loss (SL) - Take Profit (TP) levels Trade Tracking: - Record each trade’s entry, SL, and TP levels. -...

...programmer to step in and finalize a project that’s 95% complete. My original developer went MIA before testing or deploying the script in a development environment, leaving the work unfinished. The project has solid foundations but needs someone to test, debug, and ensure it’s fully functional. What You’ll Be Working On: Components of the Application: 1. Website data download: - Uses libraries like BeautifulSoup and requests to download website data. - Extracts specific information, such as brand, type, model, and cost. 2. Database Setup: - MySQL database to store downloaded data. - SQLAlchemy (Python ORM) for seamless database interaction. 3. Backend and Frontend: - Flask-based web interface for searching, sorting...

I need help deploying a WhatsApp bot on my hosting. We're utilizing Twilio and Chat GPT for this project. Key functionalities: - The bot should be capable of providing automated responses. - It should also serve as a tool for customer support. Twilio and OpenAI API: - Both Twilio and OpenAI API keys are already set up. Skills Required: - Proficiency in Python or relevant programming languages - Prior experience with Twilio and Chat GPT - Knowledge of customer support bots design Please note that the specifics of the trigger types for automated responses are yet to be determined. Your input on this would be appreciated.

I'm looking for a designer with strong Flask/Python skills to transform my current home page and login page into two separate, classic and elegant style pages. Key Responsibilities: - Redesign the existing jinja templates (that I'll provide upon project award) into a modern, minimalist style that is also classic and elegant. - Ensure the home page includes 'Featured products/services' as a key element. - Enhance the login page with additional features: a 'Remember me' checkbox and a 'Forgot password' link. Ideal Skills: - Proficient in Flask/Python with a focus on design. - Proven experience in creating modern yet classic and elegant web pages. - Familiarity with jinja template redesign.

I am looking for an expert in automation and data scraping to set up scenarios in MAKE that link with my social media accounts and chat GPT. The goal is to have CSV files automatically publishing across all platforms with AI generated lifestyle images featuring my product. Additionally, I need assistance with data scraping for emails in my group. Ideal Skills: - Proficiency in using MAKE for automation - Experience with social media management - Ability to work with CSV files - Familiarity with AI image generation - Skills in data scraping Social Media Platforms: - Facebook - Instagram - TikTok CSV File Format: - Comma-separated values Type of AI-Generated Images: - Lifestyle images with my product

...Increase the visibility and organic traffic of a German-language WordPress website on Google using legal (White Hat) SEO practices. The site is correctly integrated with Google Search Console (GSC) and uses RankMath for SEO optimization. Despite previous efforts in SEO and page speed optimization, the AI-generated content is underperforming in Google rankings. A strategic approach focusing on resolving GSC errors and enhancing overall site visibility is required. --- ### Scope of Work: 1. **Google Search Console (GSC) Error Analysis & Resolution** - Analyze all reported errors and warnings in GSC. - Identify root causes and implement solutions directly within the WordPress environment. - Ensure all fixes are aligned with G...

...calling script using Python, focusing on creating a voice bot for outbound B2B calls. Current Setup: Files in Local Directory: A Python script A .env file for environment variables Text files named: "response" for logging call outcomes "numbers" presumably for storing phone numbers to call "data" containing information about companies or products "botprompt" for predefined bot interactions or scripts System Architecture: Speech-to-Text (STT): We will use the Deepgram API to convert speech to text. Language Model (LLM): For processing and generating responses, we'll utilize the OpenAI API with the gpt-4o-mini model. Text-to-Speech (TTS): We will convert text back to speech using the OpenAI API with the &qu...

... The IB module should support multi-levels and have minimal customization requirements. Please note the following: - The integration involves purchasing the source code of the IB module and incorporating it into our current CRM system. - The backend of our CRM is built in Python. - You must have a Forex CRM already working with credentials for us to navigate the IB module. - This is not a development from scratch you must have it running already to be considered. Key Responsibilities: - Source and purchase the IB module's source code. - Full integration of the IB module into our Forex CRM. - Ensure the IB module supports multi-levels. Required Skills and Experience: - Proven experience in Forex CRM development. - Extensive knowledge of Pyth...

I'm looking for a skilled front-end developer with experience in VueJS and REST APIs to create a comprehensive front-end application using HTML-5 Template from my library. Key Features: - User Authentication: The application should allow users to register, login, and manage their profiles using their email and password. - Search Functionality: Implement a robust search feature to navigate through the application. - Data Visualization: Integrate various data visualizations to present information in an engaging and understandable way. - Application Web Page: Single Page Web site + Contact Form - Admin Panel: Create a fully functional admin panel for overseeing the application. Ideal candidates should have: - Proficient experience...

I have a 3D character with animations in GLB format, created in Blender. I need to copy these animations to other characters, which are based on the same model but have different outfits. Ideal skills and experience for the job: - Proficient in Blender - Experience with 3D character animation - Ability to modify animations for different outfits - Familiarity with working with GLB files

I'm seeking a talented designer to create a modern, sleek photography logo for me. The logo should represent a sunset using thin lines – a unique and stylish twist that resonates with my brand. Key requirements: - No camera in logo -Sunset studio written below logo using thin font -Light beige or light orange background

I need a skilled freelancer to write Selenium code that automates form filling on various e-commerce websites. Key Requirements: - Proficiency in Python and Selenium - Experience with form filling automation - Knowledge of e-commerce site structures - Ability to ensure smooth functionality on Chrome browser

Skrypt pobierający dane z obcej strony i dopisujący do bazy serwisu internetowego. Technologia serwisu: Python/Django/Docker. Baza: Postgres Preferowane osoby komunikujące się bez problemu w języku polskim.

...involve: - Scripting with Python to automate data pipelines and manipulate data. - Utilizing SQL for query optimization, managing joins, and performance tuning. - Employing Postgres for relational data modeling and management. - to produce clear reports or dashboards showcasing insights and progress. The ideal candidate will also be able to: - Understand or utilize AI-based techniques for data scraping. - Conduct exploratory data analysis, performing data cleaning and feature engineering as necessary. A critical part of the role will be translating business objectives into technical requirements. Hence, strong verbal and written communication skills are necessary for interacting with stakeholders. Your ability to produce clear r...

...looking for a Python expert who can create a code to convert any PDF (as input) into an HTML that mimics a magazine layout, complete with flipping effects. This should be accomplished solely with CSS, without any reliance on Javascript. Key Requirements: - The HTML should facilitate a page-flipping effect when the user clicks on the right or left page. - The HTML should start with one page (first pdf page) as the cover page, then opens like a magazine showing two pages at a time - The content needs to be accurately represented in a visually appealing, magazine-style layout. - Experience with Python and CSS is essential, with a portfolio demonstrating similar projects highly preferred. - An eye for detail and design is crucial, as the final product needs to b...

Hi Khalid A., We just noticed that you posted a project for "Experienced Python Developer Needed for Complex Recruitment Automation Project" (https://www.freelancer.com/projects/python/Experienced-Python-Developer-Needed-for-39023019/details)

I'm seeking a skilled developer to create an application that...create an application that extracts text data from various types of PDFs (both scanned and digitally created) and generates Word documents using the extracted information. Key Requirements: - Expertise in app development with a focus on data extraction - Proficiency in handling both scanned and digitally created PDFs - Experience in automating Word document generation - Familiarity with PDF parsing libraries and text extraction tools - Knowledge of OCR technology for scanned documents Ideal Skills: - Strong programming skills (Python, Java, C# etc.) - Experience with document automation - Understanding of machine learning for improved data extraction accuracy - Attention to det...

I can help you doing this using ltspice script

We are looking for a highly skilled Python developer with expertise in API integrations, web scraping, and webhooks to work on a complex recruitment automation project. The core of this project involves integrating with the Manatal recruitment platform API, processing data from external services like OpenAI, and automating workflows to enhance candidate evaluation. This includes fetching candidate data, dynamically associating job descriptions, processing resumes via OpenAI's API, and updating scores and custom fields directly in the Manatal platform. Additionally, the project requires monitoring assessment completion through webhook events and triggering automated reminders or updates based on specific conditions. The ideal can...

We build django bootstrap sites for clients, you just need to understand code. you will copy and paste code from chatgpt+

...experience in application development Understanding of Scala and willingness to learn 2+ years’ experience with Python 2+ years’ experience with SQL Must possess exceptional communication skills and the ability to effectively defend ideas and solutions; produce technical relevant presentations, convey complex information in a manner that is easily understood and actionable to both non-technical and technical leaders  Professional experience identifying and gathering solution needs; performing risk analysis, collaborating on architecture / solution design; acting and driving key stakeholder acceptance  Ability to communicate at all levels, build and foster relationships, including coaching and mento...

As discussed in chat. the other pages in the order process, starting from Physical try on. As per the image flow image provided.

...help me organize and analyze IRCG data from 1984-2024. The data will be focused on Political Risks (IRCG Table 3b) and Financial Risks (IRCG Table 4b) from PRS Group, and will involve estimating macroeconomic indicators with a specific emphasis on FDI inflows, export performance, the International Country Risk Guide (ICRG), and tariffs. Only individuals who have access to the required data or can arrange it should apply. Reference: Key Responsibilities: - Organizing and cleaning the IRCG data - Performing data analysis - Utilizing provided estimation models Skills and Experience: - Proficient in using Stata/R/Python/SPSS for data analysis - Strong background in data analysis, particularly in the areas of predictive modeling ...

...development team to create a cutting-edge recruitment platform that not only matches job descriptions with candidate CVs using AI but also automatically extracts key information from CVs to populate user profiles. Here are the detailed requirements: **Key Features:** 1. **User Registration & Profiles:** - **Recruiters:** - Registration with company details, job roles, and contact information. - Dashboard to post job descriptions (JDs) and view AI-matched CVs. - **Job Seekers:** - Profile creation where the platform reads, parses, and populates information from uploaded CVs. - Manual editing options for all auto-populated data to ensure accuracy and completeness. - Control over CV visibility settings (public, semi-pr...

I'm looking for a web scraper to help my asphalt sealing company find leads. The ideal freelancer would be able to extract information from Google, Zillow, and Chamber of Commerce websites to find both residential and commercial properties with driveways or parking lots in my local area. Key Requirements: - Ability to find and extract pertinent information from web sources, including the name, address, email, and phone number of property owners or managers. - Prior experience with web scraping and lead generation. - Capacity to prioritize the search for properties on the specified websites. Ideal Skills: - Proficient in web scraping tools and software. - Excellent data collection and analysis ...

Nous recherchons un développeur Python ayant déjà eu des experiences de développement de plugins Kodi/Xbmc. L'objectif du projet est donc de développer un plugin Kodi pour donner accès à d'autres types de contenus ques des contenus audios/vidéos. Nous aimerions également, en complement pouvoir mettre en place un repository propriétaire. Enfin, en cas de succès de la mission, cela pourrait aboutir à des prestations réccurentes.

Restaurant data collection project. 90 percent is complete. Need an expert to fix the last areas of code and help complete the job done.

...video, audio, and camera effects through a subscription system. The plugin must be secure, efficient, and compliant with GDPR regulations. Core Functionalities 1. Subscription System Login and Authentication: Use HTTPS for all communications. Implement secure login with JWT (JSON Web Tokens) for session management. Passwords must be hashed using bcrypt or a similar algorithm. Restrict login attempts per IP to prevent brute force attacks. Ensure protection against SQL injection, XSS, and other common vulnerabilities. Subscription Types: Manual Subscription: Users can only access effects available at the time of their subscription. Automatic Subscription: Users gain continuous access to all current and future effects. Subscripti...

I'm in need of a skilled data scraper who can extract phone numbers from various websites. Key Requirements: - Expertise in web scraping techniques and tools. - Proficiency in data sorting and filtering. - Prior experience in extracting contact details. Ideal Skills: - Web Scraping - Data Analysis - Python/Scraping Tools (like BeautifulSoup, Selenium, etc.)

I need an expert in Python and visualisation. YOU MUST HAVE EVIDENCE YOU CAN DO THE JOB OR DONT APPLY AS YOU WILL BE IMMEDIATELY REJECTED. Please supply proof with your submission. DONT SUBMIT WITHOUT EVIDENCE OF EXPERIENCE IN THIS SPECIFIC REQUIREMENT I DO NOT CARE ABOUT ANY OTHER QUALIFICATION YOU HAVE LETS NOT WASTE EACH OTHER TIME EH! I need someone to take data turn it in to a dashboard. I need the data to be segregated by user account so one user cannot see another users details. Background We have 50 different locations. Some locations are owned by more than client so lets say we have 40 clients We have reports for each location which need to see individually We need to see rolled up accounts per client We need all client reports rolled up in to a single repo...

...an experienced and skilled Cloud Engineer with expertise in AWS architecture design, backend development, and AWS services integration. You will play a pivotal role in designing, developing, and integrating scalable cloud solutions for our projects. This is a contract-based freelance position with the opportunity to collaborate on cutting-edge projects in a fast-paced environment. Key Responsibilities: • Design and implement robust, scalable, and secure cloud architectures using AWS services. • Develop and maintain backend systems using modern programming languages and frameworks. • Integrate various AWS services such as Lambda, API Gateway, DynamoDB, RDS, S3, and others into our infrastructure. &b...

...monitors specific profiles on X (formerly Twitter) for posts indicating a **memecoin launch**. The bot should notify us **via Telegram** as soon as one of the monitored accounts posts a relevant update. The bot should be quick, efficient, and not require any paid developer tools or APIs. - Monitor X Profiles: - Track a predefined list of X profiles (such as influencers, crypto-related accounts, or meme-focused accounts). - Focus on posts related to **memecoin launches**, such as mentions of new tokens, specific hashtags, or key phrases related to crypto and meme coins. - **Real-Time Detection**: - The bot should scan posts in **real-time** to identify when a memecoin-related post is made. - It should capture signals such as the **mention of new tokens**, ...

I'm looking for a Python machine learning expert who can help me with a machine learning project. The specifics of the project have not been defined yet, so flexibility and a broad range of skills and experience will be key. Ideal Skills and Experience: - Proficient in Python with a strong understanding of its machine learning libraries such as Scikit-Learn, TensorFlow, Keras, etc. - Experience in a variety of machine learning techniques. - Ability to work with different types of data. - Strong problem-solving skills and creativity to define the project objectives.

We are seeking talented and motivated individuals to generate leads for our performance marketing (PPC) services. You can use your expertise in online bidding, cold emailing, cold calling, LinkedIn outreach, or any other effective lead generation strategies. Compensation: Fixed Monthly Payment: ₹5,000 (negotiable based on experience) Per Lead Bonus: ₹100 per qualified lead Key Responsibilities: Generate high-quality leads for our PPC services through your preferred methods. Identify and connect with potential clients using tools like LinkedIn, email campaigns, or data scraping. Maintain accurate records of leads generated and status updates. Collaborate with our team to ensure lead qualification. Requirements: Proven experience in lead generation, dat...

...semplificare e velocizzare il processo di inserimento ordini riducendo gli errori manuali. Requisiti chiave: - Esperienza con SAP SuccessFactors e integrazione con Microsoft Outlook. - Capacità di creare macro o strumenti di automazione personalizzati. - Comprensione di come leggere e processare dati da file PDF. - Forti competenze in programmazione, preferibilmente con conoscenze di linguaggi come VBA, Python o simili. - Buona comunicazione e attenzione al dettaglio per garantire che il tool sviluppato rispetti le specifiche richieste. Responsabilità: - Analizzare i requisiti e proporre la migliore soluzione per l'automazione. - Sviluppare e testare la macro o il tool per assicurarsi che funzioni senza intoppi e in modo affidabile. - Fornire documentazione e...

I'm in need of a Python programmer who can create simple scripts for automating various tasks. Ideal Skills: - Proficient in Python programming - Experience in writing simple automation scripts - Problem-solving skills to understand and automate tasks efficiently The scripts will be straightforward, aimed at streamlining repetitive tasks to enhance productivity. You don't need to deal with complex algorithms or data analysis for this project. Your primary focus will be on creating easy-to-understand and effective scripts that can take over simple tasks.

...creating a simple Python strategy to be used for crypto trading on Binance. The script is basically a simple trade management and hedging script that will allow me to open and manage multiple orders in hedge mode. The key input variables to be specified by the user are: Trading Symbol Upper Limit Price Lower Limit Price Take Profit (In Percentage) Stop Loss (In Percentage) Initial Trade: Long or Short Hedge Multiplier Maximum Number of Hedges If the user specifies Initial Trade = Long, the trading engine will seek to open BUY STOP orders at the Upper Limit Price and undertake SELL STOP orders at the Lower Limit Price (as a hedge) Let’s assume that the current market price is $100. The user specifies Initial Trade = Long and sets the ...

I'm looking for a skilled professional to set up a GitHub repository for a production-grade, FastAPI-based web application built with Python and Docker. This repository will be crucial for the deployment and maintenance of the application. Key Requirements: - Expertise in Python and FastAPI is a must. - Proven experience with Docker for containerization. - Prior experience in setting up GitHub repositories for production-level projects. - Knowledge of best practices for GitHub usage in a production context. The ideal candidate will not just set up the repo, but will also ensure it's optimally configured for our production needs. Github repo is

...Ground floor : Pic 1. 1. reuse this red wooden panels as the background decoration for the ground floor throughout. This includes the (4) vertical green and blue panels with their decoration as well as the horizontal ones on the top. Those green and blue panels are made in stained glass (see through). 2. in the central arch (which is not a door) the bottom part (from 75cm high to 1.50 cm high we put the black deco as later in pic x) while the bottom is blue and the top is part ... 3. is white with bue clouds as in pic x 4. the windows above the doors have their shapes changed 5. the left one is sun like with rays like in pic x (but no face) and as well asian deco patterns in the right window 6. which follows moon shape with asian deco patterns as in pic x 7. ...