Web crawling and scraping using pythonpekerjaan
I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate p...for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and provide...
...with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note, this project requires persistence, cre...
I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.
...a company or an individual who can develop a Saas product for event organisers. It would include a CRM for businesses and a customer portal. It will have 30 pages with different functions and all pages should be responsive. Pages will include but won’t be limited to: Business portal/CRM - Registration. - Settings (with business info.) - Login. - Events (where businesses can see all there events) - Create an event. - Edit event. - Create a menu. - Event summary and food order. - Individual food order. - Exports to excel - Food orders(sorted by course and table). - seating management Customer portal - Register. - Login. - Register and create an event. - Login and create an event. - Customer profile page. - Future events. - Past ev...
I am encountering a 'Bad Gateway' error in my Django app that needs immediate attention. Additionally, I need a skilled developer to create a new API for my Python Flask project. Key Requirements: - Debugging and fixing the Django app - Creating an API in a Flask project for data retrieval - Handling file uploads via the API This project is ideal for a freelancer with a strong background in Python, Django, and Flask, with proven experience in API development and debugging. Please reach out if you can help me resolve these issues promptly.
I need a Python program that monitors my Hikvision cameras, NVR, and DVR for various events such as motion, line crossing, and intrusion detection. When an event occurs, the camera should push an image of the event to a pre-defined FTP server with specific usernames and passwords. Key Requirements: - The program should be able to monitor: - Motion - Line crossing - Intrusion detection - The program needs to work with: - Hikvision Cameras - NVR - DVR Ideal skills for this job include: - Proficiency in Python programming - Experience with Hikvision devices - Knowledge of FTP protocol - Understanding of event detection
...quantitative strategies that need to be tested, refined, and implemented into trading bots. Key Responsibilities: - Strategy Refinement: Assessing and improving my existing quant strategies. - Testing Strategies: Rigorous testing of strategies to evaluate their potential. - Building Trading Bots: Creating bots to execute successful strategies. Ideal Team Composition: - A member with a qualification in financial engineering. - Experts in machine learning-based trading systems. Compensation: - The team will be paid hourly for consulting, testing, and bot development. - Additional bonuses will be provided for successful bots that yield a return. Technical Requirements: - Proficiency in Python is a must. - Experience with Interactive Brokers and QuantC...
I need a skilled Python programmer to help me automate the order placement on Interactive Brokers. Key Requirements: - Automate the placement of Market orders, Limit orders, and Stop orders - Strong proficiency in Python - Experience with Interactive Brokers platform - Knowledge about different types of trading orders Ideal Skills: - Python programming - Trading experience - Interactive Brokers expertise - Order placement automation I am looking to hire a pythan trading expert, You need to automate trade in Shoonya Broker Account, Automate the buy sell order, It has lots requirment I have attached excel file to fetch and update data, and automate trade, I can choose any interval, It need to fech candle data, more detaiil i wll give if you c...
High User Friendly - Web Portal We are seeking experienced professionals with a strong background in web design, web development (particularly in Python and open-source technologies), and graphic design to collaborate on the creation of an advanced web portal. The portal will be similar in structure, design, and functionality to platforms like , , and europeanhhm.com. This is a long-term project with the initial focus on developing a feature-rich and user-friendly web portal that offers modern design, robust functionality, and seamless user experience across various devices and platforms. The ideal candidates should have expertise in Python and open-source technologies, along with a d...
Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and...
I need assistance with deploying a Django-based Python web application and a Node.js project on my dedicated VPS. Additionally, I require the creation of two APIs for the Python project. The ideal freelancer for this job should have: - Proven experience in deploying web applications on Dedicated VPS - Proficiency in Python and Django and flask - Strong skills in Node.js - Experience in creating APIs - Familiarity with VPS management Please submit your bid if you can deliver this project promptly and efficiently.
...papers in both PDF and DOC formats into a structured CSV file. The exam papers consist of multiple subjects and contain different types of questions, including multiple-choice questions (MCQs) and fill-in-the-blank questions. Detailed Requirements: - Exam Paper Structure: - Section 1: 20 multiple-choice questions (MCQs) with one correct answer. - Section 2: 5 fill-in-the-blank questions with solutions. - Desired CSV Format: - The CSV should have the following columns: question_type, question, option1, option2, option3, option4, solution, correct_option. - Image Handling: - For questions with images, I need the image URLs included in the CSV. - Storage: - All cropped images need to be stored in an S3 bucket. Ideal Skills and Experience: -...
I have a Python-based web application that needs to be deployed on my Azure VPS. In addition, I need a RESTful API created for another Python project I have. Key Requirements: - Deploy a web application written in Python on an Azure VPS. - Design and implement a RESTful API for a separate Python project. Ideal Skills: - Proven experience with Azure and Python web applications. - Strong skills in Python and RESTful API development. - Ability to deliver quality work within established timeframes.
I want to create voice agent in python , where on button click i can talk with chatgpt and 11labs intigration
I'm facing a compatibility issue with my React Native app on iOS devices which is using NativeEventEmitter. The error is either `new NativeEventEmitter()` requires a non-null argument or listener not found I need an expert in React Native with Objective C skills to fix this problem as soon as possible. TASK TO BE DONE ON ANYDESK....
I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters
I'm looking for a proficient web scraper who can extract specific lists from X/Twitter and use AI to organize the data according to specified parameters. Key Responsibilities: - Scrape lists from X - Use AI to compile and organize the data according to predefined criteria Ideal Skills and Experience: - Proficient in web scraping tools and techniques - Familiarity with AI data compilation methods - Prior experience with social media data extraction - Ability to understand and implement specific data organization parameters
I need a Python-based Telegram bot capable of sending broadcast messages. The bot should allow for manual input of these messages, which will consist of both text and images. Key Features: - Manual input for broadcast messages - Capability to send text and images - Python development Ideal Skills: - Proficiency in Python - Experience with Telegram bot development - Understanding of image and text processing
I need a seasoned programmer with expertise in Python and MySQL to convert a segment of my existing PHP Telegram bot code into Python. Specific Requirements: - The primary focus is on translating the broadcast functionality. - The bot should be capable of sending broadcasts based on user-specified times. - Ideally, the freelancer should be able to understand Hindi as the bot is designed for Hindi speakers. Skills & Experience: - Proficient in Python and MySQL. - Prior experience with Telegram bot development. - Able to understand and translate PHP code to Python. - Understanding of Hindi is a plus.
I need assistance with extracting data from a PDF and placing it into an Excel format I will provide. Key Requirements: - Data extraction from the PDF should be done according to specific column headers in the provided Excel format. - Minor data cleaning is needed during the extraction process. Ideal Skills: - Experience in data scraping. - Proficient in Excel. - Attention to detail for data cleaning.
I need good design recommendations first, then need html, css, javascript development.
We are looking for an experienced Android developer to create an APK similar, with features like real-time audio communication, text messaging, and a user-friendly interface. The project involves using NIO (Non-blocking I/O) and WebRTC libraries for high-performance, low-latency communication.
...secure, and tailored to our workflow. If feasible, the functionality can alternatively leverage the Project module to meet the requirements. Below are the details of the project: Requirements: Objective: Automate the creation of Sales Orders based on predefined fields such as customer aliases, products, and quantities. Implement a custom solution that integrates seamlessly into our existing Odoo instance. Ensure data security by replacing real customer names with aliases for users with restricted access. Key Features: Custom Module: Develop a custom Odoo module that captures the required data and generates Sales Orders efficiently. Alternative Implementation: Evaluate whether this functionality could also be achieved using Odoo’s Project module. If s...
...Description: SHC is seeking a skilled and dedicated SEO and Conversion Rate Optimization (CRO) Specialist to enhance our website's performance and online presence. The ideal candidate will possess a strong understanding of SEO and CRO best practices, coding experience to implement on-site changes, and the ability to develop and execute comprehensive strategies tailored to our business needs. Responsibilities: 1. Comprehensive SEO and CRO Strategy Development: Conduct thorough website audits to identify areas for improvement in both search engine optimisation and user conversion pathways. Develop a detailed plan categorizing tasks into easy, medium, and difficult implementations. Perform competitor analysis to iden...
...including company websites and public directories, to extract company names, contact details, and decision-maker information. Its responsibilities included designing the AI model for Named Entity Recognition (NER) to identify key individuals, implementing scalable web scraping pipelines, and integrating APIs for enhanced data accuracy. A notable functionality with the use of a custom machine learning algorithm to filter and rank decision-makers based on their roles, improving the my outreach efficiency by over 70%. Excel results would be in this format- Provided Email: CEO’s Name: Company’s Name Key Requirements: - The AI should primarily source information from company websites, google and other free data websites - The t...
I'm looking for a skilled professional who can suggest a reliable, low-latency proxy service for my web scraping project. The script currently targets public APIs and without a proxy, it's taking around 200ms to hit the endpoints. With a proxy, I need the latency to be between 300-500ms max. Key Requirements: - The proxy service should be located in Australia - The IP rotation level should be low, with only a few changes per day - The service should not require any specific authentication methods, as the APIs I am using do not require authentication I've previously tested several proxy services but most of them resulted in latency around 750ms, which is not suitable for my needs. Please only bid if you have experience with a proxy service that h...
Another scraping project - Need cover art based on ISBN and Author Name
I require an experienced Raspberry Pi and OpenWrt specialist to remotely set up my dual ethernet Waveshare CM4 board. - The project involves configuring one system as a basic Raspberry Pi and the other as OpenWrt. - The primary operating system for the Raspberry Pi will be Raspberry Pi OS, while OpenWrt will be set up on the other system. - I want simple Python code to run on the Raspberry Pi OS. An ideal freelancer for this project should be well-versed with Raspberry Pi, dual-setup boards, and Python programming. Prior experience with configuring OpenWrt is highly preferable. The ability to work remotely and deliver quality setup is crucial for the success of this project. I want this to be done today and can give remote access of PC ...
I'm seeking a skilled professional who can create an educational brain model using Meta Sam and a MRI dataset. This model is intended for undergraduate students, so it needs to be detailed yet comprehensible. Key Requirements: - Model should include: - Detailed anatomical structures - Functional areas of the brain - 3D interactive elements - Proficiency in using Meta Sam - Experience with MRI datasets - Ability to create educational content
...are seeking a talented and creative UX/UI Developer to design and build a modern, sleek website with voice-enabled chat functionality. The ideal candidate will have a strong background in user experience and interface design, a passion for crafting intuitive digital experiences, and a focus on responsiveness and accessibility. You will collaborate closely with me to bring our vision to life. Key Responsibilities Design and develop a visually appealing, user-friendly, and responsive website. Implement voice-to-text chat functionality and integrate APIs for real-time responses. Create wireframes, prototypes, and high-fidelity designs for web and mobile platforms. Ensure a seamless user experience across devices ...
...generative artificial intelligence models This freelance opportunity is remote and hours are flexible, so you can work whenever is best for you You may contribute your expertise by… Crafting and answering questions related to computer science in order to help train AI models Evaluating and ranking code generated by AI models Examples of desirable expertise: Currently enrolled in or completed a bachelor's degree or higher in computer science at a selective institution Proficiency working with one or more of the the following languages: Java, Python, JavaScript / TypeScript, C++, Swift, and Verilog Ability to articulate complex concepts fluently in Austrian German. Excellent attention to detail, including grammar, punctuation, and st...
We're looking for an experienced Backend programmer to help us migrate our complex HR system from Python2 to Pytho...Project: - Our HR system is quite intricate, so you'll need to be comfortable working with complex systems. - There are several libraries and frameworks that will need to be migrated alongside the code. Experience with these is crucial. - While we do have some automated tests, they are not comprehensive. You'll need to be able to validate your work without relying solely on these tests. Ideal Skills and Experience: - Extensive experience with Python, particularly Python2 and Python3. - Backend programming experience. - Previous experience with complex system migrations. - Familiarity with a variety of libraries and framework...
I need someone to scrape data from a service guide website into a Google Sheets document. The data includes Company Name, address, Name, email, phone, mobile, website etc etc from 9632 entries across 20 categories. Ideal candidates for this project should have: - Proficient data scraping skills - Experience with Google Sheets - Attention to detail to ensure all data is accurately captured from all 20 categories.
...accounts on platforms like MYM.Fans. These platforms allow creators to monetize private content by selling photos, videos, and live interactions directly to their subscribers. One of the most time-consuming aspects of this process is chatting with subscribers. Currently, agencies hire human chatters to engage with subscribers, build relationships, and sell content. This approach is labor-intensive and not scalable. Objective: Instead of developing a completely new AI from scratch, we want to leverage existing AI technology, such as ChatGPT’s API, and adapt it for this utility. The goal is to educate and fine-tune the ChatGPT API to perform the specific tasks of chatting, engaging, and selling content on while being fully integrated with a...
...an experienced Python programmer to develop a script that trains a Lora model focused on human faces using the SDXL framework. The training must prioritize accuracy and should be done without any graphical user interface (GUI). All parameters must be defined within the Python script. Key Requirements: - The script should handle a dataset consisting of 20 photos for each individual, along with multiple sets of individuals in a loop. - The script must handle the training of the Lora, saving the Lora model, and performing inference using the Lora before proceeding with the training for the next individual. - The script needs to load data per individual. - You need to have a PC with RTX 3090 or higher. Ideal Skills: - Proficiency in Python ...
...of a diver location application for Android, using OpenCPN. The app's primary function is to help locate divers using a radio beacon attached to each diver. Key Features: - Real-time location tracking of divers using radio beacons - List of Divers associated with the vessel to be managed - Each diver will be displayed on the screen and Divers not currently transmissing will be displayed to ensue they are accounted for. - A radio reciever to bluetooth serial adapter has been developed and the location information is sent as LAT/LON and radio ID using the NEMA AIS format - Ability to save detailed dive notes with each location. the project is anticipated to be based on OPENCPN for android Ideal Skills and Experience: - Pr...
I'm in need of a Python coder who can create a script for my options and futures strategy using the Dhan API. My main purpose for this strategy is income generation, specifically through selling straddles with some adjustments. Key Requirements: - Proficiency in Python and experience with Dhan API. - Understanding of options and future trading strategies, particularly selling straddles. - Ability to implement a code that can utilize my historical data. Ideal Candidates: - Have a strong background in quantitative finance and trading. - Prior experience in developing trading algorithms in Python. - Capable of delivering efficient, well-documented, and easy-to-understand code.
I meed a website built using a template. I will purchase. It needa to have a booking and payment added ao people can book tours each day. Need within 5 days. Examples must be provided.
...understand SEO strategies, particularly for SaaS and cybersecurity sectors. Experience in keyword research and analysis, as well as a proven track record of improving search engine rankings, is a must. Month 1: Foundation and On-Page SEO Focus: Sub-domains, Redirect URLs, Meta Titles and Descriptions, Header Tags, URL Structure, Alt Tags, Image Optimization, Link Analysis, Internal Linking, Speed Optimization, Schemas, HTML/CSS/JS, Indexing and Crawling Errors, Search Console & W3 Validator Errors, Mobile-first index, Breadcrumbs, Sitemap, , 404 Page Check, GA4, Console & Tag Manager Setup, Keyword Research & Analysis. KPIs: Resolve 100% of identified crawling and indexing errors. Optimize 100% of meta titles, descript...
I'm looking for a skilled data scraper and lead generator focused on the logistics, warehousing, and ecommerce sectors. The project involves extracting company contact details, specifically email addresses and phone numbers, from various sources. Key Requirements: - Proficiency in data scraping from company websites, business directories, and social media platforms. - Experience in lead generation. - Expertise in logistics, warehousing, and ecommerce sectors is a plus. Ideal Skills: - Data mining - Web scraping - Lead generation - Knowledge of ecommerce and logistics industry
...preferences and tone of each client. The goal is to create a system where, before generating content, users can select a client, and the tool will adjust its writing approach based on predefined client-specific parameters stored in a database. In addition, the tool should be able to learn and adapt its writing style over time by analyzing submitted content, allowing it to better understand and mimic each client’s voice. Since this is my first time using AI technologies for content generation, I would appreciate guidance and suggestions from an experienced developer on how best to build this tool. Scope of Work: Client-Specific Model Customization: Develop a system where users can select a client (e.g., Client A, Client B, etc.), and...
I have ongoing work related to our previous project 'Enhance Chart Interactivity with Python'
Continuar con el proyecto de creación de plantillas
...help develop a practical parsing tool that can be applied to real-world NLP applications. The tool should focus on syntactic, semantic, and morphological parsing and be suitable for handling complex language data in various contexts, such as automated language processing systems. This is a hands-on project that involves the design and implementation of a parser using Python. It is not related to any academic assignments or schoolwork. The final product should be adaptable for use in industry-standard NLP tasks. Key Requirements: • Experience in Natural Language Processing (NLP), especially with syntactic and semantic parsing. • Proficiency in Python and relevant libraries/tools. • Experience with or knowledge of...
Hola, como va ? Tengo un proyecto donde busco brindar las herramientas de Control de Stock, Ventas y Clientes con facturacion entre otros. Tengo una API Python de Flask, y mi pagina en React Js en base a un template, todo esto dentro de Containers de Docker usando Nginx como Proxy en cada servicio y Cloudfare como DNS. Busco que alguien me de una mano revisando las vulnerabilidades de mi infraestructura y ayuda de ciberseguridad
I am seeking a C++ coder to rewrite and optimize an existing Python application. The application is designed to read data from Excel files, process it, and generate Word documents with placeholder replacements. It also includes a graphical user interface (GUI) for user interactions. The rewritten application must prioritize speed and efficiency while maintaining all current functionality.
I have a WordPress account and an Envato-Codecanyon account and have need to build a website using the platforms mentioned to do it. I am looking for a website builder to use the above to develop the site.
Job Overview: I’m looking for an experienced front-end developer to design a professional invoice template using HTML and CSS. This template will be integrated into my CRM, which uses a built-in Chrome engine to generate PDF files. Requirements: Clean, responsive, and professional invoice design. Compatibility with the Chrome PDF engine. Well-structured HTML and CSS code optimized for print. Customizable fields, including: Logo, Client Name, Products/Services, Amounts, Taxes, Totals, etc. Deliverables: A complete HTML/CSS file ready for use. Instructions for integration into the CRM (if needed). Notes: I can provide an example of the desired style for reference. Ideal Candidate: Proficient in HTML/CSS. Familiar with how PDF rendering engines like Chro...
I need my Python-based web application, currently hosted on Azure, to be fully functional on a local server. The application utilizes Streamlit for the frontend and various Azure services for data handling. Key Requirements: - Convert the web application from Azure to a local environment - Ensure the Streamlit frontend operates seamlessly - Implement local data handling solutions to replace Azure services Ideal Skills: - Extensive experience with Python web applications - Proficiency in Streamlit and data handling - Strong understanding of local server setup and configuration Please provide examples of similar projects you've completed in your proposal.
