Web crawling and scraping using python仕事
...seeking a talented designer to create an engaging and visually stunning PowerPoint presentation to use to present our products into our retail store customers. This project involves incorporating our new logos and concepts to showcase our brand's fresh identity and details around our new products designed specifically for a "Retail Launch" Responsibilities: - Develop an eye-catching PowerPoint presentation that captures the essence of our new branding. - Design and create new packaging concepts and visuals, giving retailers a clear and compelling view of what our new packages could look like. - Generate 4 unique and creative packaging concepts with innovative designs on the packages. Requirements: - Proven experience in ...
I am in need of an experienced developer who is proficient in NodeJs, ReactJs, and MySQL to create a comprehensive Human Resource Management System (HRMS). The ideal freelancer for this project should have a solid understanding and experience in developing systems with the following core functionalities: - Employee Management: This module should provide tools for tracking employee details, their roles, performance, and other relevant information. - Payroll Management: A robust payroll system is required to automate and streamline salary disbursement, tax deductions, bonuses, and other financial aspects related to employees. - Leave Management: This module should facilitate the tracking and management of employee leaves, ensuring a smooth workflo...
I am looking for a DevOps specialist with solid GiT, BitBucket and CI/CD and experience, who can document and execute PR Merges and the "Pipeline" process on a daily basis. Key Responsibilities: - Ensuring all PRs are merged properly - Ensure all pipeline deployments between servers do not overwrite user content of media files and database data. - Ensuring that our development, staging and production environments are automated for deployment through BitBucket. - Ensuring all PRs are thoroughly reviewed, migrations and fixtures are deployed accordingly so that no database conflicts or code failures arise. - must be able to refine our current work instruction document so that ALL details and nuances are captured. - must be...
...allow users to log in using their email and password. I'm looking for a skilled app developer to create an event planning app, FreeVents, available on both iOS and Android. Also you design and implement a comprehensive ticketing system for an event app. Requirements: Backend: Experience with Node.js, Python (Django/Flask) or comparable frameworks. Frontend: Knowledge of React, Vue.js or Angular. Databases: MySQL, PostgreSQL or MongoDB. QR code generation: Libraries like (JavaScript) or PyQRCode (Python). Design a real-time validation system to prevent duplicate QR code usage. Develop multi-functional QR codes (e.g., event entry, pre-purchased services). Payment integration: Expe...
python script to automate process for website
...transformation and data type differences. The conversion won't be a one time job, instead, it will be run occasionally, on demand. I have a database in HSQL protocol, that I want to convert and stock on a phpmyadmin Database. The HSQL DB is stocked in a local repertory. The objective is develop a small script in Python (or other), to read data from the local HSQLDB repertory then stock entries to a remote phpmyadmin DB server. I provide a link for downloading the HSQL DB (an example), and phpmyadmin server address and login data. I must be able to run the script on my Windows PC to apply on different HSQLDB (same format) I have. At the end of the script execution, I can see data on the phpmyadmin DB. Ideal skills and experience for this ...
hi bro, I'm in need of a small Python task focusing on data analysis. Already the report part is complete and the file is ready but there are some issue needs to be rectify. Please let me know if you are able to do this. Waiting for your response. Thanks.
I'm looking f...prices from the NSE, organize the data and apply simple if-then logic to derive a final output. Key Requirements: - Data Scraping from 3 websites - Data Organization: Skill in structuring the data in a meaningful way - Logic Application: Capable of applying simple if-then logic to the data to arrive at the final output Final Output: - The data should be compiled and delivered in an Excel format or equivalent format. Ideal Skills: - Proficiency in data scraping tools and software. - Excellent skills in data organization and analysis. - Familiarity with stock market data. - Experience with Excel. Please bid if you have the relevant experience and skills. BUDGET: INR 7500 ADDITIONAL BONUS PAYMENT: INR 2500 FOR HIGH Q...
I'm looking ...a trading bot that can identify trendlines on candlestick charts and send alerts when these trendlines are breached. Key Features: - The bot should automatically detect and draw trendlines in real-time. - Trendlines should be based on significant highs/lows and local price movements impacting liquidity zones. - Alerts should be triggered upon trendline violations, sent via email and Tradingview notifications. Technical Skills Required: - Experience in Python programming language. - Integration with TradingView for analysis and notifications. Please note, the bot should not perform any automated actions when a trendline is breached. It should simply send an alert. Applicants with a deep understanding of liquidity zones a...
I'm seeking a software developer to create a web application for me. The application will require user authentication and login capabilities. Ideal Skills: - Proficiency in web development languages (HTML, CSS, JavaScript, etc.) - Experience in developing user authentication systems - Knowledge of web application frameworks (like React, Angular, or Vue.js) - Understanding of server-side languages (like Node.js, Python, Ruby, etc.) - Experience with database management systems (MySQL, PostgreSQL, MongoDB, etc.) - Familiarity with front-end libraries and frameworks (Bootstrap, Material-UI, etc.) Experience Required: - Prior experience in web application development is a must. - Demonstrated expertise in creating secure login and ...
I'm looking for a Python expert who can develop a tool ( front end & bankend ) for me that performs help to place orders along with stop loss on Nifty. The tool will primarily use Stock market APIs from brokers like finavsia/ fyers and CSV data files for tick data analysis . Key Requirements: - Proficiency in Python with a strong understanding of data analysis and real-time processing. - Experience in creating scalping tools or trading software - ability to make recommendations - Experience with Stock market APIs and handling CSV data files. - Ability to develop a user-friendly, efficient tool tailored to my needs. i will provide idea for front end UI & open to suggestions based on developer's experience Timeline to complete the proj...
python script to get data from website and export it into database
I'm looking for an expert in Ansys to assist me with a dynamic structural analysis. - The focus of this project will be on metal materials such as aluminium - Your task will involve performing a comprehensive evaluation of the structural respo...focus of this project will be on metal materials such as aluminium - Your task will involve performing a comprehensive evaluation of the structural response of the metal under dynamic conditions. - Modalanalysis Ideal skills include: - Proficiency in Ansys, particularly in conducting dynamic structural analyses. - Strong understanding of metal material properties. - Experience in interpreting and presenting simulation results. Please provide examples of similar projects you've completed in the past. I need it for an study proj...
I'm looking for a professional Python developer with experience in creating trading scripts and working with websockets. The main goal of this project is to automate my trading on the Deribit platform using a delta-based trading strategy. Key Requirements: - Design and implement a trading script that can effectively execute trades on Deribit. - Utilize websocket for real-time data processing. - Incorporate a delta trading strategy. Ideal candidates for this project should have: - Proven experience in Python, particularly in the context of trading scripts. - Familiarity with the Deribit platform and its unique features. - Strong understanding of delta trading strategies. - Experience with websocket for real-time data handling. Please provid...
https://www.freelancer.com/projects/python/Python-Django-Expert-with-Skills-38868577/proposals
I'm seeking a Polish programmer, ideally, to create or finish a Python-based web portal. The portal has a company directory across various industries, a geolocation-based search, a category-based search, and a reviews-based search. Key Features: - An advanced client panel, allowing users to edit their profiles, view visit reports, and utilize a referral program. - Online subscription-based payments. - A comprehensive administrator panel, with capabilities for adding industries, services, and uploading industry-specific images. - All aspects of the portal need immediate attention, including the graphical interface. - Develop a user notification system for messages, updates, and alerts. - Add advanced search filters to allow users to n...
Hello I am looking for readymade apps like: 1. CRM 2. ERP 3. Billing and Quotation 4. PoS 5. Recharge App 6. Inventory Management 7. HRMS 8. Accounting 9. Multi-vendor Ecommerce System Any other similar apps. Require with full source code. Preferable Languages: Python-Django, Node.js Regards, Shubham
DO NOT BID, until you have read the project in full. I do not want DATA, this is not data scraping task 10 leads required this week. If successful we will increase to 100 leads/ month from January on. Definition of a lead A business/individual who has a decalred interest in developing / re-developing a website, where you have assessed; there is an expressed need, you have an approximate budget size, and the lead is expecting to be contacted . The leads should have a need for Web development, anything from e-commerce and corporate sites to brochure sites. Key Requirements: - Leads must include: - Contact details - Website URL - Business industry - Budget Lead Generation Methods: I'm open to any method of lead generation, be it online advertising, email...
...me to scrape and automate stock data from the NSE and BSE. The primary use of this app will be for data analysis. Key Requirements: - The app should be able to scrape real-time prices and historical data from the specified stock markets - The app should be user-friendly and efficient for data analysis purposes - The app should support viewing multiple stocks simultaneously for comparative analysis. - The app should include secure user authentication to protect personal data. - The app should include robust data visualization tools such as graphs, charts, and trend lines. - The app should allow users to export data and analysis results in various formats (e.g., CSV, Excel, PDF). Ideal Skills: - Extensive experience in app development - Proven ...
Seeking assistance with Python programming. No specific area defined yet. I am getting one error that need to be rectified
Home page design and speed as discussed only.
...The primary focus will be on improving visibility on Google, Bing, and Yahoo. Key Tasks: - On-page SEO: Optimize website content and structure for search engines. - Off-page SEO: Build quality backlinks and enhance the site's authority. - Technical SEO: Improve website's backend to facilitate better crawling and indexing. - Conduct thorough keyword research to identify high-potential search terms for the pet niche. - Analyze competitors' SEO strategies to identify opportunities and threats. - Enhance website user experience to reduce bounce rates and improve engagement. - Ensure the website is fully optimized for mobile devices. Ideal Skills and Experience: - Proven track record in SEO, particularly in on-page, of...
I need a Python expert to help me with workflow automation using the Crisp chat system: Key Responsibilities: - Build custom functions that cater to specific client needs - Automate the customer service Ideal Skills: - Proficiency in Python - Experience with workflow automation - Familiarity with ticketing systems - Knowledge of Crisp chat system is a plus Experiences with is a plus
...for an experienced Python/Django developer with strong UI/UX skills to maintain and improve our clothing retail system. The main task is to fix synchronization issues with our online store (WooCommerce) and ensure seamless integration between platforms. Responsibilities: • Troubleshoot and resolve synchronization issues between the retail system and WooCommerce. • Maintain and optimize the existing system for performance and reliability. • Enhance the UI/UX for both internal and external users. • Collaborate with our team to implement additional features as needed. Requirements: • Proven expertise in Python and Django. • Experience with WooCommerce integration and API handl...
I need assistance with my Unreal Engine 5 reverse project. I want to call a gameplay-related function from UFunctions externally in C++. Making one function call work will be sufficient for completing this task. The primary purpose is to trigger in-game function. Using memory offsets. ( Using a SDK dumper is recommended to see the client sided game structure ) Key requirements: - Understanding of Unreal Engine 5's architecture. - Proficiency in C++ programming. - Experience with UFunctions and external function calls. ( using GObjects, GNames, GWorld, ProcessEvent ) - Good understanding of Unreal Engine 5 API calls. - Ability to debug Unreal Engine 5 gameplay functions. - Memory management / ASM Currently, I have a dumped SDK from the game's codeba...
...developer to create a robust and efficient web scraping script capable of scraping nearly 100% of pages concurrently. The goal is to extract all the content from a variety of websites, including both simple and complex pages, without relying on any third-party tools or external libraries. The script should be highly scalable, resilient to changes in website structure, and capable of handling a large number of pages simultaneously. Responsibilities: - Develop a custom scraping script that can extract complete content from web pages, including text, images, links, metadata, and other elements. Ensure the script can scrape content from both simple and complex websites, including those with dynamic content, AJAX, a...
Seeking Freelancer to setup environment for .NET framework using entity framework in Visual studio . Overview We are seeking an experienced freelancer in .NET Framework 4.6.1, and Visual Studio (VS2017,VS2022), to assist in setting up an environment with Oracle DB connection (DB11g and DB19c ) using entity framework . Background Our setup includes: • Existing Environment: o .NET Framework 4.6.1 o Visual Studio 2017 o Oracle Developer Tools for Visual Studio 2017 (Version ) o (v12.2.1100) o (v12.2.1100) o Middleware console application connecting to a database first using the managed driver. o Entity Framework (.edmx file) creation using the Entity Framework with the managed driver. • Updated
...form filling and CAPTCHA solving - A Python script that retrieves user data from a database and attempts to book an appointment on their behalf - The bot does not need to provide any notifications post booking - The bot should include a retry mechanism in case of booking failure. - Implement IP rotation to avoid getting blocked by the website. - Ensure session management to handle multiple requests efficiently. - The bot should accommodate bookings for multiple users simultaneously. - Create detailed error logs for troubleshooting. - Integrate with third-party CAPTCHA bypass services if necessary. - The bot should allow users to specify preferred time slots. - The bot should be compatible with major web browsers. - Provide comprehensive API documentation for ...
I'm looking for a seasoned full stack developer proficient in Flutter, ReactJS, and Python to help me create a dynamic mobile/Web application from the ground up. Key Features: - User Authentication: The application will require a robust user login system. Experience with creating secure authentication processes is essential. - Real-time Updates: The application will need to deliver information to users in real-time. Previous experience with WebSockets or similar technologies will be a plus. Skills Required: - Proficiency in Flutter for mobile app development. - Extensive experience with ReactJS for the web component. - Strong backend skills with Python. - Prior experience implementing user authentication systems. - Knowledge of technologies for re...
I'm seeking a professional skilled in data decryption and analysis. My primary goal with this project is to interpret data from the Xirgo BCE Protocol. - Data Analysis: Once the data is parsed, I need someone who can use python to interpret it. - Data Format: The data is currently in a hexadecimal string format. - Ideal Skills: Proficiency in data python
I'm looking for a professional web scraper who can help me with daily data extraction from a website and storing it in a database. Key Requirements: - web scraping using python - Storing the scraped data into a MS SQL database Ideal Skills: - Proficiency in web scraping tools - Database management skills - Ability to automate daily scraping tasks Please reach out if you have the right skills and experience. Thank you!
I'm seeking a part-time freelancer on an hourly basis to test my AI-generated codes and tools. The coding languages primarily include Shellscript, Python, JavaScript, PHP, and HTML. Key Responsibilities: - Test all codes in a staging server environment - Conduct code testing to identify any bugs, performance issues, or security vulnerabilities Ideal Skills and Experience: - Basic understanding of codes is enough - Knowledge of AI-generated code testing Performance testing should be conducted on a Linux environment. The perfect candidate for this role should be meticulous, detail-oriented, and capable of working independently to ensure the codes are functioning correctly before deployment. The expected volume of code to be tested is medium. The fr...
...capability to support various output formats, including a web interface, PDF exports, and CSV exports. Ideal Skills and Experience: - Proficient in AWS services - Experience in dashboard development - Knowledgeable in resource usage tracking - Able to implement various output formats Frontend (ReactJS) : We have our reactjs template with user-friendly features, which you can use and additionally implement including project/account filtering, billing trends, invoice downloads, and date range selection. Integrate AWS Cognito for authentication. Serverless API (Lambda): Build Lambda-based APIs (Python/Node.js) for fetching billing data using either S3 CSV exports or AWS Metrics API. Secure APIs with IAM keys and secret keys, ...
Hi I want to create a ebook store using shopify. if anyone can do it please let me know. I need international payment gateway also with complete order tracking and everthing that a store have. Thanks
I'm seeking a skilled web scraper to extract data from Google Maps, focusing on the commercial construction sector in Saudi Arabia. Key Tasks: - Scraping data for commercial construction companies - Collecting company names, addresses, mobile numbers, and emails Ideal Skills: - Proficient in web scraping tools and techniques - Familiarity with the construction industry - Understanding of data classification and organization - Ability to extract information from Google Maps Please note, the cities to be covered are not specifically mentioned. Therefore, the scraper should be able to cover all major cities in Saudi Arabia, focusing on commercial construction companies. The final data set should be comprehensive, including as many mobi...
...looking for a skilled app developer to create an event planning app, FreeVents, available on both iOS and Android. Also you design and implement a comprehensive ticketing system for an event app. Requirements: Backend: Experience with Node.js, Python (Django/Flask) or comparable frameworks. Frontend: Knowledge of React, Vue.js or Angular. Databases: MySQL, PostgreSQL or MongoDB. QR code generation: Libraries like (JavaScript) or PyQRCode (Python). Design a real-time validation system to prevent duplicate QR code usage. Develop multi-functional QR codes (e.g., event entry, pre-purchased services). Payment integration: Experience with Stripe, PayPal or Razorpay. Security: OAuth 2.0, JWT and SSL integration. Mobile Development: Experience in Flutter/Re...
Actively seeking a highly skilled developer to join our existing project, which focuses on developing a state-of-the-art chatbot. The candidate should have a strong foundation in web development and experience in integrating chatbots within various platforms such as PHP, HTML, JS, Python, Django, and WordPress plugins. Proficiency in advanced AI technologies, specifically using large language models (LLMs), retrieval-augmented generation (RAG) systems, and LangChain, Langgraph is crucial.
I need an expert to implement both continuous and periodic geolocation tracking on our PWA, accessible through an Odoo website on both Android and iOS devices. The tracking should operate even when the app is minimized or during calls. Key tasks include: - Sending geolocation data to the backend continuously or periodically. - Applying the geolocation tracking to the Odoo website PWA. - Activating or fixing PWA notifications similar to Firebase notifications in mobile apps. Essential skills: - Proficient in HTML, Python, Java, and Postgres Databases. - Experienced with Odoo and Progressive Web Applications. Budget: AED 200 Timeline: Immediate delivery
I'm looking for a data scraper to collect specific information from a conference map (I can supply the URL for review in chat). The data points to capture include: - Name - We...conference map (I can supply the URL for review in chat). The data points to capture include: - Name - Website - Booth number - Contact email - Company phone numbers All this data needs to be compiled into a CSV file. If there's missing information for any of these data points, please mark it as 'N/A'. Ideal skills and experience for this job include: - Proficiency in data scraping techniques - Experience with generating CSV files - Attention to detail in identifying and marking missing data Please do not skip any entries, even if they have incomplete information. Th...
I'm seeking a Python expert who can create a script for transshipment optimization aimed at minimizing costs. The project will involve handling data from PostgreSQL database connections. Key Requirements: - Proficiency in Python is essential, with a focus on data handling and optimization algorithms. - Experience with PostgreSQL is required, as the data will be sourced from this database system. - A strong understanding of cost minimization strategies in transshipment processes will be beneficial. Please ensure your bid includes examples of similar projects you have completed in the past. The goal is to develop a cost-effective solution for transshipment optimization.
We are seeking a talented and innovative web developer to build a gaming website that hosts the top 100 most popular games in the USA. This project requires someone passionate about gaming and web development, with a vision to create a platform that is both functional and visually appealing. The ideal candidate will have the technical expertise to design, develop, and implement advanced features while ensuring a seamless user experience. Responsibilities As the web developer for this project, your primary responsibility will be to create a fully operational website that showcases the top 100 games in the USA. Each game will need to be visually represented with high-quality images and descriptions. You will also be tasked with designi...
用分布式爬虫爬取b站数据：1. 在b站搜索Keywords （电影解说）获取 bvid（视频的唯一标识符）和视频的基本信息（包括标题，链接，时长等)，每5分钟一次重新搜索Keywords获取新发布的视频的bvid和基本信息，保存入数据库 2. 根据视频的bvid，可以调用b站的api获取到视频当前（访问视频网站链接那一个时刻）的各指标信息（包括观看量、点赞、收藏等），从第一次开始调用api爬的时间开始，每5分钟后接着调用api爬一次，导入数据库。3.爬取一周内新发布的视频的数据，每个视频连续追踪爬取一周。 2. Define error handling mechanisms for API interactions. The preferred programming language for the project is Python.
I'm looking for a proficient data extractor who can help me collect text from specific pages of a website, and organize it into a specific Excel template. Key Requirements: - Extract text from product pages of a website - Organize data into a provided Excel template Ideal Skills: - Experience in web scraping and data extraction - Proficient in Excel Chat for more information
I am in need of a Python expert who can develop a code to optimize the manpower ratio across various types of healthcare facilities including hospitals, clinics, and nursing homes. This project will particularly focus on the healthcare industry, with the goal of maximizing efficiency and effectiveness in manpower utilization. Ideal skills and experience for the job include: - Proficient in Python programming - Prior experience in the healthcare sector is a plus - Ability to understand and analyze manpower needs in various healthcare settings - Excellent problem-solving skills - Experience in developing optimization algorithms
Hey, I had a python program made but it has a lot of issues and I don't think the developer knows how to fix the problem. I am researching commodity price movement and trends and have had a python program built to track data. In summary the program has an API which connects to a data broker retrieving daily stock prices then displays the data on simple charts. There are a few issues with the program but the main is the API doesn't retrieve the data and has errors. I contacted the data broker and there are no issues from their end. There are two programs with the first having 86 lines of code and the second 437 lines of code. Half of the is explaining what each line does. Is this something you could fix? I am in searc...
I'm seeking a professional with extensive experience in de...experience in developing complex financial models. The ideal candidate will have a strong background in finance coding, particularly in financial modeling, regression analysis, and portfolio management techniques. Key tasks will include: - Creating intricate financial models to help with advanced financial analysis. - Utilizing regression analysis to identify trends and make forecasts. - Employing portfolio management techniques to assess and optimize investment opportunities. This is a unique opportunity for a finance coding expert who can help me navigate the complexities of financial modeling. Your skills in Python, R, or similar programming languages will be crucial. Please provide examples ...
...seeking an experienced and detail-oriented mobile app developer to build a question-and-answer platform powered by AI, with a strong emphasis on community interaction. The app will feature two core functionalities: AI-Powered Answers: Users can ask any question, and the app will provide AI-generated answers using OpenAI's API. User-Generated Contributions: Users can view, comment, and vote on questions and answers in a personalized feed. The ideal candidate will have expertise in building intuitive and scalable mobile applications, integrating APIs, and creating engaging user interfaces. Responsibilities Develop a cross-platform mobile application (iOS and Android) using React Native, Flutter, or native technolog...
I have a project that involves a 2200sqm lot with retail on the main floor and office on the upper level. The architectural design needs to be rectified, with specific emphasis on layout adjustments. Software Used : Revit Key tasks: - Identify and rectify architectural design flaws - Propose layout adjustments to improve design - Ensure all modifications adhere to code compliance Ideal candidates for this project should have: - Extensive experience in architectural design - Proven track record of rectifying design flaws - Strong problem-solving skills to propose effective layout adjustments
I need you to scrape all customer reviews from Amazon for a particular product and deliver them in an Excel spreadsheet. The information to extract includes the reviewer's name, the review text, and the rating. Key Requirements: - Scrape all pages of customer reviews - Filter reviews by star rating and verified purchase only - Output in an organized and easy-to-read Excel spreadsheet - Also share the scrapping code in python Ideal Skills: - Expertise in web scraping - Proficient in Excel - Experience with data filtering and organization
I'm seeking a professional with experience in server management and web scraping to help me install Node.js version 22 and Puppeteer version 17.1.3 on my Linux server (ubuntu24.04 lts). This is to run the 'Ultimate Web Novel and Manga Scraper' plugin for my WordPress site. The installation of puppeteer should be done in the following directory: cd /var/www/ After installation, I need you to: - Test that everything is functioning correctly on the various scraper sites. - Specifically check the performance on Web Novel site A, Web Novel site B, and several Manga and other sites. You will have full root access to the server, so you can execute necessary commands without restriction. Please refer to this gu...
