Web scraping using aws lambdapekerjaan
ambil data mengenai saham , melalui web
Hi Muhamad Amin Hakim S., Bro, nampak ada web scraping dlm description. ada task sikit nk bg boleh contact saya balik? whatsapp muaiz - (Removed by Freelancer.com admin)
Saya membutuhkan data mengenai donasi yang dilakukan pada 1 bidang (akan dijelaskan lebih lanjut) yang terlaksana selama 2018-2021 di Indonesia. Data berupa profil penyumbang, penerima, lokasi, jumlah, perusahaan, sumber dana, dll. Projek akan terlaksana dalam 1 bulan. Output Data berupa tabel .csv atau .xlsx excel document. Ideally you are indonesian, because the web scraping job is scraping indonesia news article,company website, and open source indonesia data provider.
buat koding programming mplab untuk pic18f4580 untuk buat projek street light beserta proteus
project ini merupakan fyp saya. saya perlu mencari error dalam sliding mode contoller dan PID controller dalam pre-sliding motion. sya perlukan sesorang yang boleh buat PID dan SMC simulink dan saya hanya perlu masukan nila transfer function nilai x untuk cari error. nilai transfer function sudah diberi.
Data processing dan visualization using python and matlab
project singkat untuk setup apache web server sesuai dengan keterangan PDF yang diberikan. Termasuk performance testing dan juga mengimplementasikan load balancer
Saya ingin membuat aplikasi Scraping google Search, Scraping yang tidak menggunakan googleApis Scraping yang saya maksud hasilnya akan sama dengan apa yang diketikan pada browser Dan saya menginginkan data dari google untuk mengetahui "keyword" yang saya pasang pada URL website saya berada pada posisi berapa. dan itu bersifat dinamis misal saya mengeset lebih dari 1 keyword. sehingga setatusnya seperti tabel yang terlampir pada dokumen.
- Implementasi Sistem Absensi Otomatis Di Kampus Institut Teknologi Del dengan Menggunakan Teknologi RFID. - Implementasi Nagios dan Cacti sebagai Network Management System. - Implementasi Active Directory di Kampus Institut Teknologi Del menggunakan Windows Server 2012. - Implementasi Fortigate Sebagai router. - Implementasi Auto Laptop Installation Using Mumi.
I'm in need of an IT professional services sales consultant with a strong focus on lead generation, social media marketing, and sa...Media Marketing: Enhance our brand visibility and service awareness through strategic social media initiatives. - Sales Strategy: Devise and implement effective sales strategies tailored for Cloud Services. Ideal Candidate: - Extensive experience in the Cloud Services industry. - Proven track record in IT professional services sales. - Familiarity with major public cloud providers, particularly AWS, Azure, and GCP. - Exceptional skills in lead generation and social media marketing. This could evolve into a long term partnership, with a potential bonus structure based on sales performance. Please share your relevant experience and achievements in...
We are looking for a skilled developer to build a solution that identifies arbitrage opportunities using the sqrtPriceX96 value of token pairs across multiple decentralized exchanges (DEXs). The goal is to automate the process of finding and executing arbitrage opportunities by monitoring token pair prices on DEXs like Uniswap v3, Sushiswap, and others. The solution should follow a step-by-step process: 1. Query the liquidity pools of various DEXs for the sqrtPriceX96 values of token pairs. 2. Convert the sqrtPriceX96 values to actual token prices. 3. Identify price differences between DEXs to spot potential arbitrage opportunities. 4. Account for transaction fees (gas and conversion) when calculating potential profits. 5. Continuously monitor and automatically execute arbitra...
I need a freelancer who can help me change the public SSH key for my OVH instance. The new SSH key is already available in the OVH dashboard. Your task is to change the SSH key via the OVH website, using Anydesk for remote access. Requirements: • You will not be provided with the private SSH key for the new SSH key. • You must change the SSH key through the OVH website interface only. • Anydesk will be used for secure remote access to the system. • Ensure no interruptions or issues with the instance’s access after making the change. Skills Required: • Experience with OVH cloud platform and managing instances. • Proficiency in working with SSH keys. • Anydesk usage for remote troubleshooting or configuration. Please apply only if yo...
I have a list of 300 profiles each on Twitter, Instagram, TikTok, and YouTube. I need a freelancer who can provide a script or software s...can provide a script or software setup that can collect followers and subscriber counts for each profile daily within a 3-hour time window. Requirements: - Collect data for 300 profiles on each platform - Collect data within a 3-hour window - Deliver data in CSV format - Provide software or script to run on Windows/Mac - Suggest suitable proxies if needed Ideal Skills: - Proficient in data scraping and software development - Familiar with social media platforms - Experience with proxy usage for data collection Please quote your price and approach for this project. Include how you plan to handle proxies. I expect this to be completed within t...
...System Data Sources and Resources Resource Description Source NASA Worldview, EOSDIS Provides access to NASA’s Earth science data from satellite, aircraft, and field missions. NASA EOSDIS NASA Earth eXchange (NEX) Generates global downscaled climate projections (NEX-GDDP-CMIP6) and CONUS projections (NEX-DCP30-CMIP6), available from NASA and AWS. Produces ecosystem and carbon monitoring data from global geostationary satellites. Climate & Natural Resource Assessment - NASA NASA Global Climate Change (Vital Signs of the Planet) Provides data on global temperature, carbon dioxide levels, Arctic sea ice, sea level, and other critical climate indicators. NASA Global Climate Change NASA Go...
I'm looking for an expert web scraper who can help me extract a full, publicly accessible, Trading View script. The purpose of this extraction is to allow me to modify indicators. Requirements: - Proficiency with Chrome Debugger. - Advanced skills in Java Script and Pine Script. - Proven experience in web scraping. Please note, I do not require any additional data extraction. I only need the script.
I'm seeking a skilled freelance Python developer for a short-term project. The primary task involves fixing bugs in our system. If the individual performs well, the project duration may extend. Key Responsibilities: - Identifying and fixing database-related bugs - Troubleshooti...freelance Python developer for a short-term project. The primary task involves fixing bugs in our system. If the individual performs well, the project duration may extend. Key Responsibilities: - Identifying and fixing database-related bugs - Troubleshooting and resolving backend bugs Ideal Candidate: - Strong proficiency in Python - Experience with Python Libraries, Postgres, Django, Heroku, and AWS - Ability to deliver high-quality code within tight deadlines - Good problem-solving skills and atte...
I am looking for a skilled developer to create a dynamic reverse proxy solution using and http-proxy-middleware. The proxy must function similarly to , offering seamless web proxy functionality with integration of a Service Worker on the frontend for advanced request handling. Requirements: Backend (Proxy Server): Build a reverse proxy using and http-proxy-middleware. Support dynamic target selection, routing requests to different backends based on specific rules (e.g., request paths, query parameters, or custom headers). Forward headers, cookies, and other request/response metadata correctly to emulate CroxyProxy's behavior. Implement custom middleware to modify or log requests and responses as required. Frontend
...created with the following information: - Product Cost: Supplier's listed price -15%. - Offer Price: Supplier's listed price +23%. - Sale Price: Supplier's listed price +23%. - Description - Images - Product Name - Inventory by Variant - Variants (color, size, etc.) - This update must occur daily at 4 AM GMT-5 - SKU I understand that Mercado Libre and similar platforms sometimes update their anti-scraping security measures. Therefore, I need a long-lasting, robust code that will remain functional over time. In case of failure, I require lifetime support as this functionality is the core of my operation. My website is: Please provide the implementation timeline and cost. I’ve already had a freelancer do it poorly, resulting in wasted time and a refund. I ...
I'm using AWS. AWS sent me the following two messages: ===== We are sending this email to provide you with an update on Ubuntu 20 blueprint availability on Amazon Lightsail. The existing Ubuntu 20 blueprint will be reaching end of standard support on April 2, 2025 [1], and it will be removed from Lightsail on April 2, 2025. As a result, you will not be able to create new instances with this blueprint on Lightsail on or after April 2, 2025. This blueprint will also be removed from the response of Lightsail "get-blueprints" command in the AWS Command Line Interface (CLI) and corresponding Application Programming Interface (API). A list of your affected resources can be reviewed in the "Affected Resources" tab of your AWS Health ...
I'm looking for an expert who can set up a MITM (Man-in-the-Middle) configuration on AWS for the purpose of network security testing. Key Requirements: - Implement a Man-in-the-Middle proxy server on AWS - Configure the server to intercept and analyze HTTP/HTTPS traffic Ideal Skills: - Extensive experience with AWS - Proficient in network security testing - Familiar with setting up MITM proxy servers
I have to do the coding for attiny 85 to control the led and buzzer based on the buzz wire.
Sila Dafter atau Log masuk untuk melihat butiran.
I'm looking for a skilled data engineer/ data scientist to create a web-based link for reporting that can be used by executives. This application should generate various crucial reports including: - Financial reports - Performance reports - Resource Utilization - Revenue Forecast The ideal candidate should be able to integrate data visualization features in the form of charts and graphs, dashboards, and interactive elements. Experience in creating similar web-based applications will be highly advantageous. This project is aimed at enhancing decision-making processes, so an understanding of executive needs in reporting is a plus. We are considering to use Power Bi for reporting and there is potential source data hosted at AWS SERVER. I would like to have technica...
This project is a modern, user-friendly website with a responsive design, interactive features, and optimized performance. this web project that includes multiple HTML, CSS, JavaScript files, images, and fonts. I’d like to replicate and improve upon it, using modern frameworks and best practices. Core Requirements Frontend Development: Develop a responsive design using HTML, CSS, and JavaScript. Incorporate frameworks/libraries like layui and for styling and interactive elements. Pages to Include: Homepage with a modern, visually appealing layout. Login and registration forms for user authentication. Policy pages such as privacy policy and terms of use. Content pages for banners, image galleries, and dynamic sections. Styling and Design: Implement consistent...
I'm in the process of shifting my infrastructure from AWS/Docker to Azure/AKS and I require a seasoned DevOps professional to assist with this migration. Key Responsibilities: - Configuring Azure CLI - Deploying and managing AKS - Providing comprehensive support throughout the AWS to Azure migration process Primary Objective: - Achieving seamless, improved integration with Azure DevOps As part of this project, you'll be responsible for creating new Azure DevOps pipelines from scratch. Specifically, you'll need to establish: - Both build and release pipelines Your expertise will be critical in ensuring this transition is smooth and efficient, ultimately facilitating better integration with Azure DevOps. Required Skills: - Proficient in Azure CLI conf...
...full-time position based on performance. Key Responsibilities: - Architecting robust, scalable solutions. - Conducting code reviews to ensure quality and adherence to best practices. - Actively participating in code development. Ideal Candidate Should Have: - Proficiency in React JS and expertise in Next JS. - A proven track record in performance optimization and scalability. - Experience with AWS Cloud. You will be pivotal in driving our tech strategy and mentoring our junior developers. Your leadership skills will be just as important as your technical expertise. Please apply if you're ready to take on this exciting challenge. This requirement is for individuals ONLY. Candidates based in India ONLY. Full time availability needed, need to have around 8-9 years of experi...
I'm looking for a proficient web scraper who can extract the tokens from the GMGN website. The data should be delivered in a neatly organized CSV file. I want to scan this web: I want that every time a new token appears on the right side (Gastado en DEXScreaner) I save in a csv both the date/time, the token name and the token address. The website I pull from will keep the filters applied (I think if I'm logged in it will keep them). Python code to be able to do this scanning every minute. (En Jupyter notebook) When a new token appears in this window, add it to the CSV. Translated with (free version) Ideal skills for this project include: - Proficiency in web scraping tools and languages (like Python, BeautifulSoup, Scrapy etc.)
I'm seeking a skilled professional who can create an educational brain model using Meta Sam and a MRI dataset. This model is intended for undergraduate students, so it needs to be detailed yet comprehensible. Key Requirements: - Model should include: - Detailed anatomical structures - Functional areas of the brain - 3D interactive elements - Proficiency in using Meta Sam - Experience with MRI datasets - Ability to create educational content
I'm transitioning my infrastructure from AWS/Docker to Azure/AKS and require a seasoned DevOps professional to assist with this migration. Key Responsibilities: - Azure CLI configuration - AKS deployment and management - Comprehensive support throughout the migration process from AWS to Azure Primary Objective: - Achieve seamless, improved integration with various Azure services Required Skills: - Proficient in Azure CLI configuration - Experienced in AKS deployment and management - Demonstrated history of successful migration projects from AWS to Azure This migration aims to facilitate a better integration with other Azure services, specifically Azure DevOps, Azure Monitor, and Azure Active Directory. Your role will be crucial in ensuring this transition is ...
Project Description: Turnkey Web Application Development Using Django MAXIMUM BUDGET: USD 2,250. 1. Project Conditions Exclusive internal use: The application is intended only for the employees of the importing company. No external users will have access or be able to make purchases through the application. Deadline: 3 weeks from the project award. Current status: The project is already 20% complete. Partial deliveries: At least 2 partial revisions are required before the final delivery for feedback. 2. Objective Develop a turnkey web application for an importing company that facilitates: - Management of customer orders. - Consolidation of purchases made from factories. - Administration of an inventory. - Registration and customization of client information. - Th...
I'm seeking a proficient developer for creating a Telegram deal-hunting bot. This bot should scrape the web for deals across all categories - Electronics, Fashion, Groceries, etc. Key Requirements: - The bot should primarily focus on a wide array of deals from various sources including E-commerce websites Coupon sites, and Retail blogs. - It should web scrape deals from the internet and post them in the group channel every hour. Ideal Skills: - Profound knowledge of web scraping - Extensive experience with Telegram bot development - Ability to source deals from diverse platforms Please bid only if you have the necessary skills and experience. Looking forward to your proposals.
We need to setup multiple servers to balance the load of our server. We need server expert to do the setup and suggest configuration.
I need a mobile application, compatible with both iOS and Android, designed for web scraping the Racing Post for horse races. This app should also allow me to query a database of past results. Key Requirements: - Fully automated web scraping of today's races, runners, tracks, going, and other relevant variables. - Application of my specific strategies to identify qualifying horses, also fully automated. - Automatic backing or laying of horses using the Betfair API, in line with my strategies (which include pre-race and in-running bets). - Options for level stakes or various staking plans. I expect after-sale support from the coder for minor changes or bug-fixes as needed. Happy bidding. Regards.
...professional web developer with expertise in data scraping and UI/UX design to create a modern and trendy site similar to , with a focus on business contact search. This platform should have the capability to scrape all the established Business - Contact details - Support numbers - Business operational information The ideal candidate will have a strong background in data scraping and web development, with a portfolio showcasing their ability to design and implement modern, user-friendly interfaces. If you have experience in creating similar platforms, I would love to see your work. Please only bid if you have the relevant skills and experience. NOTED : Need Similar Functioning Site Like gethuman.com. We want all the data's from the stated Site in to o...
I'm in need of a modern e-commerce website designed to sell mobile devices, laptops, tablets, and consoles. The site should be built using the latest technologies and equipped with a detailed inventory management system. *If you have made something Similar then only bid* Only if you are fully available to complete within a speed timeline. An Complete E-commerce Website *An detailed tailored Inventory management system where every device is unique so it has a detailed history and reports to it* Scraping data, extracting information needed to save time as we need it to be live ASAP Example site :
I'm seeking a skilled data scraper to extract stock prices from Yahoo Finance. The data should cover both the NYSE and NASDAQ. Key Responsibilities: - Scrape real-time and historical stock prices from Yahoo Finance. - Implement data scraping in a way that it can be run periodically. - Store the scraped data into a MySQL database using "INSERT ON DUPLICATE KEY UPDATE" to handle potential duplicates. Ideal Skills: - Proven experience in web scraping, particularly finance data. - Strong knowledge in MySQL and data management. - Familiarity with Yahoo Finance and stock market data. Please bid if you can provide a prototype and have experience in similar projects.
I'm seeking an experienced researcher to compile a detailed list of private drum instructors across the entire East Coast of the US and ...aimed at enhancing outreach and potential engagement. Key Responsibilities: - Research and document private drum teachers who possess personal websites showcasing their drumming and teaching services. - Gather and verify essential contact details: First Name, Second Name, Email, Web URL, City. - This project requires search engine research and music teacher directories, NOT LinkedIn scraping. Deliverable: - The final list should be delivered in a Google Sheets or excel document. Ideal Skills: - Proficient in web research and data collection. - Familiarity with music teacher directories preferred. - Previous experience in lea...
...js) to build a custom e-commerce website. The project will be similar in structure and functionality to popular e-commerce platforms like , requiring robust features such as product management, a secure shopping cart, checkout, and PayHere payment gateway integration. Responsibilities: Develop a responsive and user-friendly frontend using React.js, ensuring compatibility across mobile and desktop devices. Build a secure and scalable backend using Node.js and Express.js. Integrate the PayHere payment gateway to process secure transactions. Manage and optimize the MongoDB database for seamless data storage and retrieval. Implement performance optimization, security, and scaling best practices. Regularly update the team on project status and milestones. Skills Require...
I am seeking an experienced and skilled developer to create a feature-rich web application for controlling smart lighting devices via the Tuya API. The application should leverage the capabilities of the Tuya API library to offer seamless control over various aspects of smart lighting systems. Pre-designed templates and assets for the web app interface, as well as a pre-built backend library for API interactions, will be provided to accelerate development. Core Features: - On/Off Control: Allow users to power smart lights on and off individually or as a group. - Dimmer Control: Enable users to adjust light brightness with a slider or percentage input. - Color Adjustment: Provide a color picker or similar interface for changing the light colors, including support for RGB and ...
I'm looking for an expert data scraper to harvest ads from two popular Moroccan real estate goal is to capture a variety of listings including residential, rental, and commercial properties. Key Requirements: - Proficient in web scraping techniques and tools - Prior experience in scraping real estate listings is a plus - Able to deliver the scraped data in a clean, organized CSV file Ideal Skills: - Data mining - Python programming - Proficient in using web scraping libraries like BeautifulSoup, Scrapy or Selenium - Strong attention to detail to ensure data accuracy I appreciate freelancers who can communicate clearly and provide updates on their progress. Thank you for considering my project.
I'm in need of a seasoned sales professional with a keen skillset in online research and data scraping, who can help me gather emails from every business in Australia. The goal is to turn these businesses into partners. Specific requirements: - Target: All businesses in Australia, irrespective of their size or industry - Methods of Email Collection: A combination of cold calling, online research, and data scraping. In addition to collecting email addresses, I also need the expert to gather the names of the businesses and their contact emails. Ideal Skills: - Proficient in data scraping - Excellent sales and communication skills - Experience in partnership development - Capability of reaching out to a vast array of businesses Please note, this project requir...
I'm looking for a professional web scraper who can help me gather contact details from multiple Facebook groups. I specifically need: - Phone numbers, email and names - Data from more than 10 groups. The ideal candidate for this project should have: - Proficient skills in web scraping and data mining. - Prior experience with Facebook scraping is a big plus. - Ability to handle large datasets and ensure data accuracy. - Strong understanding of privacy and ethical considerations in data scraping.
I'm experiencing a deployment failure with m...experiencing a deployment failure with my Spring Boot application on AWS Lambda. The issue arises when I'm running the Lambda function, and I'm encountering a ClassNotFound exception for the handler class, despite the class file being present in the JAR. I need an expert who can: - Troubleshoot the deployment issue and find the root of the ClassNotFound exception. - Diagnose if there's a problem with the JAR or the Lambda configuration. - Provide solutions to successfully deploy and run the Spring Boot application on AWS Lambda. Ideal candidates should have: - Extensive experience with AWS Lambda and Spring Boot. - Proficiency in diagnosing and resolving deploymen...
I am seeking a professional or agency specializing in lead generation to target mid to small-sized corporations in the US for my tech company. Our offerings include GCP, GWS, Power BI, Power Platform, Office 365, AI, AWS, Azure, and Dynamics 365. Key Responsibilities: - Research Prospects and Verify Leads - Identify and generate valuable leads for companies in the US - Collect pertinent business details from each lead - Schedule the first demo call with a company Ideal Skills: - Proven experience in B2B lead generation, specifically targeting mid to small sized companies - Proficient in research and data collection - Familiarity with the tech industry is a plus We are open to working with a lead generation agency or an individual expert who can deliver qualified leads tailored to...
Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.
I need help converting exam papers in both PDF and DOC formats into a structured CSV file. The exam papers consist ...option2, option3, option4, solution, correct_option. - Image Handling: - For questions with images, I need the image URLs included in the CSV. - Storage: - All cropped images need to be stored in an S3 bucket. Ideal Skills and Experience: - Proficient in using Tesseract OCR for text extraction. - Experienced in handling both PDF and DOC exam papers. - Skilled in using Python libraries such as OpenCV, Pillow for image processing. - Familiar with document parsing tools like PyPDF2, PDFMiner, python-docx. - Knowledgeable in using AWS SDKs for S3 storage. Goal: - A structured CSV file with all the question data. - All processed images succe...
I need a skilled Unity developer who can help me set up a Codecanyon app. The setup involves integration with Cashfree and PhonePe payment gateways, configuring a combin...can help me set up a Codecanyon app. The setup involves integration with Cashfree and PhonePe payment gateways, configuring a combination logo, linking to my website, and setting the server on AWS. Requirements: - Proficiency in Unity, with a portfolio of similar projects. - Experience with Codecanyon apps. - Knowledge in configuring payment gateways, specifically Cashfree and PhonePe. - Ability to design a combination logo, as per my specifications. - Familiarity with AWS for server setup. Ideal Skills: - Unity Development - Codecanyon Apps Configuration - Payment Gateway Integration - Logo Design - A...
