How to build a web crawler jobs
We are looking for an experienced developer or team to create a custom search engine from scratch. The goal is to build a fully functional search engine that operates independently, without relying on any third-party APIs (e.g., Google, DuckDuckGo, or Bing). In addition, the system will include a robust Web Crawler and Indexing System, along with an Admin Panel to manage the entire process. This project will involve developing a crawler, setting up an indexing system, and building an admin panel to control, monitor, and optimize the search engine. Key Requirements: 1. Web Crawler Development: • Purpose: Develop a custom crawler to scrape and collect data from websites...
We are looking for an experienced developer or team to create a custom search engine from scratch. The goal is to build a fully functional search engine that operates independently, without relying on any third-party APIs (e.g., Google, DuckDuckGo, or Bing). In addition, the system will include a robust Web Crawler and Indexing System, along with an Admin Panel to manage the entire process. This project will involve developing a crawler, setting up an indexing system, and building an admin panel to control, monitor, and optimize the search engine. Key Requirements: 1. Web Crawler Development: • Purpose: Develop a custom crawler to scrape and collect data from websites...
I need someone who knows how to make facebook posts go viral organic, feel free to contact me !
What type of product or service is being advertised in your Facebook/Instagram ads? Physical product Which style do you prefer for the graphics? Bold and vibrant What primary colors do you want to use in the graphics? Blue and green
I'm looking for a video editor for my YouTube Vlog/how-to series. The editing style should be slow-paced and casual. Key Requirements: - Edit footage into a slow-paced, casual style - Seamlessly integrate audio, visuals, and graphics - Understands the pacing and style of a typical vlog/how-to video Ideal Skills: - Proficiency in video editing software (e.g., Adobe Premiere Pro, Final Cut Pro, etc.) - Experience editing for YouTube - Ability to follow a specific editing style - Attention to detail If you have prior experience editing vlogs or how-to videos, please share examples of your work. I look forward to collaborating with you to create engaging content for my channel.
...an expert capable of designing a web crawler that can gather data from 25-35 specified websites, similar to www.ladies.de. We are looking for someone who can only crawl data or someone who can crawl data and also program a dashboard. Task Description: Development of a Web Crawler: The crawler should scan the specified public websites and collect structured data (e.g., text content, metadata). Images should be downloaded in the highest available resolution and stored in a defined directory. Database Integration: The collected data should be stored in a relational database (e.g., MySQL). Data structure: Tables for URLs, collected content, images, and associated metadata. Admin Dashboard: Provide a use...
I am looking for blog writer that knows how to write about Food. I need to have the entire 12 months of Blog written for 2025 Looking to pay around $25 per blog. One blog per month. We already have the food ideas also we have the pictures of our products because we want to focus on our brands for example we have three brands , Beverage, Spicies and breadings so we will illustrate importanst of it will send the blog write these informations then they will put it together and write about it. 50% of the work already done
here are the...com/0x-49/exemplarFiles here are the files I have created describing each page how I want it to be created and implemented I have proposed sitemaps and file structure for all and have created these pages with AI I need everything to be messed together now please use the latest and greatest AI tools to speed up your development like: windsurf by Codium cursor ai cline roo cline and any other tool you might need the files have been created, and everything needs to be meshed together in a coherent cohesive manner help me create a better explained and elaborated detailed plan for a project proposal to Upwork for developers
I am creating a business plan to transition case projects from one department into my liens department. What we do Personal injury firm that ensure client do not owe medical bills for their wreck there clear of any liens
As a startup, we're looking to create engaging demo videos to showcase our app's features to potential users. The videos will need to be in both English and Hindi, so fluency in both languages is crucial. Key Requirements: - Create a voice-over script based on the app's features - Record voice-overs in a clear, engaging manner - Edit the videos to include screen recordings of the app features - Provide a reference document in English Ideal Skills: - Video editing - Scriptwriting - Voice-over - Bilingual in English and Hindi
I'm looking for two (2), 1 min (could be 10 sec less - 10 sec more) , 2D animated, casual tone, "how to" commercials for my company. The animations casual style but keep in mind that our company is a foundation giving to the elderly in the society, conveying the ease and fun of using our products or services. Ideal skills and experience for the job include: - Proficiency in 2D animation - Experience in creating casual content - Ability to deliver within the specified timeframe - Prior work with "how to" commercials is a plus.
I am looking for a highly skilled professional who can create a short film of how some one can sign up thier utility service with us.
...details #1—> PRODUCT ( FREE) 1. HOW TO GET ANYTHING YOU WANT CHALLENGE. ( Free challenge) 2. Online webinar to build wealth and healthy relationships. Lessons of secrets of success.( 3 DAYS CHALLENGE) 3. Support from the community and coaches. 4. Audiences are athletes, business owners and everyone who wants to be successful. #2—> PAYMENT 1. ILL pay you 5000 inr for the first project. 2. If you bring 101 free sign-ups before March 8 then you'll build trust and I will pay you more for the next projects (remember next projects will be to bring sales not free sign ups but paid sales). #3—> MY EFFORTS 1. I won't do any work for these sign-ups 2. I'll only provide you the link to p...
...experiencing issues with a script I have for crawling and analyzing GitHub repositories. The specific problem lies with the crawling functionality. The script fails to capture the complete file structure and content when crawling GitHub repositories. This incomplete data has hindered my ability to fully analyze and evaluate the codebase of certain repositories. I need an experienced programmer with a solid understanding of Python, Selenium, and web scraping. You should be able to troubleshoot and fix the script so it can accurately crawl and collect all necessary data from GitHub, including files, directories, and their content. Please include in your proposal any relevant experience you have, particularly with crawling data from GitHub or s...
I need someone who can Teach Student On How to Draw Simplified Hand-Drawn Circulatory System. I'm looking for a simplified hand-drawn illustration of the circulatory system, suitable for an 8th-grade student. You need to teach the student how to easily draw circulatory system. Key elements to include: - A clear and simplified depiction of the heart. - An easily understandable representation of the blood vessels. Ideal skills and experience: - Previous work creating educational illustrations or diagrams. - Strong drawing skills, with a style that is clear, engaging and suitable for a younger audience. - Experience with depicting biological systems would be a plus.
I need someone who can Teach Student On How to Draw Simplified Hand-Drawn Circulatory System. I'm looking for a simplified hand-drawn illustration of the circulatory system, suitable for an 8th-grade student. You need to teach the student how to easily draw circulatory system. Key elements to include: - A clear and simplified depiction of the heart. - An easily understandable representation of the blood vessels. Ideal skills and experience: - Previous work creating educational illustrations or diagrams. - Strong drawing skills, with a style that is clear, engaging and suitable for a younger audience. - Experience with depicting biological systems would be a plus.
...using Cascadeur!! As a beginner in the animation world, I'm looking for an experienced animator who can teach me, in the simplest and quickest way, how to create character movements using Mixamo in the Cascadeur software. I'm not interested in 3D animation. Also, I don't want to spend a lot of time and effort on modeling and such. I just want to create animations that other people have made in MIXAMO using Cascadeur program and upload them to my YouTube channel. <LIST> How to import animations from MIXAMO and change their position, rotate them, and merge them When importing two or more animations, how to make them flow naturally when the positions are different between each animation ...
I need a web crawler that can capture video stream data to trigger real-time notifications. The specific types of notifications and data formats for saving the crawled data will be discussed later. Ideal Skills: - Proficiency in web scraping - Experience with video stream data - Programming skills in Python, Java or similar languages Please note, the specifics of the project may evolve as we progress.
I'm looking for two, 15-30 second, 2D animated, casual tone, "how to" commercials for my company. The animations casual style but keep in mind that our company is a foundation giving to the elderly in the society, conveying the ease and fun of using our products or services. Ideal skills and experience for the job include: - Proficiency in 2D animation - Experience in creating casual content - Ability to deliver within the specified timeframe - Prior work with "how to" commercials is a plus.
...convey a feeling of premium, sophistication, exclusivity, cleanliness, healthy and innovation. 4. Lots of visuals like static illustrations, multiple small animated gifs, infographics and interactive content. 5. Text only to be provided by SSCG, vendor to create visuals based on text to convey information 6. Product imagess to be provided by SSCG 7. Web Crawler software to be incorporated. The purpose is to have a section that would display air pollution related news for India 8. AQI display meter integration from various sources 9. Chatbot integration 10. About 14-15 total pages plus a BLOG page 11. The website has to tell a story. 12. The product is related to health industry, specifi...
I'm looking for a professional skilled in e-book production and animation to help create an 8-part series aimed at early years children (2-6 years). The series is titled "How to Feed a Dragon" and will require character creation for the dragon and other animals, as well as scene creation. Key Requirements: - Moderate level of animation: This includes character interactions and scene transitions. - Interactivity: The e-books should feature clickable elements, interactive storytelling, and sound effects. - Character Design: The style should be 'cute and simple'. Currently, the stories contain approximately 8 pages each and have been produced in Canva. Based on cost, I would like to consider adding animation to...
I'm looking for a developer to create a single-player, hand-drawn style, dungeon crawler survival mobile game. Key Features: - Character Leveling and Progression: Players should be able to level up their characters, unlocking new abilities and making strategic decisions about character development. - Resource Gathering and Management: The game should involve collecting resources from the environment, which players will need to manage wisely to survive and progress. - Combat and Tactics: The game should feature engaging and challenging combat scenarios, requiring players to use tactics and strategy to overcome their foes. The ideal candidate for this project would have a strong background in game development, parti...
I'm seeking a skilled web developer to enhance user interactions on my webpage through an interactive browser window feature. This will involve the implementation of interactive animations with dynamic effects, ensuring an engaging and stimulating user experience. Key Project Requirements: - Develop an interactive browser window to be accessed from a designated page. - Incorporate interactive animations such as moving elements, changing shapes, and other engaging visuals. - Utilize dynamic effects for the animations, creating an energetic and captivating experience.
My company () develops webshops based upon the Magento commerce solution. Please read about it on the site. For the "blog" section we are looking for a freelancer to write unique and well researched articles. Our current blog posts are too "thin" in content and we want to improve the quality. As a trial, would like to ask you to write an article about "Gen Z - And how they like to pay "
I want to watch the changes in holder numbers, bio, etc over time of one website, two different sections: and There is a list of agents on each of them. Once one clicks on one of them there is plenty of info. Collect and put in json on file (2 jsons, 1 for each of the sectors) Important: Deliverable is the python script. I want to be able to update the data daily.
Clearly outline the project goals: Preparing ~1,000 PDF pages with images for fine-tuning. Handling image metadata and linking it to text. Formatting content in JSONL for OpenAI fine-tuning. Specify requirements: Experience with OpenAI or similar tools. Familiarity with data preparation for AI training. Knowledge of technical manuals and metadata handling. Mention deliverables: Clean, structured dataset ready for fine-tuning.
I'm seeking a skilled writer with a strong understanding of military operations and training programs to assist in drafting a 1,500 - 2,000 word journal article. The article will argue for a significant change in the current utilization format of the Army's 150U Warrant Officers, advocating for the implementation of an Uncrewed Aircraft System (UAS) training program and utilization similar to that of the USAF. Must be in word format., and reference all sources used. No preferred sourcing format. Key Focus: The article should primarily emphasize how such a shift could enhance 'Strategic Flexibility through Modernization'. Source Inclusion: The piece will predominantly reference 'Military reports and docume...
I need a detailed guidance, how to create the call of the 'Web Scraper' Agent from Apify with domains coming via make (one by one or bage) .
I'm seeking a seasoned writer who can generate a variety of 'How To' and tips articles, or knowledge articles, catered towards the general public. The topics can cover a wide array of subjects, so creativity and versatility are key. Ideal Skills: - Exceptional writing skills - Creativity and versatility in topic selection - Ability to write for a general audience Experience: - Prior experience in article writing is a must. - Experience writing 'How To' or tips articles is a plus.
I'm looking for a skilled writer to create an informative 'how-to' guide aimed at students or academia. The guide should be clear, engaging, and well-structured to ensure it can effectively convey its message to the target audience. Ideal skills for this project include: - Excellent writing and editing abilities - Understanding of academic language and structure - Experience in creating educational content - Ability to simplify complex concepts for a student audience The purpose of this guide is to provide valuable information in an accessible format. If you have a passion for education and the skills to match, I look forward to your proposal.
...Title:* Developer Needed for Web Scraping & Interactive Link Management Application *Description:* I’m looking for a skilled developer to create an application that extracts and organizes links from *IFRAME HTML content*. The application should: 1. Gather all information from IFRAMES using *JavaScript* or *Python*. 2. Extract all links from the HTML content within the IFRAMES and compile them into a list. 3. From this list, generate a *unique list of links* (remove duplicates). 4. Associate each link with an image so that clicking the image will redirect to the corresponding URL. 5. Host the application on my domain, ensuring it's easily accessible online. I believe this project may require a *...
...certificate works fine but per default, Odoo is not protected (no https). I need to intergrate the SSL certificate in order to protect Odoo and especially port 8069 (https). Please tell me how it works against the background of an Apache Server. I am a programmer and you can tell me Linux Command Line Code, Python Code, XML code, html code or direct me through the Odoo UI. Tell me in which files and at what position particular changes need to be implemented. The Odoo documentation and AI do not help regarding this task. Therefore, just send me a solution if you are experienced and have already successfully implemented SSL certificates in Odoo Community Version (Apache) yourself. The money will be awarded to the first person who co...
I'm seeking video content creator for YouTube channel, and website. Key Areas of Focus: - Primarily, I need 'how-to' videos that cover a wide range of topics, from Microsoft 365 and AI to iPhone tips and tricks. - Cyber security best practices will also be a significant part of the content. - Finally, I will need some client onboarding videos. Requirements: - The 'how-to' videos will need to be optimized for our YouTube channel. - A preferred style for these videos is live-action tutorials. - An understanding of cyber security and tech is highly desirable. Skills and Experience: - Proven video production and editing skills. - Experience creating live-action tutorial videos. - Familiarity with cybe...
Seeking an AWS Glue expert to assist with fetching analytical data from Google BigQuery and storing it on S3 in Parquet or CSV format. The job includes setting up an incremental data extraction process that runs daily. Current Status: Query: Already prepared. Connection: The connection to BigQuery is set up and ready from within Glue Studio. Challenge: 1- I need assistance configuring Glue ( Glue Notebook or visual Job) to handle date-partitioned tables in BigQuery and load data from there incrementally. 2- configure S3 crawler to scan the bucket and push new data to DB Background: I previously implemented this workflow using QlikView script, but I am now transitioning to AWS. Looking for guidance on best practices specific to A...
We’re looking for a talented motion graphic designer to create a high-quality, visually engaging GIF for the landing page of our Daily Fantasy Sports platform, PickMantra. This GIF will explain to users how they can play on our platform in a simple, step-by-step manner. Key Responsibilities: Design a sleek and modern GIF that aligns with the aesthetics of our platform. Break down the "How to Play" process into 3-4 easy-to-understand steps. Use on-brand colors, fonts, and graphics to maintain a cohesive look. Optimize the GIF for fast loading on web and mobile platforms. Our Target Audience: 18-34-year-olds in Tier 1 and Tier 2 cities in India. Deliverables: A GIF file that ...
I'm looking for an experienced developer who can create a AI web crawlers Key Requirements: -Vactor db knowledge (pinecone) -deep learning
...also be disruptive or harmful if taken too far. Here’s a general overview of how to prank call using some popular apps, along with important guidelines to ensure it’s all in good fun: 1. Using Prank Call Apps: There are several apps designed specifically for prank calling. These apps usually allow you to change your voice, spoof the caller ID, or even play pre-recorded messages. PrankDial: This is a popular app for prank calls. You can choose from a variety of prerecorded messages to send to a friend or someone else. SpoofCard: This app lets you change your voice and disguise your phone number, so it appears as though you are calling from a different number. Call Voice Changer: This app allows you...
We require someone to install Sphider () the PHP web crawler on on cpanel vps Budget for this task is $10 Winner will be given cpanel to setup and install.
Hello, I hope someone can teach me how to configure pgBackRest to back up my database on a VPS with PostgreSQL. The idea is to store those backups in Azure Storage and also have them explain how to restore the database in case it stops working.
I need a skilled Python developer to create a web crawler script for me. The script should be capable of extracting text data from various tender websites. Key requirements: - Proficient in Python and its web scraping libraries (BeautifulSoup, Scrapy, etc.) - Experience with creating web crawlers - Understanding of how to extract and handle text data - Able to target specific types of websites (in this case, tender sites) - Knowledge of best practices for web crawling (to avoid IP bans, etc.) The ideal freelancer for this project should be able to demonstrate previous experience of similar projects, and have a good understanding of the intricacies involved in crawling and scraping data from...
Revising the project as I realized the skills required are different. You will receive a bird feeder with Camera from us so you need to live in US. - Install the feeder - Shoot a video about how to install the feeder - Edit the video so others can know how to install following your guide.
As an intermediate IDA user, I'm seeking a professional with extensive experience in IDA to teach me more about disassembly and assembly analysis, debugging techniques, and script development. Ideal skills for this project include: - Expertise in IDA - Proficiency in disassembly and assembly analysis - Skills in debugging techniques
...looking for a skilled Python developer with expertise in web scraping to enhance an existing script designed to extract product data from Walmart's online store. The current script retrieves only 10 items at a time, while the website displays 40 items per page. The task involves addressing the infinite scroll or JavaScript loading mechanisms that are limiting data extraction. Key Responsibilities: - Modify the existing Python script to enable it to scrape all 40 items per page. - Implement solutions to effectively handle infinite scrolling or dynamic content loading. - Ensure the script is efficient and adheres to best practices in web scraping. - Conduct thorough testing of the updated script to confirm ...
I am seeking a skilled freelancer with expertise in the XRPL network, Xaman wallet, and to create a professional, educational video tutorial tailored for beginners. This video should provide a clear, step-by-step walkthrough of the following: How to Purchase XRP on Coinbase: Navigate the Coinbase platform. Create an account (if necessary). Buy XRP securely. How to Set Up a Xaman Wallet and Fund it with XRP: Download and install the Xaman wallet. Set up the wallet step by step, including securing the seed phrase. Fund the wallet with XRP. How to Use the Xaman Wallet to Purchase Meme Tokens on : Navigate and select a token. Establish a Trustline for a specific token. Complete ...
I am seeking a skilled backend developer who can create a simple solution to retrieve user data from an API. I have some basic programming skills and would like to not only have the solution created, but also understand how it is done in order to make adjustments if needed. Create simple TG bot: - it will get information from API from two sources, compare them and create conditional notification - I would like to be involved in creating it (best way to create it on my machine, via TeamViewer, Skype) I would like to understand step by step. - good English/Polish required
content writing base on my life’s journey which I have concocted successful models
I need a Python/Django based web interface that can take 50 keywords and automate a news crawler, a URL parser, and an interaction with ChatGPT's web interface. Requirements: - Step 1: The web interface should allow me to input 50 keywords which will be stored in a database. - Step 2: The crawler should be able to search for each of the preset 50 keywords on , extract the actual news URLs after Google News redirection and save them back to the database. - Step 3: The parser will validate the URL's accessibility and extract meaningful details from each news article including the Title, publication date, and the original URL. - Step 4: Automate interaction with ChatGPT using Selenium to fin...
I'm looking for a video editor to help me create a concise "how to use" video using existing footage from YouTube. The objective is to ensure the video is simple, short, and clear. This is not difficult or large project, please check price for that. Key Requirements: - Editing existing YouTube video footage - Adding voice-over (instructional) - Inserting subtitles (simple and plain) - Ensuring clarity of instructions throughout the video Please provide samples of your previous work that includes instructional voice-over and texted video. This will help me gauge your style and suitability for the project. The final video format will be discussed later.
