Web scraping software postgresql jobs

Search for the top 30 YouTube channels and shorts based on keyword searches and save these to Airtable. Do the same for Podcasts, blogs, and newsletters. Scrape their # views, # subscribers, # video, and channel age, along with all of their other social profiles to Airtable. Look up and scrape their # subscribers and top 3-4 stats from their other social media sites. Sort their videos by views. Search the top 10% of their videos that have a guest. Look for the name of the guest and feed that person back into the algorithm to be scraped. Provide a ranking of people by reach in Airtable. Suggest how the ranking should be calculated and how AI could be used to refine the search and ranking, looking for influence and audience overlap.

I am looking for a professional to do software testing at Skills Required 1. Ensure the project is buildable locally and in CI/CD. 2. Conduct a quality analysis using SonarCloud. 3. Address the issues found or provide justifications for not fixing them. 4. Prepare and publish a Docker image on DockerHub. 5. Ensure the Docker container is running (e.g., web app or Java application). 6. Analyze code coverage using Cobertura or Jacoco. 7. Perform mutation testing using PiTest. 8. Conduct performance tests using JMH. 9. Create automated tests for poorly tested code components. 10. Analyze security using OWASP FindSecBugs and OWASP DC.

I'm seeking a software solution tailored for managing commercial properties. Its primary function will revolve around property management, though an ability to incorporate some basic accounting features would be a bonus. Key Features: - Tenant Management: The software should facilitate easy tracking and management of tenants. - Lease Tracking: A system to monitor lease dates, renewals, and compliance is crucial. - Maintenance Scheduling: The software should help in scheduling and tracking maintenance tasks. Ideal Skills and Experience: - Proficient in software development with a focus on property management systems. - Prior experience working on commercial property management software is a plus. - Strong understanding of tenant management, lease tr...

We're seeking a proficient technician to construct a robust VOIP system and a software phone for our company. The main objective is to enhance the reliability of our communication system. Key Responsibilities: - Build a stable VOIP system and software phone compatible with macOS and Linux. - Connect the system to multiple SIP trunk providers and GSM device gateways for line stability. - Assist in finding and connecting to a suitable SIP trunk service provider. - Undertake system maintenance post-construction. - Provide a detailed work plan and quotation for long-term cooperation. Ideal Skills & Experience: - Extensive experience in VOIP system construction. - Proficiency in building software phones compatible with macOS and Linux. - Ability to connect to mu...

I need assistance in removing a license from a specific Windows-based loading software used for a merchant ship, named Cload 6.1.1 The software is primarily focused on loading operations. Ideal Skills and Experience: - Proficient in Windows-based software - License removal and software modification expertise

...customer behaviour. 4. Technical Recommendations: Option 1: WordPress with Plugins Use WooCommerce Bookings or Amelia for booking features. Use plugins like Mailchimp for marketing automation. Pros: Cost-effective, easy to manage. Cons: Requires regular updates and plugin management. Option 2: Custom Development Frontend: React.js or Vue.js. Backend: Node.js with MongoDB or Python Django with PostgreSQL. Pros: Fully customizable, scalable for growth. Cons: Higher initial cost, developer support required. Option 3: Shopify or Wix Use built-in booking apps like Sesami for Shopify or Wix Bookings. Pros: Quick setup, user-friendly interfaces. Cons: Monthly subscription costs, limited flexibility. Deliverables: The fully functional live website with: Activity booking system reflect...

USDT Flashing Software Development Request

I need assistance pulling all followers from my business Instagram account. Specifically, I'm looking for their username, email, and name (if available). Ideal skills for this project include: - Proficiency in data extraction and web scraping - Familiarity with Instagram's platform and its data privacy rules - Experience in data presentation using Excel or CSV formats Please bid only if you can deliver the data as a neatly organized spreadsheet (Excel, CSV).

I'm in need of a comprehensive billing software for my restaurant that can cater to multiple users with an admin dashboard. This software needs to support Windows, MacOS, Linux, and also be accessible via a phone. Key Features: - Multi-user support: The software should be able to accommodate multiple users concurrently. - Admin dashboard: This should provide an overview of all operations and allow for administrative controls. - Real-time analytics: The software needs to provide up-to-the-minute data on sales, inventory, and other key metrics. - Payment Processing: A seamless integration for payment handling is crucial. User Roles: - Admin: This user will have full control over all software functionalities. - Manager: This user will have access to m...

...The software needs to be compatible with both mobile phones and PCs. It should allow users to take pictures of items, assign unique ID codes, generate QR codes, and initially designate ownership among family members (Katie, Jack, Tanya, Donna, Gary, Michael, Tom). Key features of the program should include: - Assigning an initial value of $5 to each item, but also allowing for higher valuations to be set. - Facilitating the input of item descriptions. - Outputting a PDF file containing the picture and value of each item. In terms of eBay integration, the program should interface with eBay for the auction of selected items. This includes: - Listing items for auction - Tracking bids - Managing payments The ideal candidate for this project should have extensive experience in ...

I'm looking for an experienced web scraper to extract data from several retail websites. The goal is to compile a list of products and compare their prices across different platforms. The ideal freelancer for this project would have: - Extensive experience in web scraping and data analysis - Familiarity with retail websites - Excellent attention to detail The project will involve: - Scraping specific retail websites to be communicated post-hiring - Collecting product names, prices, and descriptions - Compiling the data into a comparative list A strong understanding of data manipulation and pricing analysis is crucial for this project. Please provide examples of similar projects you have successfully completed.

I need a price at first I'm seeking a top-tier Global HR, Accounting, and Payroll Software. This system must be comprehensive and cover all critical functions, including: - An all-encompassing Employee Self-Service portal - Seamless Global Payslip Integration for remote staff - A Custom Backend development which can monitor staff's login & logout to track working hours The software should be able to: - Automatically calculate tax deductions - Handle currency conversion - Provide multi-language support in the Global Payslip integration The Employee Self-Service portal should allow staff to: - View and download their payslips - Update their personal information - Request leave or time-off The backend needs to be secure to prevent unauthorized access. It sho...

I am in need of a freelancer with expertise in data scraping and automation tools to help me streamline my real estate property data collection from various websites into my existing spreadsheets. Key Responsibilities: - Automate the gathering of real estate property data from multiple websites into my current spreadsheets - Ensure the data collection process is accurate and efficient Ideal Skills: - Proficiency with data scraping and automation tools - Experience with real estate data is highly preferred - Ability to improve workflow through automation I am open to suggestions regarding websites, types of data to be gathered, as well as the automation tools or programming languages to be used. The primary goal is to enhance the efficiency of my data collection process. ...

I'm in need of a proficient web scraper who can assist in generating sales leads through data extraction. The primary task involves scraping contact information from company websites. Key Requirements: - Extracting and compiling data into an organized list - Data should include Email addresses, Phone numbers, and Physical addresses Ideal Skills: - Proficient in web scraping tools and software - Experience in data analysis and lead generation - Attention to detail and commitment to data accuracy Please submit your proposal if you have the necessary skills and experience.

...Description: We are looking for an experienced system administrator or database specialist to assist with the installation and configuration of PostgreSQL on two new servers. The goal is to establish a replication setup where one server acts as the primary (master) and the other as a replica (slave), ensuring automatic synchronization and real-time backup of the primary server’s data. The setup should also allow secure connections to the PostgreSQL database from a third server, which will be used for accessing the database remotely. Key Requirements: PostgreSQL Installation: - Install the latest stable version of PostgreSQL on both servers. - Configure PostgreSQL to run as a service on both servers, ensuring automatic startup on reboot. Maste...

Description over freelancer and Video Call

We are looking for an experienced Python developer to create a web scraping script using Scrapy. The script should scrape property data from Idealista and extract detailed information for all types of properties. Framework: The project must use the Python framework Scrapy. Key Data to Scrape: - Title of the listing - Price of the property - Location (address, neighborhood, city) - Property features (size, bedrooms, bathrooms, type, orientation, floor) - Description of the property - Highlighted features (year of construction, energy rating, heating, elevator) - Image URLs - Floor plan (image or URL if available) - Extras (storage, garage, pool, common areas) - Contact information (name or agency and contact details) - Environment (proximity to transport, schools, parks, ma...

Please Sign Up or Login to see details.

I'm looking for a skilled web scraper to extract data from Bet365 across all sports markets. Key Requirements: - Scraping all available data across every market on Bet365 - Delivering the data in a structured JSON file - Specifying the frequency of data updates Ideal Skills: - Proficient in web scraping tools and techniques - Experience with sports data - Ability to structure and deliver data in a JSON format. The scraper should provide real-time updates (milliseconds) Java is mandatory We need only the consultantion for connection to the websocket Project target is live. Any solution to the PM would be appreciated

Project of auction platform for selling stock goods 1. General information: - Project name: - Develop an analog of the platform Project Goal: To create a web platform that allows to users to buy liquidated and surplus goods through online auctions, or price ( buy it now ). - Target audience: Resellers, owners of online stores, Entrepreneurs looking for bulk purchases of goods. 2. Main objectives: - Development of a user interface similar to - Uploading of goods to our site should be done automatically, through parsing of goods items on the site of our supplier.

Looking for experience Server Admin in Oracle Cloud for following tasks Key Tasks - Setting up and optimizing Compute Instances - Installing & Setting Coolify, WordPress, and PostgreSQL - Configuration for SSL and Multiple Domains - Security, Web Application Firewall (WAF) - Schedule Backup Bidder to present past works experience related to Oracle Cloud, Coolify & Wordpress setup to be shortlisted to receive task details after NDA signed.

I'm looking for an expert in data scraping who can extract specific user information from a Facebook group for me. Key Requirements: - Scrape user names and profile links - Extract user email addresses Deliverables: - All scraped data should be compiled into a CSV file Ideal Skills: - Proficiency in data scraping tools and techniques - Understanding of data privacy and ethical considerations - Experience with data organization into CSV files Please, only apply if you can guarantee the confidentiality of the data and comply with Facebook's terms of service.

I need to setup an environment with on my workstation that can acquire lists of leads from a portal that requires scrolling, clicking.

I need a professional live-action video showcasing my software product. The primary purpose of this video is to demonstrate the product in a clear and compelling way to potential business clients. Key requirements: - Experience in creating product demonstration videos - Ability to convey complex software concepts in a simple, easy-to-understand manner - Strong understanding of B2B communication and branding The ideal freelancer for this project should have a strong portfolio in live-action video production, particularly in the tech sector. A good understanding of software products and the business landscape will be a significant advantage. Quality, creativity, and attention to detail are key.

...format, no adding the members or sending requests or creating bot. Key Requirements: - Scraping content from a specific Telegram group - Building a dashboard that is capable of sorting data and creating pivot tables - Ensuring the dashboard runs 24/7 with scheduled breaks - Making the dashboard seamless for real-time or near realtime data viewing Key Data to be Scraped: - Content: The main focus will be on text messages. - Timestamp: I need to know when each message was sent. - Message Content: The actual text of the messages. Please note, I do not require data on user profiles or media files, just the text messages and their timestamps. Freelancer for this project should have: - Experience with web scraping, particularly on Telegram. - Knowledge of data extracti...

I'm looking for an expert in data scraping who can extract specific user information from a Facebook group for me. Key Requirements: - Scrape user names and profile links - Extract user email addresses Deliverables: - All scraped data should be compiled into a CSV file Ideal Skills: - Proficiency in data scraping tools and techniques - Understanding of data privacy and ethical considerations - Experience with data organization into CSV files Please, only apply if you can guarantee the confidentiality of the data and comply with Facebook's terms of service.

...access control for property managers and staff. Ideal candidates for this project should have: - Prior experience developing similar platforms. - Proficiency in integrating with the specified online platforms. - Strong understanding of the key features listed. Technology Stack: Backend: PHP / Laravel Framework Frontend: Modern UI framework (e.g., Vue.js, React, or similar) Database: MySQL or PostgreSQL APIs: Integration with OTA APIs using REST or XML Deliverables: Fully functional Channel Manager Platform with all features. Documentation for API integrations and user guidelines. Deployment and setup on the client’s server or cloud infrastructure. Priority for Existing Systems: If you already have a Channel Manager System available that meets our requirements, your prop...

...Design: Use scalable database solutions (e.g., PostgreSQL, MongoDB) that can handle large volumes of transactions and user data Caching: Use caching mechanisms like Redis or Memcached to speed up frequently accessed data. Load Balancing: Deploy across multiple servers or use cloud services to scale up during high traffic periods. Cloud Services: Use cloud providers (e.g., AWS, Google Cloud, or Azure) to deploy services with auto-scaling. Microservices Architecture: Split the system into different services for better scalability. Code Structure and Tools Frontend Technologies: React, Angular, or Vue.js for building dynamic, responsive UIs. Backend Technologies: Node.js with Express, Django, or Flask for the server-side logic. Database: PostgreSQL, MySQL, or MongoDB for dat...

I need a skilled web scraper to assist with my real estate business. This involves scraping a real estate website that updates daily with 2,000–3,000 listings. The goal is to extract and match the data with realtor needs from my internal database. Requirements: - Daily scraping of 2,000–3,000 listings. - Extract relevant data such as price, property type, location, realtor name, contact info, and more. - Basic matching for a specific region. Budget: I’m ready to pay $40/month for this service. Ideal Skills: - Proficient in web scraping techniques and tools. - Experience in data extraction and analysis. - Familiarity with real estate data is a plus. - Able to perform basic data matching. Note: Please be aware that the listings will n...

I'm in need of a skilled developer who can create a specialized Channel Manager for the hotel industry. This software should seamlessly integrate with major platforms like , Airbnb, Expedia, and Agoda. Key Features: - Centralized Booking Management: The tool should provide a singular interface to oversee all reservations, ensuring a smooth operation. - Real-time Inventory Updates: This feature is crucial to maintain accurate stock levels across all platforms and prevent overbooking. - Pricing Optimization Tools: The software should include advanced algorithms to help determine the most competitive pricing. ==== Channel Integration: Real-time synchronization with popular OTAs like , Airbnb, Expedia, Agoda, and more. Two-way data sync (retrieving bookings and updating

I am looking for an IT solution sales professional based in Punjab, India - Chandigarh/Ludhiana, who specializes in selling enterprise software solutions specifically tailored for the manufacturing industry. Key Responsibilities: - Identify and engage potential clients within the manufacturing sector - Promote and sell enterprise software solutions - Build and maintain strong client relationships - Understand client needs and provide suitable software solutions Ideal Skills and Experience: - Proven experience in IT solution sales, particularly software solutions - Ability to generate new leads and follow through the sales cycle till closure. - Excellent communication and interpersonal skills - Ability to understand and meet client needs -

...encapsulation. ● Relational Databases (Advanced): ○ Experience in query optimization, query building, and managing databases such as PostgreSQL, MSSQL, and Oracle. Expected Proficiency ● AWSCloudServices: ○ Familiarity with AWS tools relevant to data engineering, such as Athena and AWSBatch Jobs. ● DataModeling and Transformation: ○ Advanced expertise in processing structured and unstructured data. ● DataStructures and Algorithms: ○ Proficient in manipulating arrays and lists, implementing searching and sorting algorithms. ○ Experience with recursion and analyzing time and space complexity. Additional Skills and Experience ● Familiarity with web frameworks such as Django or Flask. ● Exposuretodatascience libraries like Scikit-learn, TensorFlow, or PyTorch. ...

I am in need of seasoned developers to create a desktop billing software similar to Tally. This software should be equipped with crucial features like inventory management, invoice generation, and payment gateway integration. It is essential that this application is compatible with Windows operating systems. Key Requirements: - Extensive experience in desktop application development - Proven track record in building billing or inventory software - Strong skills in integrating payment gateways - Knowledge of Windows OS compatibility requirements - Ability to create user-friendly interfaces I'm looking for a professional who can deliver high quality work in a timely manner. Your expertise, creativity, and dedication will be highly appreciated.

I'm looking for a data scraping expert to help me gather product information from three websites. The specific data I need includes product names and prices as well as product descriptions and specifications. The task is a one-time requirement, so I don't need ongoing updates. Ideal Skills and Experience: - Proficiency in data scraping tools and software - Experience in extracting product information from e-commerce websites - Strong attention to detail to ensure accurate data collection

...saree draping software using Angular. This software will primarily cater to the fashion design industry. Key Features: - Customizable saree patterns: Users should be able to create their own unique saree designs. - 3D Visualization: The software needs to provide a realistic 3D view of the saree draping process. - Draping Tutorials: Incorporating step-by-step tutorials on how to drape a saree. - Virtual Try-On: An interactive feature allowing users to 'try on' their designed sarees. - Social Media Sharing: Capability for users to share their designs on different social media platforms. Ideal candidates for this project should have: - Extensive experience in developing Angular applications. - A strong background in software development, particularly...

I am looking for a skilled Odoo Developer to create a robust, user-friendly application that meet...and ensure data integrity. Test the application to identify and fix bugs or performance issues. Requirements: Proven experience with Odoo development. Strong knowledge of Python and Odoo frameworks. Experience with mobile app development (e.g., Odoo Mobile Framework, React Native, or Flutter). Familiarity with front-end technologies (HTML, CSS, JavaScript). Understanding of database management (PostgreSQL preferred). Strong problem-solving skills and attention to detail. Preferred Skills: Knowledge of RESTful APIs or XML-RPC for integrating Odoo with other platforms. Experience in building responsive designs for multiple devices. Previous work with Odoo mobile apps or custom desktop i...

Job Description: We are looking for a talented and experienced web developer to build an image search website. The website will allow users to upload images and get search results from various image search APIs, displaying the images and related data returned in a clean and organized format. The developer will work with us to integrate and complete the website, ensuring it is secure, user-friendly, and fully functional. Some parts of the website, such as the results page code, are already available, and we have a Figma wireframe to guide the design. We need a developer to handle the backend integration, implement additional features like CAPTCHA protection, and ensure the platform is robust. Key Features and Requirements: 1. User Authentication System: Secure Login Me...

... I'm looking for an expert in Excel and astrology software integration. The primary task involves data import/export between the two platforms (excel and software). Please note, the data to be transferred/extracted encompasses specific fields from the astrolog software. Ideal Skills: - Proficiency in Excel and creating macros - Experience with software or with any astrology software that uses swiss ephemeris - Data management skills - programming skills to pull out data from () - be able to connect data from excel and the astrology software I will be placing dates and times into excel, and then I want to click a button and extract out info from software and paste it into the excel worksheet. The data I want

...ensure seamless game-play. The cache will need to track and store: - Character movements - Combat actions - Interactions with objects in the game The stored data should be periodically saved to a PostgreSQL database, specifically every few seconds. - This will not be required at this point, but prepare the data so it can be sent to or retrieved by the database server, which I will be asking you to do for phase 2. Ideal candidates will possess: - Proven experience in game server development - Strong skills in C++, with the ability to write efficient, high-performance code - Familiarity with PostgreSQL and experience in working with it for game data storage This project presents a fantastic opportunity for anyone passionate about game development, offering the chance to s...

I am seeking a developer who can create a cloud-based software system that allows me to play the same video on different Standard TVs (connected to media players) in various locations. Key Requirements: - The software should allow for monthly video updates. - I need the capability to upload videos directly from my home desk. - The system must support streaming to different locations simultaneously. Specifications: - Management of video uploads should be through a web-based dashboard. Ideal Skills: - Expertise in cloud software development. - Experience with video streaming software. - Knowledge of creating user-friendly web-based dashboards. I am looking for a professional who can deliver a reliable and efficient system for my streaming needs...

SOFTWARE EXPERT (XERO) FOR 1 PAGE TEMPLATE

I'm seeking collaborators to further develop,test and debug a software I have developed for taking software code backups. The software is written in Visual C++ and MFC / win32. I will pay a fixed amount for the service, and if the software is enhanced to a bug-free state, I will also share a percentage of the profits with you which will be your income from this work .You will also need to a little bit of marketing the software. more details. Functional Testing: The primary focus will be on functional testing, particularly: - Backup Accuracy: Ensuring the software accurately backs up code. - White Box Testing: This will involve testing the internal structures or workings of the software. You will be responsible for setting up the te...

I have an existing scraper built in python for the website (CWH). It scrapes the following information: - product description, price, images - SEO metadata - Additional metadata Currently, all the scraped data is stored in a CSV file. I am looking for a developer who has expertise in python / scraping and postgres to do the following: [Phase / Milestone 1] 1. Convert the existing scraper (code attached - /site-packages removed for space) to load the data in a postgres database. 2. Scrape reviews of products from the (CWH) website and store them in the database. 3. Look up the availability of the product in specific stores and write the boolean value in the postgres database. (code attached - ) [Phase

I'm in need of a Python script that can download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from ...download an Excel report from a public website every hour and upload it to a designated portal folder without any modifications. - **Task**: Script should perform the following tasks - Download an Excel report from a public website every hour. - Upload the report to a specific portal folder without any modifications. Ideal Skills: - Proficient in Python programming. - Prior experience with web scraping and automating tasks. - Familiarity with working with Excel files in Python. - Knowledge of file upload pr...

As the owner of a home cleaning company, I'm in need of a robust Desktop CRM software. The software should primarily manage customer relationships, tracking customer profiles and history, and facilitating automated communication via emails and SMS. Key Features: - Customer Profiles and History: The software should maintain comprehensive profiles of all our customers, detailing their cleaning history, preferences, and feedback. - Automated Communication: The system should be capable of sending scheduled emails and SMS to our customers, providing updates, reminders, and promotional content. Ideal Skills and Experience: - Proven experience in software development, particularly in creating CRM systems. - Strong understanding of customer relationship managem...

We are seeking to initiate a collaborative project to design and develop AI-based coconut counting software. The project entails the following key aspects: Collaboration Scope: Your team will manage software development, leveraging your expertise in AI and software engineering. Hardware implementation and integration will be handled by our team. Deliverables: Fully functional coconut counting software based on AI algorithms. Comprehensive documentation, including: Source codes with detailed explanations. Step-by-step installation and setup instructions. Post-development support to ensure smooth integration and deployment for the client. Client Requirements: The final deliverables must meet all specified requirements provided by the client, ensuring usability...

I'm looking for a skilled developer who can assist with the software configuration of my Bitcoin mining facility. Specifically, I need help with the installation of the MultiMiner software. Key Responsibilities: - Install MultiMiner software on my mining hardware. - Ensure all configurations are optimized for performance and security. Ideal Skills and Experience: - Proven experience in Bitcoin mining software configuration. - Familiarity with MultiMiner. - Strong IT and Computer Science background. - Excellent problem-solving skills.

I'm in need of a versatile professional skilled in Squarespace and Canva. Your primary t...integrating local delivery options and managing courier charges. You will also be tasked with creating a series of Canva social media posts and setting up an e-learning course in Squarespace (I will provide the written content). Additional responsibilities will include various general marketing tasks, such as scraping email addresses. Ideal Skills: - Proficiency in Squarespace and Canva - Experience in e-learning course setup - Knowledge of basic marketing tasks - Skills in data scraping Understanding of product fulfillment and delivery integration on e-commerce platforms is crucial for this role. Looking forward to your bids. Looking for ongoing person who I can a...

Development of NGO Automation Website + Software with EdTech Features Project Description We are looking for an experienced software development team or freelancer to build a comprehensive NGO Automation Website and Software for our organization. The solution should include the following features: Core Features Domain & Hosting: Includes domain registration (.in) and hosting services. SSL Certificate: Secure website with SSL encryption. Business Emails: Set up two business email addresses. Membership Management: ID cards with QR codes for members. Appointment letters with QR codes. Certificates for members with QR codes. Donation Management: Donation receipts with QR codes. Accept donations via payment gateways (Razorpay or PhonePe). Cash donation management with...

HM Interface Designed by Matlab program will send step motors data from Matlab to Arduino. Control a stepper motor connected to Arduino through Matlab. Arduino sketch file communicates will Matlab program. Program Interface will show and control current angle/step, degrees to Jog, motion jog +/- and X Y Z current position each of joints. On the program Human Machine Interface will have buttons for Teach New Position, Modify Position, call program and delete program, etc. . Program will make Auto Calibration, Manuel Calibration and Show Calibration values for each joints. Program section will be inputs and outputs toggle buttons for entering values servos and digital outputs. MATLAB Program will provide us as design view with written codes not just as .exe file. Program will be open sourc...