Elasticsearch nutch hadoop jobs

Filter

My recent searches
Filter by:
Budget
to
to
to
Type
Skills
Languages
    Job State
    2,000 elasticsearch nutch hadoop jobs found

    Install and configure Hyper-V + Ubuntu + Docker I've a windows server 2022 and a Hyper-v and I need someone to do the following: Running a Hyper-v virtual machine, installing Ubuntu server, ssh, docker, docker compose, Redis cache, RabbitMQ, Elasticsearch. Then configure the Hyper-v VM to use the internet and also to expose the ports of the docker containers to the host (windows server). # Structure - Windows server 22 (host) - Hyper-V - Ubuntu server - Docker + docker compose + ssh - Redis cache, RabbitMQ, Elasticsearch # Expected behavior - The ability to access the `Redis cache` service and ports from the `Windows server 22 (host)` - Auto start hyper-v and everything to keep the `Redis cache` service accessible after the host, the `Windows server 22 (host)` is r...

    $158 Average bid
    $158 Avg Bid
    29 bids

    I'm looking for an experienced Ruby On Rails developer to create a web app for me. The app will fetch data from a server using Elasticsearch and present it to users through an advanced search interface. Key Requirements: - Proficiency in Ruby on Rails with proven experience in developing web apps. - Familiarity with Hotwire and Stimulus for creating reactive user interfaces. - Experience with TailWind for responsive and aesthetically pleasing UI design. - Knowledge of Postgres for database management. - Expertise in API integration and development. The app should feature: - An advanced filter system for the search interface, going beyond a simple search bar. - Filters based on categories. Ideal candidate would have a strong background in full-stack development, with a keen...

    $15 / hr Average bid
    $15 / hr Avg Bid
    21 bids

    I'm seeking a seasoned software engineer well-versed in React, NodeJS, and Storybook + ElasticSearch. The project involves extensive refactoring of existing code in addition to the development of new features, with a particular focus on the creation of a comprehensive dashboard and analytics system, calendar integration, and robust security measures. This project will be FULL TIME and last ~1 month on a contract, if the work gets done we can renew the contract for more. Key aspects of the project include: - Developing new features: The primary focus will be on creating engaging and innovative new functionalities. Clean code quality is crucial in this fast-paced startup environment. Your ability to maintain high coding standards and develop using clean, efficient code will b...

    $8 / hr Average bid
    $8 / hr Avg Bid
    81 bids

    We are looking for full-stack developer: Frontend - ReactJS Backend - NodeJS, ExpressJS SQL - PostgreSQL, MongoDB, ElasticSearch. Full Time as according to UK Shift (12 to 9) Duration of contract - 3 months extendable to 4 months. Experience: 5+ code quality and familiarity with integrations would be useful

    $5 / hr Average bid
    $5 / hr Avg Bid
    58 bids

    I'm seeking a seasoned software engineer well-versed in React, NodeJS, and Storybook + ElasticSearch. The project involves extensive refactoring of existing code in addition to the development of new features, with a particular focus on the creation of a comprehensive dashboard and analytics system, calendar integration, and robust security measures. This project will be FULL TIME and last ~1 month on a contract, if the work gets done we can renew the contract for more. Key aspects of the project include: - Developing new features: The primary focus will be on creating engaging and innovative new functionalities. Clean code quality is crucial in this fast-paced startup environment. Your ability to maintain high coding standards and develop using clean, efficient code will b...

    $510 Average bid
    $510 Avg Bid
    72 bids

    I'm seeking a seasoned software engineer well-versed in React, NodeJS, and Storybook + ElasticSearch. The project involves extensive refactoring of existing code in addition to the development of new features, with a particular focus on the creation of a comprehensive dashboard and analytics system, calendar integration, and robust security measures. This project will be FULL TIME and last ~1 month on a contract, if the work gets done we can renew the contract for more. Key aspects of the project include: - Developing new features: The primary focus will be on creating engaging and innovative new functionalities. Clean code quality is crucial in this fast-paced startup environment. Your ability to maintain high coding standards and develop using clean, efficient code will b...

    $156 Average bid
    $156 Avg Bid
    33 bids

    I'm seeking an expert in Elasticsearch configuration for Vendure. The primary goal is to resolve a 'congratulations' related issue. Key tasks: - Diagnose and troubleshoot the current Elasticsearch problem that's affecting the 'congratulations' messages. - Improve search speed and accuracy to ensure timely and precise delivery of these messages. - Support complex queries to enhance the system's overall performance. Ideal skills and experience: - Proven expertise in Elasticsearch, specifically within the Vendure platform. - Strong problem-solving skills with a focus on troubleshooting and diagnosing system issues. - Experience in improving system performance through configuration enhancements.

    $14 Average bid
    $14 Avg Bid
    3 bids

    This position is in remote work • The can...remote work • The candidates also should have prior experience on Hadoop Administration, Cloudera Upgradation and Administration, Spark, Nifi, Splunk • Implementing, managing and administering the overall Spark logs to Splunk Dashboard via NiFi • If working with open-source Apache Distribution then Hadoop admins have to manually setup all the configurations- Core-Site, HDFS-Site, YARN-Site and Map Red-Site. • However, when working with Hadoop distribution like Cloudera the configuration files are setup on start-up and the Hadoop admin need not configure them manually. • Ensure that the Splunk dashboard is up and logging the spark job logs. • Monitoring the cluster connectivity an...

    $22 / hr Average bid
    $22 / hr Avg Bid
    2 bids

    We're seeking a skilled developer to create a chat-bot for our established business. This bot will leverage OpenAI's capabilities and utilize content from Elasticsearch. In your application, please provide a detailed project proposal. This should outline your understanding of the task, your proposed approach, and any relevant past experiences. Ideally, we're looking for a professional with a strong background in AI, chat-bot development, and Elasticsearch. The application should have two main modules 1 - indexer - to index new documents whose content and metadata are in Elasticsearch 2 - search engine - to ask questions search results must also return specific metadata, such as: document name, and a link to download the document (built dynamically) W...

    $573 Average bid
    $573 Avg Bid
    79 bids

    ...experience in chatbot development, particularly with RAG and WhatsApp API. - Excellent understanding of customer service needs and dynamics. - Ability to create a bot that can handle very specific technical queries. - Strong skills in software development and AI technology. Please only apply if you can deliver a high-quality, efficient, and reliable chatbot. Requisitos del proyecto: FAISS o ElasticSearch: Configuración e implementación para la indexación de datos. El sistema deberá ser capaz de buscar y recuperar fragmentos de información relevantes de una base de datos estructurada a partir de consultas del usuario. GPT (OpenAI) o Hugging Face Transformers: Implementación de un modelo de lenguaje natural para la generaci&oacu...

    $2418 Average bid
    $2418 Avg Bid
    70 bids

    I'm in the planning stage of building a robust Security Operation Center (SOC) primarily aimed at threat detection. I need an engineer with substantial experience in setting up SOCs and proficient in TheHive, MISP, Elasticsearch(ELK), and Cortex. Key Responsibilities: - Assist in the planning and setup of the SOC. - Implement functionalities such as real-time monitoring, automated threat response, and data analysis and visualization. Ideal Skills: - Proficient in TheHive, MISP, Elasticsearch(ELK), and Cortex. - Extensive experience in SOC development. - Strong understanding of threat detection methodologies.

    $2140 Average bid
    $2140 Avg Bid
    41 bids

    I'm experiencing configuration errors with my NestJS Vendure Elasticsearch plugin setup. I've got some logs that might be helpful for troubleshooting, but I'm not sure how to interpret them or what to change to fix the issue. Ideal Skills and Experience: - Proficient in NestJS and Vendure - Experienced with Elasticsearch - Strong troubleshooting skills - Ability to interpret technical logs

    $13 Average bid
    $13 Avg Bid
    11 bids

    I'm seeking an expert in OpenSearch who can assist me with monitoring a Ubuntu folder using my existing OpenSearch setup. Key requirements: - Monitor all activities in a specific folder, including file creation, modification, and deletion. - Implement a solution that allows real-time tracking of these activities. Ideal skills include: - Experience in OpenSearch/ElasticSearch. - Experience with Linux/ubuntu systems. - Knowledge of file system monitoring.

    $173 Average bid
    $173 Avg Bid
    32 bids

    I'm looking for a data expert who can help me with reporting and visualization from SQL databases. Key Responsibilities: - Utilize SQL databases for data extraction and analysis - Create insightful graphs and charts using Excel and Hadoop - Transform complex data into easy-to-understand visual representations Ideal Skills: - Proficiency in SQL and Excel - Experience with Hadoop - Strong skills in data visualization and creating graphs and charts - Ability to simplify complex data for clear understanding Your task will be to uncover trends, patterns and insights from our data, and present these in a visually appealing and easy to understand format. Your expertise in data analysis will be crucial to our project's success.

    $26 Average bid
    $26 Avg Bid
    13 bids

    I am looking for a skilled developer to integrate either Sphinx search or Elasticsearch into my Osclass platform. The main purpose of this integration is to enable the system to handle large datasets more efficiently. Key Requirements: - The integration should facilitate faceted search, full-text search, and real-time indexing. - The chosen search solution (Sphinx or Elasticsearch) should be implemented in a way that optimizes for speed and accuracy in handling large data volumes. Ideal Skills: - Extensive experience with both Osclass and Sphinx/Elasticsearch. - Proven track record of implementing complex search functionalities. - Strong problem-solving skills, particularly in dealing with large datasets.

    $158 Average bid
    $158 Avg Bid
    30 bids

    ...innovative project. The goal is to create a software solution that combines Retrieval-Augmented Generation (RAG) Machine Learning Models with OpenAI and Elasticsearch. The primary focus of this software is to enhance information retrieval. Key Responsibilities: - Lead the development of the software solution - Integrate various data sources including internal databases, public web data, and third-party APIs - Implement essential features like Natural Language Processing (NLP) capabilities, real-time data processing, and customizable search options Ideal Skills: - Proficient in AI and Machine Learning - Experience with OpenAI and Elasticsearch - Strong understanding of NLP - Capable of implementing real-time data processing and customizable features This project is perfe...

    $380 Average bid
    $380 Avg Bid
    23 bids

    More details: Is this project for business or personal use? For an existing business What information should successful freelancers include in their application? Past work How soon do you need your project completed? ASAP SKills : SQL,H base,HDFS

    $13 / hr Average bid
    $13 / hr Avg Bid
    12 bids

    We are seeking a seasoned full-stack developer with strong experience in PHP/Laravel and Vue.js. The project involves back...strong experience in PHP/Laravel and Vue.js. The project involves backend development, API integration, and front-end tasks for an e-commerce platform. The ideal candidate will have extensive experience with Laravel, Vue.js, and working with cloud services like AWS. Requirements: - 10+ years in web development. - Proficient in PHP, Laravel, and Vue.js. - Experience with MySQL, PostgreSQL, and ElasticSearch. - Strong skills in API integration. - Familiarity with AWS services (S3, SES, EC, RDS). - Knowledge of testing tools like WebdriverIO, Postman, and Jira. Duration: 2-3 months. Apply: Please submit your portfolio and a brief description of your relevant e...

    $205 Average bid
    $205 Avg Bid
    48 bids

    ...data categories if needed. 3. **Storage in Elasticsearch:** - All processed document information must be stored in Elasticsearch with the following fields: - **Identification Number**: Provided through the API with each request. - **Source Document Name**: Including the extension. - **Source Document Path**: To access the original file. - **Anonymization Date**: To track when the document was processed. - **Anonymized Text**: The resulting text after anonymization. - **Subject Type (optional)**: A field to categorize the type of subject matter of the document. - **Summary (optional)**: A summary of the document’s content. - The combination of the identification number and the file name will make each record in Elasticsearch unique. ...

    $569 Average bid
    NDA
    $569 Avg Bid
    39 bids

    I'm looking for an expert with a strong background in Magento to help upgrade my two websites ...expert with a strong background in Magento to help upgrade my two websites from 2.x to the latest version 2.4.7 or later. The project involves disabling MySQL and enabling/installing Elasticsearch, and fixing bugs or clearing errors. Key points: - General error: 1205 Lock wait timeout exceeded has been a recurring issue. - My server load is consistently high, contributing to performance slowdowns. - I want to improve both search speed and product indexing with the new Elasticsearch installation. Ideal skills include: - Strong experience with Magento - Proficiency in server optimization - Knowledge of Elasticsearch installation and configuration - Ability to troubles...

    $223 Average bid
    $223 Avg Bid
    90 bids

    ...such as Python (with Flask/Django) or Node.js, focusing on API development, database management, and integration with mapping services. - Frontend development: Proficiency in JavaScript frameworks like React.js or Vue.js for developing responsive, interactive web-based applications. - Database management: Familiarity with databases like MongoDB, PostgreSQL, and search optimization tools like Elasticsearch for managing and retrieving structured content and geolocation data. - Language processing and translation: Experience with translation APIs (e.g., Google Translate, Microsoft Translator) and handling multilingual content for seamless user experience. - Performance optimization: Skills in implementing caching, prefetching strategies, and optimizing data access for fast, responsi...

    $1662 - $3324
    Sealed NDA
    $1662 - $3324
    24 bids

    I'm looking for an experienced individual to install Elasticsearch 7.10 on a Debian 12 server, with a specific requirement of including the Elasticsearch SQL plugin. This installation will be a pivotal part of a larger system where Elasticsearch will be integrated with Magento 2.4.7 p1. Key requirements: - Install Elasticsearch 7.10 on a Debian 12 server - Include the Elasticsearch SQL plugin - Ensure seamless integration with Magento 2.4.7 p1 Ideal skills and experience: - Proficiency in Elasticsearch installation, particularly version 7.10 - Prior experience with Elasticsearch SQL plugin - Familiarity with Magento 2.4.7 p1 integration - Strong understanding of Debian 12 server configurations - Ability to troubleshoot and ensure smo...

    $22 Average bid
    $22 Avg Bid
    26 bids

    Need Data Engineer with Hadoop, GCP, SQL, Kafka, Python and Scala experience. It's a part-time opportunity 2hrs per day payment will be accordingly 25-30k per month 1. Project is to migrate out of Talend & Teradata/Hadoop to GCP

    $313 Average bid
    $313 Avg Bid
    11 bids

    I'm looking for an expert to set up an active/passive server for my 24/7 e-commerce website. This should include a .NET web portal, an ElasticSearch, and a SQL database. I would also like to discuss the possibility of migrating to AWS cloud with the use of Lambda functions. Ideal candidates for this project should have: - Extensive experience with server setup and management. - Proficiency in .NET framework for web portal development. - Knowledge of ElasticSearch and SQL databases. - Prior experience with AWS and Lambda functions. Please note that I haven't decided on the migration of specific components to AWS yet, but I'm open to suggestions based on your expertise.

    $214 Average bid
    $214 Avg Bid
    65 bids

    ...writing unit test cases using Junit Jupiter. ● Experience with databases, including RDBMS and NoSQL (MongoDB, MySQL) ● Strong understanding of Git and any other sub version control system. ● Knowledge of build tools like Gradle or Maven ● Knowledge of application security, authentication & authorization ● Strong knowledge of REST API standards and conventions Good to have ● Some experience with Elasticsearch. ● Experience with payment gateways like Stripe ● Knowledge of dockers and containers ● Swagger specification standards ● Database migrations with Flyway or Liquibase ● Understanding of CI-CD Design: ● Familiarity with SOLID principles for software design. ● Knowledge of important Java Design Patterns, such as Singleton, Factory, Template, and Strategy, and the ability t...

    $59540 Average bid
    $59540 Avg Bid
    16 bids

    Hello all! I am looking for a well-versed Node.js developer experienced in OpenAI API, elasticsearch, PostgreSQL and Restful services. Tasks needed to be performed are below: a) Connecting with PostgreSQL with Restful services b) Send data to openai and other API (will share more details on chat) c) Basic UI/UX d) Search functionality to search for records (elasticsearch) e) AWS Setup

    $205 Average bid
    $205 Avg Bid
    103 bids

    I'm looking for a professional who can set up logging for my Django application using Elasticsearch 7.x. The logs should be formatted in JSON and the application is running on a Docker container based on the Python image. Key requirements: - Proficient in Django and Docker - Extensive experience with Elasticsearch, particularly version 6 - Ability to format logs in JSON - Familiarity with Python Docker base images

    $136 Average bid
    $136 Avg Bid
    17 bids

    Need a Nodejs Developer to create a web app based on openai API, elasticsearch and postgrsql. 1. Connect with postgrql database 2. Send data to openai and other API and create vectors of the date and store all the vectors of the data 3. Create a chatbot using openai API. whatever user will ask, get its reply from bot and get what to search in the database from the openai. searchterms are received by the openai, search for it in the background and show aside of the chatbot window on same page. 5. show a snippet of results of searched term like google results page with search term highlighted 6. user can click expand button and see complete record.

    $336 Average bid
    $336 Avg Bid
    53 bids

    ...front-end developers. 7. Server Management: Familiarity with server environments and basic server management tasks. 8. Testing: Experience with automated testing (PHPUnit) and debugging. 9. Algorithms: Strong understanding of algorithms and data structures. Additional Skills (Good-to-haves) --- 1. Search Optimization: Experience with search optimization techniques is a huge PLUS, including Elasticsearch or similar search technologies, to ensure relevant search results. 2. Security: Understanding of web security principles and best practices. 3. Microservices Architecture: Knowledge of Microservices and how they integrate with Laravel applications. 4. API Documentation: Experience with API documentation tools 5. Task Runners/Build Tools: Familiarity with tools like Webpa...

    $19 / hr Average bid
    $19 / hr Avg Bid
    194 bids

    ...Testing (PyTest or similar) Commit-Rollback Mechanism Initial Implementation of Basic Indexes Query Analysis and Optimization using ElasticSearch Database Specifications: Modularity: Each module must be independent and maintainable. Data Validation: Implement validation mechanisms before data insertion. Unit Testing: Include unit tests for each module and functionality. Commit-Rollback: Develop a commit-rollback system to handle errors before transaction commits. MVCC: Plan the integration of an MVCC model for concurrent transaction management. Indexes: Create initial basic indexes and plan the future use of ElasticSearch for query analysis and index optimization. Documentation: Provide detailed documentation of the database stru...

    $4897 Average bid
    $4897 Avg Bid
    53 bids

    I'm looking for an expert with a deep understanding of Elasticsearch and proficiency in open-source projects. The job is all about correcting logic bugs in Elasticsearch, with an emphasis on GitHub issues. The ideal candidate would have: - Outstanding debugging skills in bug fixing, specifically for logic bugs - Proficiency in open-source software projects - Deep insight into Elasticsearch's internal workings - Excellent understanding of data indexing, query execution, and aggregation - A good track record on GitHub, resolving issues Your job will mainly involve diagnosing and fixing these logic bugs, and ultimately enhancing the functionality of Elasticsearch. If you're cut out for this, please make a bid. Also it is expected to do knowledge t...

    $30 / hr Average bid
    $30 / hr Avg Bid
    26 bids

    I'm looking for an expert with a deep understanding of Elasticsearch and proficiency in open-source projects. The job is all about correcting logic bugs in Elasticsearch, with an emphasis on GitHub issues. The ideal candidate would have: - Outstanding debugging skills in bug fixing, specifically for logic bugs - Proficiency in open-source software projects - Deep insight into Elasticsearch's internal workings - Excellent understanding of data indexing, query execution, and aggregation - A good track record on GitHub, resolving issues Your job will mainly involve diagnosing and fixing these logic bugs, and ultimately enhancing the functionality of Elasticsearch. If you're cut out for this, please make a bid. Also it is expected to do knowledge t...

    $19 / hr Average bid
    $19 / hr Avg Bid
    23 bids

    ...pipelines. 3. Implemented data processing and indexing mechanisms. 4. Integrated AI models for content generation. 5. Performance-optimized backend system ready for deployment. Requirements - Proven experience in data engineering and backend development. - Proficiency in Python or Node.js. - Strong knowledge and experience with Next.js. - Experience with databases like MongoDB, PostgreSQL, or Elasticsearch. - Expertise in building and optimizing data pipelines. - Knowledge of AI models and their integration, particularly for NLP and embedding-based databases. - Familiarity with the Morphic repository or similar projects is a plus. - Ability to complete the project within the specified 1-month timeframe. - Excellent communication skills and ability to work collaboratively in a re...

    $113 Average bid
    $113 Avg Bid
    6 bids

    I'm currently seeking an expert to help with installing and configuring Elasticsearch on my WordPress site. Key tasks include: - Setting up Elasticsearch to handle specific search features. - Making Elasticsearch responsible for faceted search, full text search, autocomplete suggestions, filters, and recommendations. Skills & Experience: - Proficient in Elasticsearch and WordPress integration. - Strong understanding and practical experience with faceted and full text search functionalities. - Expertise in setting up autocomplete suggestions, filters, and recommendations using Elasticsearch. - Proven experience in successful WordPress troubleshooting. Your expertise will streamline my website's search features, forwarding its usability ...

    $148 Average bid
    $148 Avg Bid
    61 bids

    I'm in need of a Full Stack Web Developer with a high degree of experience in Java Spring Boot and React. The developer will be responsible for designing, developing, and maintaining my new website. Specific tasks will include: - Designing and implementing user interfaces using Java with React - Building and maintaining backend infrastructure - Ensuring the entire stack i...entire stack is designed and built for speed and scalability Ideal Skills and Experience: - Proficiency with Java and React - Full Stack Development experience - Strong knowledge in database management - Exceptional attunement to detail - Understanding of the web development process, including design and deployment - Proven ability to manage a diverse and challenging workload efficiently. - Elasticsearch k...

    $175 Average bid
    $175 Avg Bid
    30 bids

    ...for the returned speakers and answer questions based on information given in the unstructured fields. We would like to test the bot in a local environment (like just a jupyter notebook or a streamlit application), but it should be possible to transfer the bot to a web-based interface. Possible technologies/framework could be: - OpenAI API - Google Cloud Platform / BigQuery / Vertex AI - ElasticSearch - langchain If you know another tech stack that can solve this problem you can use it as well, of course! When you apply to this job, briefly outline what tech stack you would use and why and give us a short summary of existing projects you worked on that might be relevant or similar to this project...

    $561 Average bid
    $561 Avg Bid
    39 bids

    Hi, I want to setup following wordpress theme on my server along with the demo content I want to make it similar to i want similar features alon...content I want to make it similar to i want similar features along with similar links which has I also want to keep same options which nytimes has in its footer. you can use the demo content of the theme to set it up. I will provide you following things GCP Managed - ElasticSearch - WordPress on App Engine - Memorystore (Redis Cache) I also want to configure elasticsearch on it you have to help me with configuring ElasticPress Plugin and Yoast SEO Plugin. I also want you guys to configure Redis Cache on it.

    $443 Average bid
    $443 Avg Bid
    139 bids

    Currently seeking skilled IT Trainers for a vast range of disciplines. This includes, but isn't limited to: - Software development - Networking - Cybersecurity - C, C++ - Data Structures - Python - AI - Data Sciences - Hadoop Big Data etc. Requirements: - Expert knowledge and experience in the selected discipline. I am looking to hire a total of 15 instructors, each specialising in the above-mentioned disciplines. The training courses are short term, with a duration of 1 month. Please state clearly in your proposal your area of expert knowledge and prior experience in training. Reach out if you think you can handle this task, have a passion for IT, and love sharing your knowledge!

    $479 Average bid
    $479 Avg Bid
    8 bids

    I require an expert in Hadoop to carry out tasks ranging from installation and configuration to monitoring and troubleshooting. The ideal candidate should also be adept at data backup and recovery. Key Responsibilities: - Installation and configuration of Hadoop - Monitoring and troubleshooting of Hadoop cluster - Data backup and recovery Security Requirements: - User authentication and authorization - Data encryption - Network security Data Size: The data to be processed is on the smaller side, totalling up to 1 TB. Ideal Experience and Skills: - Proven experience as a Hadoop Administrator - Expertise in installation, configuration, monitoring, troubleshooting, and data backup and recovery - Strong understanding of user authentication, data encryption, and...

    $23 / hr Average bid
    $23 / hr Avg Bid
    11 bids

    ...mandatory trainings completed Knowledge Examples: - Programming languages – Java/ Python/ R / Scala - Web Services - Redshift S3 Spark DigitalOcean etc. - Statistical and data mining techniques: GLM/Regression Random Forest Boosting Trees text mining social network analysis etc. - Google Analytics Site Catalyst Coremetrics Adwords Crimson Hexagon Facebook Insights etc. - Computing Tools - Map/Reduce Hadoop Hive Spark Gurobi MySQL etc. - Database languages such as SQL NoSQL - Analytical tools and languages such as SAS & Mahout. - Practical experience with ETL data processing etc. - Proficiency in MATLAB. - Data visualization software such as Tableau or Qlik. - Proficient in mathematics and calculations. - Utilization of spreadsheet tools such as Microsoft Excel or Googl...

    $20 - $30 / hr
    Sealed NDA
    $20 - $30 / hr
    0 bids

    ...innovative environments. 7-8 years of professional experience in data engineering. Strong expertise in Microsoft Azure data services, particularly Azure Data Factory (ADF) and PySpark. Experience with data pipeline design, development, and maintenance. Proficiency in SQL and experience with NoSQL databases. Knowledge of ETL/ELT processes and tools. Familiarity with big data technologies such as Hadoop and Spark. Experience with Azure Databricks, Data Lake, SQL Database, and other Azure data services. Production experience delivering CI/CD pipelines across Azure and vendor products. Knowledge of architectural patterns across code and infrastructure development. Fully conversant with big-data processing approaches and “schema-on-read” methodologies, with a preference fo...

    $10203 Average bid
    $10203 Avg Bid
    15 bids

    ...Ubuntu OS and I'm looking for a skilled professional to configure and integrate an ElasticSearch module into it. My primary goal for this integration is to enhance the search speed on the site by utilizing ElasticSearch's capabilities. Search should also cover all item details such as name, title, attributes, etc. When new items are imported to OpenCart, ES should index them as well. Write a short instructions of what needs to be done (database and code /file changes) in order push your changes to production. Key Tasks: - Find a suitable ElasticSearch module for OpenCart 3. - Install and configure the module. - Ensure that the search functionality on the site is running fast and efficiently through ElasticSearch. - Write instructions for push in productio...

    $29 Average bid
    $29 Avg Bid
    25 bids

    I am seeking a skilled developer who can manage large sets of textual data on Elasticsearch and create visually appealing and interactive reports using Kibana. Key Responsibilities: - Handling large textual datasets: You should be adept at managing and querying large datasets efficiently. - Creating interactive dashboards with Kibana: The reports generated should be visually appealing, intuitive, and interactive. Experience and Skills: - Proficiency in Elasticsearch: You need to have a solid grasp of Elasticsearch's functionalities, and be able to efficiently handle large datasets. - Kibana: You should be an expert at creating visually appealing and intuitive reports using Kibana. - Data Management: Experience working with text data is crucial. You should know...

    $745 Average bid
    $745 Avg Bid
    14 bids

    I'm seeking a skilled professional who can assist me in setting up a High-Availability (HA) Hadoop cluster on AWS virtual machines. This cluster is primarily intended for big data storage, with the following specifics: - Cluster Size: The ideal setup will involve 6-10 nodes to accommodate substantial data processing and storage. - Additional Services: Beyond the base Hadoop setup, I require expertise in configuring HDFS High Availability and YARN Resource Management. Your role would be in ensuring these services are integrated seamlessly into the cluster for optimal performance and reliability. Your experience in Hadoop cluster administration, AWS setup, and knowledge of additional services like HDFS and YARN will be critical in delivering a successful project....

    $158 Average bid
    $158 Avg Bid
    4 bids

    ...**Reinforcement Learning**: Training models through rewards and penalties based on actions. 5. **Data Visualization**: - Creating graphical representations of data to communicate findings effectively. - Tools: Tableau, Power BI, Python (Plotly, Bokeh), and R (Shiny). 6. **Big Data Technologies**: - Managing and processing large-scale data using distributed computing. - Technologies: Hadoop, Spark, Hive, and NoSQL databases (MongoDB, Cassandra). 7. **Data Engineering**: - Building and maintaining the infrastructure and pipelines for data collection, storage, and processing. - Tools: SQL, ETL (Extract, Transform, Load) processes, Apache Kafka, and Airflow. ### Applications of Data Science 1. **Business Intelligence and Analytics**: - Improving decis...

    $11 / hr Average bid
    $11 / hr Avg Bid
    23 bids

    ...**Reinforcement Learning**: Training models through rewards and penalties based on actions. 5. **Data Visualization**: - Creating graphical representations of data to communicate findings effectively. - Tools: Tableau, Power BI, Python (Plotly, Bokeh), and R (Shiny). 6. **Big Data Technologies**: - Managing and processing large-scale data using distributed computing. - Technologies: Hadoop, Spark, Hive, and NoSQL databases (MongoDB, Cassandra). 7. **Data Engineering**: - Building and maintaining the infrastructure and pipelines for data collection, storage, and processing. - Tools: SQL, ETL (Extract, Transform, Load) processes, Apache Kafka, and Airflow. ### Applications of Data Science 1. **Business Intelligence and Analytics**: - Improving decis...

    $13 / hr Average bid
    $13 / hr Avg Bid
    13 bids

    ...response time, network latency, and ensure effective error handling for a web application. Tasks: Response Time Testing: Measure application responsiveness to user interactions or requests. Network Latency Testing: Assess delays in network communications affecting user experience. Error Handling Testing: Ensure the application gracefully handles unexpected inputs and errors. Tools: ELK Stack (Elasticsearch, Logstash, Kibana), Splunk 5. Cross-Browser/Device Compatibility Testing Project: Description: Ensure consistent performance and behavior across different browsers and devices. Tasks: Cross-Browser Testing: Verify application functionality across major browsers (e.g., Chrome, Firefox, Safari). Device Compatibility Testing: Ensure consistent performance on various devices ...

    $21 / hr Average bid
    $21 / hr Avg Bid
    27 bids

    ...who can help me with a two-fold project. The first part involves using a Virtual machine to perform Hadoop MapReduce and WordCount analysis. The second part is more focused on data collection, analytics and visualization using Databricks Notebook. Key Tasks: 1. **Hadoop MapReduce & WordCount Analysis:** - Utilize a Virtual machine to perform Hadoop MapReduce - Implement a WordCount analysis on the data 2. **Data Collection & Analytics:** - The data to be collected is unstructured in nature - Use Databricks Notebook for analytics 3. **Data Visualization:** - Create data visualizations using the Databricks platform Ideal skills for this job include: - Proficiency in using Hadoop ecosystem for MapReduce tasks - Strong experience with ...

    $142 Average bid
    $142 Avg Bid
    10 bids

    ...such as Django, Flask, and FastAPI. - Implementing scraping solutions to gather and process data from various online sources. Integrating scraping modules with backend systems to ensure seamless data flow and processing. - Utilizing SQL and NoSQL databases to store, retrieve, and manage data efficiently. - Designing and implementing monitoring, logging, and analytics solutions using ELK stack (Elasticsearch, Logstash, Kibana). - Writing clean, maintainable, and well-documented code following best practices and coding standards. - Collaborating with QA engineers to ensure software quality through automated testing and continuous integration. - Participating in code reviews, providing constructive feedback, and continuously improving development processes. Ideal candidate should ...

    $17 / hr Average bid
    $17 / hr Avg Bid
    16 bids

    ...looking for a skilled developer with experience in Hadoop to help me create a real-time data analysis application. Requirements: - The primary focus of this project is data analysis. You should have a strong background in analyzing data and be familiar with common data analysis techniques, tools and algorithms. - The system will need to integrate with various public datasets. Experience with dealing with such data sources will be essential. - The system should support real-time data analysis. So, expertise in real-time data processing and analysis is a must. Ideal Skills for the job: - Strong background in data analysis - Experience working with public datasets - Proficient in real-time data processing and analysis - Familiarity with Hadoop and its ecosystem, such as H...

    $41 Average bid
    $41 Avg Bid
    12 bids