Elasticsearch nutch hadoop jobs
I am looking for a team to help me create a crypto reward-based social media platform. I want this website to allow posts,...cashback affiliate program, directory. I have some web design experience and will be assisting in the creation. Please only contact me if you have experience working with open source dolphin or similar software. Candidates must have experience installing open-source scripts from Github. Working knowledge of other frameworks including Apache Cassandra, React Native, AngularJS, PHP, Nginx, Elasticsearch, Ethereum, OpenZeppelin, Truffle, NativeScript, MetaMask, Redis, MongoDB, DroneCI, RabbitMQ, ZeroMQ, Vagrant, Docker, NodeJS, Gulp, Typescript, OpenSSL, , and NPM. Must be able to work with a team, have good communication skills, and be able to meet deadline...
...The site will provide a range of search facilities on a specialized text corpus. We have a working Python Flask application and plan to do a proof of concept (Phase 1) by hosting it 'as-is' on a Cloud platform with a view to making major enhancements over time. Possibilities include Docker, Azure, Anaconda, Heroku ... The main criteria for choosing are: 1) Python (anaconda) and Flask; 2) Elasticsearch (or solr) running against: a) At least 1 Gb of storage PDF/Word files (finally). About 100 Mb (in Phase 1); b) Database to handle full text search on these volumes. Some preference for MS SQL. 3) Low-cost hosting for Phase 1 which be very low-volume; 4) Reasonably priced final hosting for low-volume academic use. The current requirement is to recommend a plat...
Task From the Bitcoin core code github.c...entire history of the blockchain having convenient access to this data. If you take the original bitcoin and use its RPC or REST api, it works for a long time and is not convenient in some cases. There is no way to make any selection (according to the parameters we need), etc. At the moment, we have an application that takes data via RPC from the bitcoin client, processes it and throws it into elasticsearch. But we don’t really like this approach, because It requires a large amount of resources both on the bitcoin node and on the elastic storage. We would like to get around that path, namely, not to synchronize the Bitcoin node and then fill elastic, but to do it directly. condition: Using original c ++ bitcoin code Work on the term...
We are based in the EU and we are looking to hire talented Independent Contractors to work full-time (40+ hours...fluent). - Strong software engineering foundation with data structures, and algorithms. - Good software design skills. - Ability to do test-driven development. - Ability to recognize and fix race conditions. - Ability to optimize for performance for backend engineering. - Ability to effectively debug code. - Knowledge of Git - JAVA/ GO - Ruby/ROR - Angular - NodeJS - JavaScript - REST API - ElasticSearch - AWS We are looking to hire somebody confident in their technical skills and can solve new problems that they never encountered before. Recommended but not required: - Bachelors Degree or higher in Computer Science - NoSQL database (DynamoDB) - ReactNative or ReactJS ...
he tasks are first set up a focused crawler which collects the body (the text) of the url not only the url link. Connect this data to elasticsearch . The data pages should be shown in elasticsearch. So this focused crawler will be about Moroccan tourism. So I will create file will include 50 links about moroccan tourism. Then we should build classification model. Additionally . We will create negative file about stg else such footbal or politics rather than Moroccan tourism , so the crawler will filter the data
Hello, I am working on some project which needs develop shell script which utilities mapr utilities to copy data between source cluster on mapr v 5.2 Hbase into Maprdb on mapr v 6.1. There maybe requirement to copy data between hadoop hdfs locations as well. Need someone with expertise in hadoop to help develop / enhance existing scripts from past programmer with little or no documentation, add documentation for readability. Occasionally develop new program from scratch to help me speed along with my development project. I am looking to get comfortable with the develop, so firstly I had like to offer a fixed price project which includes develop the required scripts, help with optimizing the script, verification the migration is correctly done and also assist in copying an...
I need you to develop some software for me. I would like this software to be developed for Linux using Python, spark, hadoop, hive, netezza, sqoop
Hi All, I am working on Linux related stuffs like MySQL, ElasticSearch, NGINX, HAProxy and so on. So I need a person who can help me or guide me during the course. So it will be a lifetime job and will be paid for every hour they help me out. Thanks
I have a YouTube channel in Tamil and need Hadoop expert to create videos in tamil. Don’t need to show face. Just screen recording is enough. Only tamil speaking person is required.
...MySQL query optimization, database replication, Logical Volume Management (LVM) - Nginx/Apache configuration and rules - Good eye for UX design. We provide templates but you must integrate them aesthetically OPTIONAL SKILLS*: - Familiarity with automation tools like Selenium/PhantomJS or iMacros - Chrome extension and FireFox add-on development - Knowledge of full text search engines, such as Elasticsearch or Sphinx * Please let us know if you have any of these skills APPLICATION PROCESS: To evaluate whether you are a good fit for us, you will be paid for the first project on a freelance basis. Upon successful completion, you will be hired full-time based on the agreed salary. To apply: 1) What is your expected monthly salary? (ie. $800) 2) How long would it take you to compl...
We have a Web APP running on AWS and that is connected with My SQL database. We need to connect the My SQL with data warehousing platform such as Hadoop / Redis using open source Pipelines / connectors.
... - Where they should be - Where are there going to be - Etc... Workflow: - Whats going to happen to this asset - Conversion of a group of assets into a new one - Different workflows, physical and digital Tool need to be web based, with Android and IOS apps with reduced functions as read codebars, trace assets, etc... ElasticSearch preferred We need to publish also web service to reply other software status of the assets. We need to integrate our BLE, RFID, Scan solutions We need to integrate ZEBRA Software/Hardware (Printers, RFID Readers, Scans) Can be done from an open source based server adapted to cover our needs. Must be implemented in Azure and use they native services if possible. Thanks i...
Can you TODAY Install & configure a simple crawler & Elastic Search DB? 1. Install a simple crawler & crawl three newspapers and collect article data: title/image/date/author/summary/full_text/news_source 2. Install ElasticSearch DB & store crawled data 3. Build a simple Flask/python SEARCH web-app and display search hits with collected data including image (but don't display full text).
I am looking for a Big Data/ Hadoop trainer. Ability to teach with examples in Python or Java. Strong knowledge and experience in Hadoop Architecture, Map Reduce, Sqoop, Hive, Spark, and any No-SQL database. Duration 30 to 45 days, at least 1 to 1.5 hours a day.
...taken in response. - Automating and extending our AWS-based infrastructure and ensuring that our colleagues can be productive using our solutions. - Also site reliability testing Nice to have... - Software engineering background (ideally NodeJS, Python or Golang) - Kubernetes experience. - Experience in applications performance monitoring. - Experience with Big Data Infrastructure like Apache Hadoop cluster, Apache Spark, Databricks, or any other....
We have a big data project developed in scala spark, looking for a short term help in learning, teaching and prepare the training document. • Have project experience working with Spark, Scala and Hadoop • Needs to have strong development environment skills (git, Intellij, Gradle) • Should have familiarity with: Hadoop, Spark, Scala, Elastic search, restful API’s JSON, Tomcat • Needs to have general development environment skills (code control, IDE’s), understand processes such as unit testing, documentation, design for security and performance, dev environments and Linux
Need to write a scripted field query in Kibana to extract a substring
I have a Django project I'm hiring for. I will need an API for a mixed mysql/ambar (elasticsearch) backend to be used for a web application. Thorough documentation will be required as well. If interested I will PM you a document with the detailed description and design.
We are looking for an expert Azure DevOps engineer able to set up a CI/CD pipeline. The stack is composed by Angular and Django, Postgres, Elasticsearch.
Create time base index in ElasticSearch using nodejs
In my project, I want simulation of hadoop environment in which I want to test some algorithms which are implemented by mine. Initially some synthetic data is to be generated and access patterns should be formed from that data. By using these generated access patterns the proposed algorithms should be implemented in java. Should also be familiar with hadoop internals. i.e., should be able to modify the replication factors and read modules in hadoop.
We have an Hadoop/Hive environment that and we need to install and configure Impala (open source version - not Cloudera!!) on this environment
Need to consume data from different data sources and create a data lake This will serve as repository for other consumers who ever wants data from us . Should be willing remotely . Should know the latest big data architecture .
Need to do small work which includes hadoop nd linux
Hi Pulak P., I noticed your profile and would like to offer you my project. Here are some of the high level requirements: -Need an API for a mixed mysql/ambar (elasticsearch) backend to be used for a web application -Document the complete backend API/endpoints before any other work. This should include requests and json responses. -Document complete db schema, field types, index types, etc we can discuss additional requirements via email if you're interested. Thanks!
I'm looking for a BigData developer who can implement a small project for my Certification Course and give a test which will have 10 MCQ questions. PFA the Problem Statement PDF.
runs on PHP/Maria DB - MySQli/. Require to build a site search engine on Elasticsearch to display search results in certain predefined order/rank. Limit the index and extraction of results to certain tables in the dB. Nacfun engages largely children (adults as well) with home video and image based activities, challenges, quizzes and study material. These activities are published by NacFun content writers or faculty of schools participating in the program. Kindly review the site and read the following to have the proper context.; The search results should be grouped and displayed in the following order. 1. Published by NacFun Content writer - Video challenges (instruction based physical fun sports ) - Video Contests ( fun activity like blow 100 ballons) - Image Contests (art
Hi, I have a Magento 2 (2.3.5) website with Martfury theme and I have some issues. 1. ElasticSearch - with version 7.7 - Mirasvit Autocomplete doesn't work - when I've installed ES 6.8 it is works. 2. With enabled elasticsearch - Amasty Layered navigation doesn't show manufacturers - If I choose Native MySQL for search engine - it is works. 3. Some CSS styles fixing between Amasty Shop by Brand and Auto Related products with the Martfury theme. (To look similar to Martfury sliders/blocks). Thank you
I want someone to deploy elastic search cluster on two nodes in Production Elasticsearch nodes should start automatically after server restart / Failure Deployment will be done through zoom Documentation will also be required after deployment, regarding steps performed Bidder should tell the best approach which he/she will use in deploying maybe using Docker / or without Docker Mention word "ARESKA" in your bids after reading description
We are under study for the visual and new functionalities the next step will be the application. To work in PHP Laravel and Semantic UI. Do you have to have everything in PPE to make the app? Steps - 1 D...site "you make links to associate them on our site"? - 4 app delivery on apple and android stores How long in total 1 Week - 2 Months? If I understand your method correctly, you give information to users of the app and push yourself into the site? Thank you for your feedback For the functionality we would simplify the site User / Professional connection "for messages" Using the "elasticsearch" search bar Use of the news and the online post "not yet on the site" You will make an iOS and android version of the app Tell ...
The requirement is to write a PEP-8 compliant, well documented Python code that takes user-driven inputs and parse the contents recursively. Followup queries on the code should be answered via email form your end. There is some sample data below this folder, you will need to translate it from the .xml and .properties file into json data that is suitable for importation into elasticsearch where it will be searchable - all fields should be searchable. We need the following items in each test result: • junit results are split into collections of suites, which have a known name. Each suite has a stdout and stderr. • testsuite has: â—‹ file, name, stdout, stderr, duration, timestamp and time â—‹ Each suite is split into one or more testcases, each case has the following man...
I currently have a script that parses the iTunes API and puts the data into ElasticSearch and Cassandra databases. It crawls the RSS feeds twice per day. It checks iTunes for new Podcasts every day as well. Here is an example of an RSS feed that it parses. So there are Podcasts which are like audio shows. And then each Podcast has multiple episodes. In other words, each Podcast has one RSS feed and each RSS feed shows the episodes for that podcast sorted by newest release date first. The current developer of the script is not very responsive to making changes. So your job is to 1 - There are some parse errors for some of the podcast rss feeds. 2 - We are missing a lot of podcasts from iTunes. We can get some of those from another websites API. 3 - Setup
I need you to develop some software for me. I would like this software to be developed for Linux using Java. To improve mapreduce
...smart phone sensors data, such as GPS, accelerometer, etc., from several users. The sensor data are stored in a Big Data infrastructure. (i) Chose a database type solution for the sensor data storage and explain the rationale of your choice and the involved trade-offs. (iii) Provide an example of how the data records in the database look like Model an automated and decentralized load balancer for Hadoop cluster computing infrastructures using the EPOS system. Specifically determine the following: what the agents and plans represent, what the global (system-wide) and local (agent) objectives are, what could be the agent preference trade-offs over the two objectives and how these preferences are modeled. Illustrate an application scenario of decentralized in-network aggregation s...
I looking for Grafana, prometheus, elesticsearch Expert to create Dashboard panels for Prometheus and Elasticsearch datasources. Regards
# Background We are a SaaS company that sells big data insights in the real estate market. We have three products in production, serving different segments of the same...address, 2 x equity holders * Arizona, US : sales, BPO, commercial offices, 2 x equity holders * California, US : 2 x developers (backend) * South America: 1 x developer * Europe / Asia : 5 countries, 7 people (design, devops, development, data science) ### Stack Frontend: React + Redux + Sagas // custom functional package (moving away from this ) // Firebase Hosting Backend: Django / Go / ElasticSearch 7+ / Kong / Postgres Our ES indices are ~6TB with a couple dozen TB of source data. ### Hiring Process * Chat on Upwork * Continued discussion over video/local * Begin work ### How to Apply Apply here so we...
I need the Saleor opensource django site converted to a multi-vendor marketplace. Saleor repository: basic project details The website will be a search engine similar t...managing the products, managing the vendor profiles and viewing reports. Can delete, suspend, or refuse vendors or products. Captcha powered forms: Registration form is powered with Captcha support. Product and Vendor reviews: Comes with in-build review system for both products and sellers. Extention of warehouse model: The warehouse must be extended to include additional fields important for elasticsearch. These fields will not be visable of assessable to vendors or consumers. Only for application use. Additional information: No payment handling or shipping No Vendor subscriptions.
Hi, I have a sports website. The frontend is developed using VueJS and backend is developed using Java. Both are separately dockerised. I want it to move it from Amazon AWS to another server. No source will be provided and migration will be done using screen sharing / remote control. Do not copy paste bid and type I can do it so that I know you're not a bot. Need to be done ASAP and...The frontend is developed using VueJS and backend is developed using Java. Both are separately dockerised. I want it to move it from Amazon AWS to another server. No source will be provided and migration will be done using screen sharing / remote control. Do not copy paste bid and type I can do it so that I know you're not a bot. Need to be done ASAP and needs skills of Java, Docker, VueJS, Elast...
I need someone i can pay hourly that knows how to work fast and efficient. the project include building an API in lumen framework (php) and connect it properly to ReactJS via modern documentation. its a long project but Im looking for someone that have experience in working in PHP lumen framework and reactJS, working with elasticsearch and mysql DBs. its work with very tight deadlines and no time to waste so if you are busy in other projects, dont reach out. its not a product for outsourcing so propose if you are a "product manager" or a "dev company" ... only single talented freelancer. * Fluent understandable english is a requirement.
Currently an application is developed using pimcore - a php framework which uses elasticSearch service using the elasticSearch PHP client , We have an random slowness i.e high respinse time around 2 minutes while making request through the easticsearch-php client where as directly hitting to elastisearch using kibana hosted on aws in always less than 2ms. Need to debug/ fix this random slowness
I'm looking for a freelancer who can create video courses on 'Developer Tools - Elasticsearch' that could be hosted on an online learning platform. Please revert on your experience in online training and the language that will be used in the training.
I need a data pipeline designed using S3, Kafka, Spark, and Elasticsearch / Snowflake. Something a lot like what is described in this Esri presentation - however a lot simpler as we will do a basic spark transformation (not build a complex library of batch and real-time transformations). The process is that: JSON files will be dropped into S3, these will be instantly picked up by Kafka and Processed by Spark, then this processed data will be pushed into elastic ready for access via the HTTP api and also into snowflake for querying later. Don’t mind if there’re are any suggestions on how to do this better. Prefer using serverless products AWS or GCP. Fine with either Python or Java. The final deliverable is the data pipeline with documentation, and
Hello, We have a website with around 200k active products on - mainly within the electronic categories. Right now we have elasticsearch implemented but not working according to our goals and standards. It have been working the same way for nearly two years but time has come to making the adjustments necessary for getting a good working search-function. Right now our elasticsearch function only search on "term" and not "multiword queries" 90% of the results are bad. We are searching for a partner that can drive the project and implement it on our website.
with using the hadoop enviroment, the given task needs to be completed.
Hello,
 We are looking for someone with: - an overall good level in software engineering - a really good communication skills - a really good internet connection and audio quality to talk - elasticsearch knowledge ( bonus) - curiousity, and willingness to learn DM me for more info
Task From the Bitcoin core code github.c...entire history of the blockchain having convenient access to this data. If you take the original bitcoin and use its RPC or REST api, it works for a long time and is not convenient in some cases. There is no way to make any selection (according to the parameters we need), etc. At the moment, we have an application that takes data via RPC from the bitcoin client, processes it and throws it into elasticsearch. But we don’t really like this approach, because It requires a large amount of resources both on the bitcoin node and on the elastic storage. We would like to get around that path, namely, not to synchronize the Bitcoin node and then fill elastic, but to do it directly. condition: Using original c ++ bitcoin code Work on the term...
