Elasticsearch Jobs

Search Engine Build a search engine that can be started with docker compose and run a few services - Meilisearch as the database and search engine with AI embedding - Use infinity as the embedding api - Nextjs Web UI for searching and admin screen - Scheduler/scraper for gathering data (scrapy with python) - Nginx web server The scheduler/scrapper will be given a list of websites to routing gather from. These websites are primarily - Online books, both text and pdf - Online videos- YouTube channels (need to search transcripts, api can be used) - Online recordings (need to search transcripts) - Bibles (ESV, NASB, KJV, Louis Second, Darby etc) The data would be loaded into meilisearch and routinely refreshed if data is older than a certain age and hash has changed. We should routin...

NEED THIS DONE ASAP! DONT APPLY IF YOU CANT START NOW! AND DONT HAVE EXPERIENCE! We are seeking a skilled developer to handle data scraping and database setup for a high-performance chatbot project. This role involves collecting structured data from multiple websites and designing a robust database to store and retrieve the information efficiently. Responsibilities Data Scraping Identify target websites and develop web scrapers using tools like BeautifulSoup, Scrapy, or Selenium. Automate the scraping process using AWS Lambda or other scheduling tools. Extract relevant data such as schedules, events, and other updates from dynamic or static websites. Clean and format the scraped data into structured formats (e.g., JSON, CSV). Database Setup Design and implement a schema for storing t...

I need someone to help me to download all our project code from an AWS EC2 instance. What I need you to do: - Access the EC2 instance and download all project code, configuration files, and related data from the cloud. Ideal candidate: - Proficient with AWS, particularly EC2 instances. - Comfortable in handling various types of code files including source code, database files, and configuration files. - Experienced in dealing with JavaScript, Python, and Java. - Able to ensure the secure and efficient retrieval of data.

I'm seeking a professional to assist with transferring a mixed type of data (documents, media files etc.) from a Kubernetes Elastic logs cabinet to a NAS storage. Key details: - The total data size exceeds 5TB - The current data organization in the cabinet is structured in specific folders. Ideal candidates for this project should have: - Prior experience with large scale data transfers - Knowledge of Diskstation Synology NAS storage systems - Ability to maintain the existing organizational structure during the transfer