🪢 Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. 🍊YC W23

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

The open-source LLMOps platform: prompt playground, prompt management, LLM evaluation, and LLM Observability all in one place.

Prompt & Conversation Management Middleware for Conversational AI APIs such as OpenAI ChatGPT, Facebook Hugging Face, Anthropic Claude, Google Gemini, Ollama and Jlama. Lean, restful, scalable, and cloud-native. Developed in Java, powered by Quarkus, provided with Docker, and orchestrated with Kubernetes or Openshift.

An Automated AI-Powered Prompt Optimization Framework

🪢 Langfuse documentation -- Langfuse is the open source LLM Engineering Platform. Observability, evals, prompt management, playground and metrics to debug and improve LLM apps

Open Source LLM proxy that transparently captures and logs all interactions with LLM API

Building blocks for rapid development of GenAI applications

Managed Prompt Engineering

An open-source prompt engineering framework.

An easy-to-use structured prompt builder for LLMs in TypeScript.

These guides are designed to help teams and individuals leverage AI tools like GitHub Copilot, OpenAI, and Claude to build software projects efficiently and effectively

The prompt engineering, prompt management, and prompt evaluation tool for Python

The prompt engineering, prompt management, and prompt evaluation tool for TypeScript, JavaScript, and NodeJS.

A lightweight, intuitive templating language designed for interactive use in LLM chat sessions.

Documentation for managing prompts and outputs and working professionally with large language models (LLMs)

The prompt engineering, prompt management, and prompt evaluation tool for Go.

A Chrome extension that enhances ChatGPT by providing quick access and management of prompts, streamlining interactions for improved efficiency and a better user experience. Perfect for optimizing your ChatGPT workflow.

The prompt engineering, prompt management, and prompt evaluation tool for Java.