A tool for customers to evaluate their AWS service configurations based on AWS and community best practices and receive recommendations on potential improvements.

Prompt design using JSX.

Harness LLMs with Multi-Agent Programming

Model components of the Llama Stack APIs

Open Source framework for voice and multimodal conversational AI

Foundation Model Evaluations Library

Build Conversational AI in minutes ⚡️

"Sandbox Accounts for Events" allows to provide multiple, temporary AWS accounts to a number of authenticated users simultaneously via a browser-based GUI.

This repository contains the code and infrastructure as code for a Generative AI-powered Request for Proposal (RFP) Assistant leveraging Amazon Bedrock and AWS Cloud Development Kit (CDK).

AWS Nitro Enclaves Vault

CDK stack for self-hosting Langfuse on AWS

Hosting Langfuse on Amazon ECS with Fargate using CDK Python

Easily use and train state of the art late-interaction retrieval methods (ColBERT) in any RAG pipeline. Designed for modularity and ease-of-use, backed by research.

Home to all tools related to Amplify's code-first DX (Gen 2) for building fullstack apps on AWS

VectorHub is a free, open-source learning website for people (software developers to senior ML architects) interested in adding vector retrieval to their ML stack.

Finetune Llama 3.2, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

This repository provides sample code to help customers easily connect to AWS IoT Core and learn more about how the AWS IoT Sensors mobile app publishes sensor data from mobile phones to AWS.

This Guidance demonstrates how to build an internal Software-as-a-Service (SaaS) platform that provides access to foundation models, like those available through Amazon Bedrock, to different busine…

OpenAI-Compatible RESTful APIs for Amazon Bedrock

Deploy Your LLM Chatbot in Databricks

LLMPerf is a library for validating and benchmarking LLMs

Source repo of Building SaaS applications on Amazon EKS using GitOps workshop

Demonstration of Natural Language Query (NLQ) of an Amazon RDS for PostgreSQL database, using SageMaker JumpStart, Amazon Bedrock, LangChain, Streamlit, and Chroma.

Foundation model benchmarking tool. Run any model on any AWS platform and benchmark for performance across instance type and serving stack options.

SaaS Builder Toolkit for AWS is a developer toolkit to implement SaaS best practices and increase developer velocity.