This sample project deploys an Amazon API Gateway REST API with an AWS Lambda integration. The Lambda function is written in Java, calls the Amazon Bedrock API for Anthropic Claude-v2 model and returns a response containing the generated content.

Learn more about this pattern at Serverless Land Patterns: https://serverlessland.com/patterns/apigw-lambda-bedrock-cdk-java

Important: this application uses various AWS services and there are costs associated with these services after the Free Tier usage - please see the AWS Pricing page for details. You are responsible for any AWS costs incurred. No warranty is implied in this example.

• Create an AWS account if you do not already have one and log in. The IAM user that you use must have sufficient permissions to make necessary AWS service calls and manage AWS resources.
• Anthropic Claude fundamental model access requested (check Prerequisite to see details).
• AWS CLI installed and configured
• Git
• Java 21
• Maven 3
• AWS Cloud Development Kit (AWS CDK)

This pattern uses Anthropic Claude fundamental model provided by Amazon Bedrock. It is required to request access to the model before starting using the pattern. Please refer to the link below for an instruction: Model access.

1. Create a new directory, navigate to that directory in a terminal and clone the GitHub repository:

   git clone https://github.com/aws-samples/serverless-patterns

2. Change directory to the pattern directory:

   cd apigw-lambda-bedrock-cdk-java/infrastructure

3. From the command line, configure AWS CDK:

   cdk bootstrap ACCOUNT-NUMBER/REGION # e.g.
   cdk bootstrap 1111111111/us-east-1
   cdk bootstrap --profile test 1111111111/us-east-1

4. From the command line, use AWS CDK to deploy the AWS resources for the pattern as specified in the lib/cdk-stack.ts file:

   deploy.sh

This CDK project uses the Amazon Bedrock API for Anthropic Claude-v2 model to generate content based on given prompt. This is exposed through a serverless REST API. Please refer to the architecture diagram below:

Here's a breakdown of the steps:

1. Amazon API Gateway: Receives the HTTP POST request containing the prompt.

2. AWS Lambda: Triggered by the API Gateway, this function forwards the prompt to Amazon Bedrock API using Bedrock SDK. It uses Anthropic Claude-v2 model and sets other required parameters to fixed values for simplicity.

3. Amazon Bedrock: Based on the given prompt, using Anthropic Claude-v2 model generates the content and returns the response to Lambda.

4. Response: Lambda processes the Bedrock output and sends it back to the user via the API Gateway.

Test the deployed content generation API by providing a prompt. You can use curl to send a HTTP POST request to the API. Replace BedrockRestApi with the API URL in the CDK output, which has a name beginning with ApiGatewayLambdaBedrockStack.LambdaBedrockAPIEncpoind :

curl -d '{"prompt": "Please calculate with step-by-step explanation: 2+2*2"}' -H 'Content-Type: application/json'  <BedrockRestApi>

The API returns a response with generated content. Your output may vary:

{
	"response": " Okay, let's solve this step-by-step:\n2 + 2 * 2\nStep 1) Perform the multiplication first: 2 * 2 = 4\nStep 2) Now perform the addition: 2 + 4 = 6\n\nTherefore, the final answer is:\n2 + 2 * 2 = 6"
}

1. To delete the resources deployed to your AWS account via AWS CDK, run the following command:

cdk destroy

Copyright 2023 Amazon.com, Inc. or its affiliates. All Rights Reserved.

SPDX-License-Identifier: MIT-0