Skip to content

Latest commit

 

History

History

langchain-chains-demo

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
README.md
README.md
 
 
bentofile.yaml
bentofile.yaml
 
 
requirements.txt
requirements.txt
 
 
service.py
service.py
 
 

README.md

LangChain + BentoML + OpenLLM

Run it locally:

export BENTOML_CONFIG_OPTIONS="api_server.traffic.timeout=900 runners.traffic.timeout=900"
bentoml serve

Build Bento:

bentoml build

Generate docker image:

bentoml containerize ...
docker run \
  -e SERPAPI_API_KEY="__Your_SERP_API_key__" \
  -e BENTOML_CONFIG_OPTIONS="api_server.traffic.timeout=900 runners.traffic.timeout=900" \
  -p 3000:3000 \
  ..image_name