I understand that you are looking for someone to set up an LLM model with API. This project requires deep knowledge in SageMaker but you are welcome to choose another solution if you know something better/cheaper.
I can provide the necessary skills and experience to complete this project. As an AI/ML developer, I have extensive experience in developing and implementing machine learning algorithms and models to solve complex problems. Additionally, I have experience with various machine learning frameworks and libraries such as TensorFlow, PyTorch, and scikit-learn which can be used to build intelligent systems that can analyze data, make predictions, and automate processes.
I am confident that my expertise can help you set up an LLM model with API quickly and effectively. With my help, you will be able to control when the model is turned on or unloads without paying for usage beyond what is required. Additionally, I can provide a REST endpoint for you to call with the prompt so it returns the response as a stream end end end