• Usage about deploy LLM in Computing Power Platform

• This process is responsible for listening to the memory consumption ratio of CUDA

nvidia-smi -l 1

• Run Ollama serve

ollama serve

• This process is responsible for running the Open-WebUI

open-webui serve

• This process is responsible for running Ngrok for Intranet penetration

ngrok http 8080

Be sure to turn off Academic acceleration(VPN)