Open
Description
Context
for a better and stable inference performance
Current Solution
the client code
octogen/agent/src/og_agent/codellama_client.py
Lines 37 to 56 in 9fc446b
the llama server
Lines 24 to 26 in 9fc446b
Context
for a better and stable inference performance
Current Solution
the client code
octogen/agent/src/og_agent/codellama_client.py
Lines 37 to 56 in 9fc446b
Lines 24 to 26 in 9fc446b