bug: Docker container blasts config every time it start. #1861
Description
Cortex version
All
Describe the issue and expected behaviour
I noticed after updating my cortex that my specific config changes kept getting removed. Including CORS, allowed hosts, hugging face model.
Steps to Reproduce
The issue is that in docker/entrypoint.sh the config file is ruined upon startup. The cortex fills in the rest with defaults.
echo "apiServerHost: 0.0.0.0" > /root/.cortexrc
Additionally, the config file is inside of the container, and using the provided documentation it will not survive across removal and recreation of the container:
Docs say:
docker run --gpus all -it -d --name cortex -v cortex_data:/root/cortexcpp -p 39281:39281 menloltd/cortex
However, the config is not in that folder, as evidenced by the running command:
cortex-server --ignore_cout --config_file_path /root/.cortexrc --data_folder_path /root/cortexcpp
So there are two problems here. 1) The instructions have the user create a container and the config is implied to be temporary, which it is not. If you make a config outside of the container and reference it with -v, the container start process overwrites the file when it starts.
Screenshots / Logs
No response
What is your OS?
- Windows
- Mac Silicon
- Mac Intel
- Linux / Ubuntu
What engine are you running?
- cortex.llamacpp (default)
- cortex.tensorrt-llm (Nvidia GPUs)
- cortex.onnx (NPUs, DirectML)
Hardware Specs eg OS version, GPU
No response
Metadata
Assignees
Labels
Type
Projects
Status
Investigating