Jan version

0.5.13

Describe the Bug

I have downloaded multiple models in the "Hub" tab, such as multiple Llama, Qwen, Mistral, and llava models. I can use the Llama, Qwen and Mistral models without any issue, but all of the Llava models fail to load. Instead, I get an error message reading

Fail to load model with ID 'bakllava-1': filesystem error: cannot get file size: No such file or directory []

in the example of BakLlava. I can verify that the files have been downloaded into my data folder, but I've noticed that the Llava models are located directly in $PREFIX/data/models while the other models are downloaded into a $PREFIX/data/huggingface.co/... folder.

I'm using the .deb package and run it on Debian 12.

Steps to Reproduce

1. in "Hub", find model LlaVa 7B and click on download
2. wait for the download to complete
3. click on "Use"
4. give a prompt (e.g., "tell me a joke")
5. receive error message

Fail to load model with ID 'llava-7b': filesystem error: cannot get file size: No such file or directory []

Something's wrong. Access troubleshooting assistance now.

Screenshots / Logs

cortex.log
app.log

What is your OS?

• MacOS
• Windows
• Linux