Skip to content

mrcichon/llmchat

Repository files navigation

currently houses a minimal implementation of RAG, along with the beginings of not-so-minimal one. different base models are being tested on TruthfulQA, with different embedding models being tested on LEPISZCZE and KLEJ

instructions to run

docker run -p 6333:6333 -v ~/path/to/loca/vector/database:/qdrant/storage:z qdrant/qdrant

ollama create newmodelname --file path/to/model/file

uvicorn app:app --reload

About

simple RAG for now

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages