This repository has been archived by the owner on Mar 6, 2024. It is now read-only.
Open
Description
Instead of using OpenAI api I want to use Mistral AI api using the 8x7B model.
The only blocker with this code is the presence_penalty: 1
parameter in the index.js file, we just need to remove this line
to avoid OpenAI error 422 due to this Extra inputs not supported and permitted from Mistral API
I created a fork with this fix here
Now I'm using Mistral instead of OpenAI than is a lot cheaper
Metadata
Assignees
Labels
No labels