Skip to content
This repository has been archived by the owner on Mar 6, 2024. It is now read-only.

Mistral API compatibility #512

Open
Open
@Onigam

Description

Instead of using OpenAI api I want to use Mistral AI api using the 8x7B model.

The only blocker with this code is the presence_penalty: 1 parameter in the index.js file, we just need to remove this line
to avoid OpenAI error 422 due to this Extra inputs not supported and permitted from Mistral API

I created a fork with this fix here

Now I'm using Mistral instead of OpenAI than is a lot cheaper

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions