Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feature: different claude model for auto suggestions #774

Closed
trevorwhitney opened this issue Oct 30, 2024 · 2 comments
Closed

feature: different claude model for auto suggestions #774

trevorwhitney opened this issue Oct 30, 2024 · 2 comments
Labels
enhancement New feature or request

Comments

@trevorwhitney
Copy link

trevorwhitney commented Oct 30, 2024

Feature request

I want to use claude sonnet for chat, but claude haiku for auto suggestions.

Motivation

Haiku is faster and cheaper, but sonnet is better and more accurate. So, I'd like to give the small/quick tasks to haiku, while still chatting with sonnet.

I currently use the copliot plugin for auto-suggestions, but they seem to keep adding new Copilot features to VS Code while abandoning the vim plugin, so I'm looking for other options with more flexibility.

Other

I can take a stab at a PR if you have a vision for how this should be implemented, ie can claude have multiple modes, and one must specify claude-sonnet or claude-haiku to specify which mode they'd like to use?

@trevorwhitney trevorwhitney added the enhancement New feature or request label Oct 30, 2024
@JonatasAmaral
Copy link

Hey, seen it could be done with custom providers, so you copy the official claude one, setting only the model to haiku

vendors = {
      claude-haiku = {
            ...
      }
}

and in you config

    provider = "claude", -- Recommend using Claude
    auto_suggestions_provider = "claude-haiku",

@aarnphm
Copy link
Collaborator

aarnphm commented Nov 5, 2024

hmm we can add claude-haiku and claude-opus to default vendors, given that it makes sense

for copilot it would be a catch up game for sure.

@aarnphm aarnphm closed this as completed in 8699ada Nov 5, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

3 participants