Skip to content

Commit

Permalink
feat: enable streaming for o1 models (yetone#896)
Browse files Browse the repository at this point in the history
As of a few days ago, o1 models support streaming responses. Please see:
https://community.openai.com/t/openai-o1-streaming-now-available-api-access-for-tiers-1-5/1025430
  • Loading branch information
abatilo authored Nov 24, 2024
1 parent c8e688a commit e60ccd2
Showing 1 changed file with 0 additions and 1 deletion.
1 change: 0 additions & 1 deletion lua/avante/providers/openai.lua
Original file line number Diff line number Diff line change
Expand Up @@ -147,7 +147,6 @@ M.parse_curl_args = function(provider, code_opts)
-- NOTE: When using "o1" set the supported parameters only
local stream = true
if base.model and string.find(base.model, "o1") then
stream = false
body_opts.max_tokens = nil
body_opts.temperature = 1
end
Expand Down

0 comments on commit e60ccd2

Please sign in to comment.