Replies: 3 comments
-
Hi, @3inary I made this work on a test, but this will require some refactoring of the current request dispatcher. I can bring this over this week. |
Beta Was this translation helpful? Give feedback.
-
Hello. This would be awesome because that's kind of complex to do in Unity with UnityWebRequest. Did you succeed to do it @srcnalt ? |
Beta Was this translation helpful? Give feedback.
-
Just released streaming support for text and chat completion endpoints. Tbh, I'm not super happy with how I had to implement it but works as intended. You can find example usage in the readme and in endpoint tests. Also a sample added for this feature. |
Beta Was this translation helpful? Give feedback.
-
Thanks for this well crafted package!
I have a request, could you please add Streaming to completions?
As described in the API:
stream boolean Optional Defaults to false
Whether to stream back partial progress. If set, tokens will be sent as data-only [server-sent events] as they become available, with the stream terminated by a data: [DONE] message.
With media type "application/octet-stream"
Beta Was this translation helpful? Give feedback.
All reactions