Skip to content

v0.6.5

Latest
Latest
Compare
Choose a tag to compare
@tp-nan tp-nan released this 25 Oct 05:18
· 94 commits to main since this release
v0.6.5
fb12d25
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Learn about vigilant mode.

What's Changed

Full Changelog: v0.6.3...v0.6.5

  • experimental streaming openai interface for llama2.
  • Consolidate the code supporting TensorRT >= 8.5, 9, and 10.
  • Some bug fix
Assets 2
Loading