Skip to content

2.3.4
Compare
Choose a tag to compare
@ngxson ngxson released this 25 Jul 10:15
· 1 commit to master since this release
2.3.4
c267097
This commit was created on GitHub.com and signed with GitHub’s verified signature.
GPG key ID: B5690EEEBB952194
Verified
Learn about vigilant mode.

What's Changed

Small fix for KV cache management, which cause some issues with hybrid and recurrence models

  • if KV rm fails, we should clear the whole cache by @ngxson in #188

Full Changelog: 2.3.3...2.3.4

Contributors

ngxson
Assets 2
Loading