Skip to content

Java: Add rate limit metadata values to OpenAIStreamingChatMessageContent and OpenAIChatMessageContent #203

Open
@d3r3kk

Description

@d3r3kk

Raw Azure OpenAi chat completion response contains additional headers, which contain information about rate limits:
x-rate-limit-remaining-requests and x-ratelimit-remaining-tokens. Would it be possible to add these values to the Metadata dictionary in both OpenAIStreamingChatMessageContent and OpenAIChatMessageContent class? I find rate limit information useful, but in current .Net implementation there is no way to access it.

See microsoft/semantic-kernel#8421 for the .NET version of this issue.

Metadata

Metadata

Assignees

No one assigned

    Labels

    javaPull requests that update Java code

    Type

    No type

    Projects

    Status

    No status

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions