You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
The current way the pipeline is implemented to ensure that we stay within a given QPM rate limit is that we wait before asynchronously sending another prompt. However, for chat instances, a prompt can be a list of messages that we send. This means we're actually waiting a time before initialising a chat and within a particular chat, we don't do any waiting between messages.
The text was updated successfully, but these errors were encountered:
The current way the pipeline is implemented to ensure that we stay within a given QPM rate limit is that we wait before asynchronously sending another prompt. However, for chat instances, a prompt can be a list of messages that we send. This means we're actually waiting a time before initialising a chat and within a particular chat, we don't do any waiting between messages.
The text was updated successfully, but these errors were encountered: