Calculating Token for GPT-4o with Images (Streaming) #9020
-
We need to log usage for tracking . As the streaming api does not return usage information, so far for textual content, we have been using sharptoken to calculate the approximate number of tokens of the conversation . In GPT-4o as we send Base64 encoded images this approach doesn't seem to work . Would like to understand from either Microsoft or the community if there is a recommendation on how to calculate tokens for images in the chat conversation |
Beta Was this translation helpful? Give feedback.
Answered by
moonbox3
Sep 30, 2024
Replies: 1 comment 3 replies
-
@jmurkothintel are you targeting .Net or Python? |
Beta Was this translation helpful? Give feedback.
3 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Thanks for your response, @jmurkothintel. This functionality is not yet available in .Net. Here is the issue tracking it: #9005.