Anthropic and get_count_tokens #623
miguelrgonzalez
started this conversation in
General
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
I'm using Anthropic models via Bedrock and I'm getting the following warning when trying to count tokens for this model.
I understand this is because the newer Anthropic API is not yet supported in Bedrock itself.
what's the recommended approach to get somewhat accurate token counts other than using the fallback?
Beta Was this translation helpful? Give feedback.
All reactions