← Back to changelog
Marc Klingen
July 20, 2023
Tokenization for exact token counts
Marc KlingenFor OpenAI and Anthropic models token counts are now automatically calculated. This is helpful for streaming endpoints that do not return usage data.
Marc KlingenFor OpenAI and Anthropic models token counts are now automatically calculated. This is helpful for streaming endpoints that do not return usage data.