Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Support for outputting token usage #237

Open
vazirim opened this issue Dec 19, 2024 · 2 comments
Open

Support for outputting token usage #237

vazirim opened this issue Dec 19, 2024 · 2 comments

Comments

@vazirim
Copy link
Member

vazirim commented Dec 19, 2024

Is your feature request related to a problem? Please describe.
It would be useful to know the token usage of a program.

Describe the solution you'd like
Use the functionality in LiteLLM to surface this in PDL: https://docs.litellm.ai/docs/completion/token_usage

Describe alternatives you've considered
N/A

Additional context

This issue was proposed by @eloycoto.

@vazirim
Copy link
Member Author

vazirim commented Feb 17, 2025

This information could also appear in Jaeger and in the new UI.
@esnible @starpit

@vazirim
Copy link
Member Author

vazirim commented Feb 17, 2025

Double check with @esnible that we are getting this info already with open-telemetry.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant