Is there an existing issue for this?
Contact Details
No response
What should this feature add?
I'd like a token counter/word counter on the prompt input box. It should show approximately how many tokens would be sent to the model on generation.
Why? It's fairly known that many models lose coherence/adherence past a certain token count. By giving the user some helpful guardrails on the prompt, they will get better results.
Alternatives
Having to paste it into another tool is annoying, but workable.
Additional Content
No response
Is there an existing issue for this?
Contact Details
No response
What should this feature add?
I'd like a token counter/word counter on the prompt input box. It should show approximately how many tokens would be sent to the model on generation.
Why? It's fairly known that many models lose coherence/adherence past a certain token count. By giving the user some helpful guardrails on the prompt, they will get better results.
Alternatives
Having to paste it into another tool is annoying, but workable.
Additional Content
No response